-- Logs begin at Tue 2022-08-30 23:30:47 UTC, end at Wed 2022-08-31 00:39:16 UTC. -- Aug 31 00:05:28.711406 dv-cinder-852210-5-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Aug 31 00:05:28.722734 dv-cinder-852210-5-iscsi devstack@keystone.service[81510]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 31 00:05:28.724829 dv-cinder-852210-5-iscsi devstack@keystone.service[81510]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 31 00:05:28 2022] *** Aug 31 00:05:28.724935 dv-cinder-852210-5-iscsi devstack@keystone.service[81510]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 31 00:05:28.724935 dv-cinder-852210-5-iscsi devstack@keystone.service[81510]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 31 00:05:28.724935 dv-cinder-852210-5-iscsi devstack@keystone.service[81510]: nodename: dv-cinder-852210-5-iscsi Aug 31 00:05:28.724935 dv-cinder-852210-5-iscsi devstack@keystone.service[81510]: machine: x86_64 Aug 31 00:05:28.724935 dv-cinder-852210-5-iscsi devstack@keystone.service[81510]: clock source: unix Aug 31 00:05:28.724935 dv-cinder-852210-5-iscsi devstack@keystone.service[81510]: pcre jit disabled Aug 31 00:05:28.724935 dv-cinder-852210-5-iscsi devstack@keystone.service[81510]: detected number of CPU cores: 4 Aug 31 00:05:28.724935 dv-cinder-852210-5-iscsi devstack@keystone.service[81510]: current working directory: / Aug 31 00:05:28.724935 dv-cinder-852210-5-iscsi devstack@keystone.service[81510]: detected binary path: /usr/bin/uwsgi-core Aug 31 00:05:28.724935 dv-cinder-852210-5-iscsi devstack@keystone.service[81510]: your processes number limit is 47680 Aug 31 00:05:28.724935 dv-cinder-852210-5-iscsi devstack@keystone.service[81510]: your memory page size is 4096 bytes Aug 31 00:05:28.724935 dv-cinder-852210-5-iscsi devstack@keystone.service[81510]: detected max file descriptor number: 2048 Aug 31 00:05:28.724935 dv-cinder-852210-5-iscsi devstack@keystone.service[81510]: lock engine: pthread robust mutexes Aug 31 00:05:28.725566 dv-cinder-852210-5-iscsi devstack@keystone.service[81510]: thunder lock: enabled Aug 31 00:05:28.725566 dv-cinder-852210-5-iscsi devstack@keystone.service[81510]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 31 00:05:28.725566 dv-cinder-852210-5-iscsi devstack@keystone.service[81510]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 31 00:05:28.764273 dv-cinder-852210-5-iscsi devstack@keystone.service[81510]: Python main interpreter initialized at 0x55c70eb179c0 Aug 31 00:05:28.764273 dv-cinder-852210-5-iscsi devstack@keystone.service[81510]: python threads support enabled Aug 31 00:05:28.764273 dv-cinder-852210-5-iscsi devstack@keystone.service[81510]: your server socket listen backlog is limited to 100 connections Aug 31 00:05:28.764273 dv-cinder-852210-5-iscsi devstack@keystone.service[81510]: your mercy for graceful operations on workers is 90 seconds Aug 31 00:05:28.764662 dv-cinder-852210-5-iscsi devstack@keystone.service[81510]: mapped 403077 bytes (393 KB) for 2 cores Aug 31 00:05:28.764745 dv-cinder-852210-5-iscsi devstack@keystone.service[81510]: *** Operational MODE: preforking *** Aug 31 00:05:28.764969 dv-cinder-852210-5-iscsi devstack@keystone.service[81510]: *** uWSGI is running in multiple interpreter mode *** Aug 31 00:05:28.764969 dv-cinder-852210-5-iscsi devstack@keystone.service[81510]: spawned uWSGI master process (pid: 81510) Aug 31 00:05:28.765175 dv-cinder-852210-5-iscsi systemd[1]: Started Devstack devstack@keystone.service. Aug 31 00:05:28.767879 dv-cinder-852210-5-iscsi devstack@keystone.service[81510]: spawned uWSGI worker 1 (pid: 81523, cores: 1) Aug 31 00:05:28.767879 dv-cinder-852210-5-iscsi devstack@keystone.service[81510]: spawned uWSGI worker 2 (pid: 81524, cores: 1) Aug 31 00:05:28.767879 dv-cinder-852210-5-iscsi devstack@keystone.service[81510]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 31 00:05:33.130024 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 00:05:33.130024 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: from cryptography.utils import int_from_bytes Aug 31 00:05:33.130806 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 00:05:33.130806 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: from cryptography.utils import int_from_bytes Aug 31 00:05:33.135900 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 00:05:33.135900 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: from cryptography.utils import int_from_bytes Aug 31 00:05:33.136419 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 00:05:33.136419 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: from cryptography.utils import int_from_bytes Aug 31 00:05:33.180711 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 31 00:05:33.180916 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 31 00:05:33.181063 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] command line args: [] {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 31 00:05:33.181326 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 31 00:05:33.181501 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] ================================================================================ {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 31 00:05:33.181752 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] admin_token = **** {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:05:33.181995 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] config_dir = [] {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:05:33.182179 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:05:33.182358 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] config_source = [] {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:05:33.182534 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] debug = True {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:05:33.182730 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:05:33.183092 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:05:33.183272 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:05:33.183519 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:05:33.183763 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:05:33.183990 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] list_limit = None {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:05:33.184189 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] log_config_append = None {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:05:33.184330 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 31 00:05:33.185187 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:05:33.185308 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 31 00:05:33.185424 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] log_dir = None {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:05:33.185534 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] command line args: [] {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 31 00:05:33.185647 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] log_file = None {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:05:33.185766 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 31 00:05:33.185865 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:05:33.185964 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] ================================================================================ {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 31 00:05:33.186076 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:05:33.186181 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] admin_token = **** {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:05:33.186288 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:05:33.186401 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] config_dir = [] {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:05:33.186401 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:05:33.186604 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:05:33.186604 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:05:33.186806 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] config_source = [] {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:05:33.186892 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:05:33.186983 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] debug = True {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:05:33.186983 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:05:33.187180 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:05:33.187273 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:05:33.187356 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:05:33.187437 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:05:33.187513 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:05:33.187615 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:05:33.187708 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:05:33.187798 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:05:33.187881 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:05:33.187963 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] list_limit = None {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:05:33.188051 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:05:33.188145 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] log_config_append = None {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:05:33.188266 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:05:33.188376 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:05:33.188376 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] log_dir = None {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:05:33.188519 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:05:33.188601 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] log_file = None {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:05:33.188692 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:05:33.188784 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:05:33.188868 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:05:33.189001 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.47/identity {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:05:33.189153 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:05:33.189273 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] publish_errors = False {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:05:33.189378 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:05:33.189491 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:05:33.189607 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:05:33.189713 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:05:33.189847 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:05:33.189950 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:05:33.190049 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:05:33.190147 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:05:33.190250 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:05:33.190358 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:05:33.190468 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:05:33.190586 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] standard_threads = False {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:05:33.190713 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:05:33.190846 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:05:33.190968 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:05:33.191075 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:05:33.191196 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:05:33.191303 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:05:33.191303 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] use_journal = False {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:05:33.191522 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:05:33.191629 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] use_json = False {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:05:33.191763 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:05:33.191881 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] use_stderr = False {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:05:33.191881 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] use_syslog = False {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:05:33.192085 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:05:33.192214 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:05:33.192214 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.192444 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.47/identity {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:05:33.192555 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.192663 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] publish_errors = False {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:05:33.192825 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.192946 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:05:33.193064 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.193181 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:05:33.193181 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:05:33.193394 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.193518 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:05:33.193632 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.193740 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:05:33.193851 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.193969 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] standard_threads = False {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:05:33.194075 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.194196 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:05:33.194308 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.194425 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:05:33.194534 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.194643 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:05:33.194751 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.194876 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] use_journal = False {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:05:33.194876 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] use_json = False {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:05:33.195085 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.195194 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] use_stderr = False {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:05:33.195313 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.195420 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] use_syslog = False {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:05:33.195543 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.195652 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:05:33.195763 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.195871 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.195990 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.196109 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.196789 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.196912 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.197117 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.197243 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.197365 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.197489 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.197612 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.197773 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.197884 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.198008 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.198138 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.198250 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.198375 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.198498 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.198608 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.198731 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.198842 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.198970 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.199163 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.199272 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.199385 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.199499 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.199612 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.199733 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.199855 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.199965 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.200146 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.200483 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.200599 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.200734 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.200845 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.200959 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.201071 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.201184 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.201307 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.201433 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.201544 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.201658 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.201771 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.201771 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.201989 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.202111 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.202230 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.202230 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.202450 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.202450 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.202663 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.202787 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.202896 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.203018 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.203129 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.203241 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.203353 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.203477 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.203587 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.203699 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.203811 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.203930 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.204042 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.204198 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.204329 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.204440 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.204563 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.204690 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.204800 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.204992 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.205107 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.205220 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.205333 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.205446 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.205574 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.205695 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.205815 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.205934 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.206044 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.206165 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.206275 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.206401 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.206511 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.206624 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.206738 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.206860 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.206979 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.207101 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.207214 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.207329 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.207435 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.207542 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.207645 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.207762 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.207927 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.208029 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.208216 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.208329 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.208482 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.208608 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.208740 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.208860 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.208970 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.209081 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.209190 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.209318 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.209430 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.209540 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.209650 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.209762 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.209880 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.210003 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.210413 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.210582 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.210706 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.210885 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.210997 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.211178 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.211305 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.211478 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.211589 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.211759 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.211873 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.212044 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.212199 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.212327 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.212500 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.212628 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.212804 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.212918 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.213101 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.213101 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.213352 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.213470 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.213597 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.213733 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.213867 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.214000 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.214119 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.214242 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.214354 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.214354 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.214620 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.214620 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.214834 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.214946 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.215060 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.215173 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.215310 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.215422 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.215536 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.216143 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.216337 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.216498 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.216670 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.216929 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.217050 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.217166 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.217280 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.217395 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.217526 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.217526 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.217744 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.217882 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.218003 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.218119 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.218313 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.218425 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.218540 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.218657 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.218772 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.218890 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.219021 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.219155 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.219278 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.219413 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.219525 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.219639 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.219752 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.219877 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.219989 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.220103 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.220253 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.220369 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.220485 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.220621 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] auth.external = None {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.220743 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.220855 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.220971 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.221084 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.221199 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.221325 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.221447 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.221560 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] auth.password = None {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.221673 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.221801 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] auth.token = None {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.221915 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.222091 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.222204 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.222361 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.222485 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.222608 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.222730 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.222842 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.222958 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.223088 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.223208 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.223331 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.223444 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.223560 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.223680 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.223805 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] credential.caching = True {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.223919 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.224042 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.224207 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.224337 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.224451 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] auth.external = None {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.224577 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.224699 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.224811 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.224926 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.225041 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.225155 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.225291 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.225404 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] auth.password = None {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.225529 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.225640 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] auth.token = None {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.225797 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.225909 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.226037 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.226149 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.226264 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.226388 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.226500 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.226614 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.226741 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.226854 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.226973 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.227088 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.227202 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.227317 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.227444 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.227557 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] credential.caching = True {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.227673 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] federation.caching = True {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.227787 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.227901 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.228016 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.228224 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.228347 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.228461 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.228578 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.228697 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.228827 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.228950 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.229072 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.229184 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.229300 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.229415 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.229530 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.229655 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.229767 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.229883 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.230008 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.230121 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.230242 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.230369 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.230482 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.230597 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] identity.caching = True {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.230712 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.230827 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.230950 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.231109 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.231222 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.231400 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.232128 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] federation.caching = True {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.232408 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.232546 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.232661 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.232782 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.232896 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.233012 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.233127 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.233331 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.233445 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.233561 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.233677 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.233792 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.233907 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.233907 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.234132 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.234248 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.234369 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.234484 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.234599 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.234726 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.234847 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.235003 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.235124 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.235310 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.235465 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] identity.caching = True {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.235591 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.235705 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.235705 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.235921 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.236040 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.236173 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.236313 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.236426 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.236426 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.236644 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.236758 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.236874 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.237003 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.237117 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.237233 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.237349 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.237466 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.237581 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.237715 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.237847 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.237964 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.238081 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.238195 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.238315 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.238450 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.238570 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.238693 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.238815 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.238937 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.239065 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.239198 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.239325 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.239453 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.239584 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.239705 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.239827 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.239961 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.240081 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.240222 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.240343 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.240462 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.240581 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.240717 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.240839 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.240956 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.241081 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.241206 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.241321 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.241451 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.241567 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.241687 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.241806 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.241925 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.242045 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.242176 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.242291 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.242409 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.242528 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.242646 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.242769 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.242898 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.243015 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.243134 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.243263 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.243380 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.243516 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.243631 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.243750 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.243900 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] ldap.user = None {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.244019 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.244139 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.244315 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.244433 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.244559 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.244679 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.244800 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.244918 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.245048 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.245177 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.245295 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.245414 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.245533 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.245652 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.245783 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.245899 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.246028 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.246152 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.246270 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.246391 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.246522 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.246638 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.246759 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.246877 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.247004 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.247125 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.247262 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.247378 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.247498 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.247619 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.247739 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.247864 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.247995 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] ldap.user = None {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.248112 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.248244 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.248374 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.248490 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.248609 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.248749 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.248864 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.248985 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.249107 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.249224 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.249343 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.249343 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.249579 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.249719 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.249834 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.249834 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.250054 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.250186 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.250302 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.250427 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.250544 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.250662 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.250780 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.250909 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.251024 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.251149 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.251269 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.251389 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.251506 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.251637 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.251752 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.251870 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.251988 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.252108 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.252108 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.252365 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.252365 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.252568 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.252692 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.252811 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.252811 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.253041 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] resource.caching = True {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.253155 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.253278 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.253398 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.253520 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.253642 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.253777 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.253895 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.254018 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.254140 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.254263 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.254385 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.254522 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.254639 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.254762 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.254881 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.255001 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.255125 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.255259 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.255378 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.255509 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] role.caching = True {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.255627 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.255750 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] role.driver = sql {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.255870 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.256007 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.256140 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.256308 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.256429 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.256554 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.256674 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.256880 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.256994 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] resource.caching = True {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.257116 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.257236 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.257355 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.257486 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.257603 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.257723 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.257842 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.257968 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.258088 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.258219 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.258333 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.258453 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.258576 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.258576 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.258796 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.258933 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.259052 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.259176 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.259298 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.259298 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] role.caching = True {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.259512 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.259643 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] role.driver = sql {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.259762 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.259883 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.260007 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.260128 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.260304 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.260443 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.260557 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.260677 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.260796 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.260914 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.261032 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.261164 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.261286 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.261406 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.261525 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.261644 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.261763 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.261895 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.262010 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.262131 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.262249 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.262367 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.262486 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.262628 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.262753 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.262867 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.262982 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.263110 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.263228 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.263228 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.263462 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.263581 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.263700 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.263818 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.263948 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.264064 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] token.caching = True {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.264203 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.264333 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.264458 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.264576 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.264713 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.264829 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.264948 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.265069 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.265069 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.265295 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.265420 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.265538 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.265658 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.265777 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.265896 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.266015 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.266151 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.266267 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.266388 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.266509 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.266628 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.266747 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.266879 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.266994 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.267115 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.267234 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.267353 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.267472 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.267645 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.267772 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.267909 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.268026 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.268026 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] token.caching = True {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.268347 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.268463 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.268598 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] database.connection = **** {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.268711 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.268834 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.268952 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.269070 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.269190 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.269320 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.269434 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.269559 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.269677 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.269795 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.269913 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.270043 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.270043 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.270259 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.270375 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.270495 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.270612 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.270743 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.270858 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.270976 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.271095 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.271219 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.271337 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.271467 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.271583 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.271702 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.271820 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.271940 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.272071 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.272224 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.272350 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.272489 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.272607 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.272731 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] database.connection = **** {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.272858 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.272981 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.273104 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 31 00:05:33.273240 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.273240 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.273240 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.273240 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.273240 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.273240 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.273240 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.273240 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.273240 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.274238 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.274238 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.274238 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.274238 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.274238 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.274238 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.274238 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.274238 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:05:33.274238 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 31 00:05:33.296361 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81523) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:05:33.296583 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81523) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:05:33.296793 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81523) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:05:33.299794 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81524) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:05:33.300048 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81524) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:05:33.300352 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81524) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:05:33.305253 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81523) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:05:33.308654 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81524) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:05:33.333497 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81523) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:05:33.333719 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81523) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:05:33.335214 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81524) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:05:33.335449 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81524) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:05:33.389211 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81524) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:05:33.389479 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81523) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:05:33.440059 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81524) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:05:33.440379 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81524) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:05:33.440471 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81523) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:05:33.440556 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81523) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:05:33.602671 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81523) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:05:33.602855 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81523) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:05:33.602951 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81524) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:05:33.603039 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81523) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:05:33.603120 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81524) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:05:33.603239 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81523) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:05:33.603326 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81524) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:05:33.603456 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81523) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:05:33.603552 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81524) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:05:33.603670 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81523) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:05:33.603756 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81524) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:05:33.603885 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81524) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:05:33.627917 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81523) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:05:33.628137 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81524) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:05:33.628253 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81523) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:05:33.628320 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81524) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:05:33.628398 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81523) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:05:33.628549 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81524) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:05:33.628645 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81523) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:05:33.628779 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81524) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:05:33.628864 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81523) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:05:33.628990 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81523) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:05:33.629096 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81524) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:05:33.629225 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81523) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:05:33.629324 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81524) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:05:33.629403 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81524) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:05:33.641985 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81523) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:05:33.642629 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81524) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:05:33.656537 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81523) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:05:33.656748 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81523) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:05:33.656960 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81523) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:05:33.657046 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81524) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:05:33.657176 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81523) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:05:33.657261 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81524) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:05:33.657390 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81523) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:05:33.657476 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81524) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:05:33.657602 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81523) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:05:33.657707 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81524) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:05:33.657838 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81523) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:05:33.657925 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81524) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:05:33.658013 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81524) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:05:33.658236 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81524) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:05:33.675431 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:05:33.675649 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 31 00:05:33.675739 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:05:33.675919 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 31 00:05:33.676009 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:05:33.676186 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 31 00:05:33.676301 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:05:33.676454 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:05:33.676553 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 31 00:05:33.676716 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:05:33.676801 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:05:33.676977 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:05:33.677062 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:05:33.677236 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:05:33.677329 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:05:33.677525 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:05:33.687410 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:05:33.687623 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:05:33.687701 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:05:33.687775 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:05:33.687961 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:05:33.688050 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:05:33.688271 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:05:33.688361 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:05:33.695557 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81524) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 00:05:33.695918 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81523) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 00:05:33.698595 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81524) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 00:05:33.698710 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81523) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 00:05:33.698885 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:05:33.698974 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:05:33.699173 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:05:33.699260 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:05:33.699456 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:05:33.699540 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:05:33.699734 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:05:33.699829 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:05:33.699994 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:05:33.700606 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:05:33.700833 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:05:33.700920 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:05:33.701147 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:05:33.701380 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:05:33.701691 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:05:33.701824 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:05:33.702010 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:05:33.702140 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:05:33.702333 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:05:33.702628 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:05:33.726787 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:05:33.727659 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:05:33.728389 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81523) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 00:05:33.728681 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:05:33.729202 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81524) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 00:05:33.729491 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:05:33.733923 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81523) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 00:05:33.734211 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:05:33.734343 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81524) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 00:05:33.734489 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:05:33.734620 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:05:33.734865 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:05:33.740992 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81523) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 00:05:33.741280 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:05:33.741438 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81524) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 00:05:33.741652 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:05:33.745253 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81523) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 00:05:33.745551 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:05:33.745683 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81524) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 00:05:33.745827 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:05:33.745963 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:05:33.746091 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:05:33.746222 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:05:33.746394 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:05:33.746529 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:05:33.746713 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:05:33.748938 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:05:33.749227 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:05:33.749360 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:05:33.749520 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:05:33.749668 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:05:33.749803 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:05:33.765622 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:05:33.765906 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:05:33.766467 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:05:33.766762 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:05:33.769810 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81524) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 00:05:33.770636 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81523) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 00:05:33.772921 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:05:33.773219 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:05:33.773783 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:05:33.774083 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:05:33.777570 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81524) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 00:05:33.779639 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81523) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 00:05:33.781291 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81524) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 00:05:33.782833 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81523) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 00:05:33.784662 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:05:33.784968 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:05:33.785246 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:05:33.785529 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:05:33.785838 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:05:33.786211 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:05:33.786345 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:05:33.786517 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:05:33.786806 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:05:33.787098 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:05:33.787386 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:05:33.787772 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:05:33.803011 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81524) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 00:05:33.803307 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:05:33.803585 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:05:33.803857 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:05:33.804195 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81523) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 00:05:33.804498 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:05:33.804771 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:05:33.805036 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:05:33.810649 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:05:33.812316 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:05:33.812497 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:05:33.813872 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:05:33.814081 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:05:33.814180 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:05:33.815635 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:05:33.815910 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:05:33.816804 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81524) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 00:05:33.817094 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:05:33.817387 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:05:33.817678 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:05:33.817971 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:05:33.818579 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81523) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 00:05:33.818869 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:05:33.819163 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:05:33.819448 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:05:33.819744 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:05:33.830060 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81524) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 00:05:33.830366 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:05:33.830655 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:05:33.830947 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:05:33.831230 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:05:33.831509 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:05:33.831805 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:05:33.832141 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81523) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 00:05:33.832458 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:05:33.832754 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:05:33.833041 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:05:33.833332 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:05:33.833609 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:05:33.833904 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:05:33.847696 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81524) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 00:05:33.850572 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81523) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 00:05:33.850738 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81524) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 00:05:33.853669 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:05:33.853763 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81523) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 00:05:33.855072 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:05:33.856705 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81524) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 00:05:33.856990 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:05:33.857073 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:05:33.857281 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:05:33.858504 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:05:33.859988 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81523) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 00:05:33.860302 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:05:33.860594 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:05:33.864078 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:05:33.865600 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81524) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 00:05:33.867137 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:05:33.868473 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:05:33.868650 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81523) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 00:05:33.868774 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:05:33.869062 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:05:33.869347 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:05:33.871495 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:05:33.871799 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:05:33.873246 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:05:33.873567 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:05:33.877821 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81524) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 00:05:33.878111 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:05:33.878508 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:05:33.883945 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81523) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 00:05:33.884496 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:05:33.884997 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:05:33.885514 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81524) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 00:05:33.885808 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:05:33.886094 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:05:33.886376 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:05:33.886647 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:05:33.886937 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:05:33.887210 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:05:33.887484 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:05:33.888356 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:05:33.888637 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:05:33.889075 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:05:33.889219 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:05:33.889474 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:05:33.890795 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:05:33.898323 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81523) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 00:05:33.898627 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:05:33.898907 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:05:33.899188 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:05:33.899467 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:05:33.899758 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:05:33.900033 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:05:33.900334 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:05:33.900624 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:05:33.900906 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:05:33.901179 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:05:33.901443 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:05:33.901709 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:05:33.901987 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:05:33.924322 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55c70eb179c0 pid: 81524 (default app) Aug 31 00:05:33.928065 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500025cb-37de-4dd9-9100-6d003b68cb58 None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:33.928421 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500025cb-37de-4dd9-9100-6d003b68cb58 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:33.928743 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500025cb-37de-4dd9-9100-6d003b68cb58 None None] PATH_INFO: `/v3` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:33.932934 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1/1] 10.222.0.47 () {50 vars in 791 bytes} [Wed Aug 31 00:05:33 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:05:33.938589 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55c70eb179c0 pid: 81523 (default app) Aug 31 00:05:40.677420 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8923cd1-1f97-41e2-90e2-332a75d4ea4f None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:40.678081 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8923cd1-1f97-41e2-90e2-332a75d4ea4f None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:40.678081 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8923cd1-1f97-41e2-90e2-332a75d4ea4f None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:40.679291 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 2/2] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 00:05:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 00:05:40.686986 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4966de5-ff53-4ab1-aeff-dc2884b7fb50 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:40.687603 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4966de5-ff53-4ab1-aeff-dc2884b7fb50 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:40.687603 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4966de5-ff53-4ab1-aeff-dc2884b7fb50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:40.758401 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: INFO dbcounter [None req-b4966de5-ff53-4ab1-aeff-dc2884b7fb50 None None] Registered counter for database keystone Aug 31 00:05:40.778252 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG oslo_db.sqlalchemy.engines [None req-b4966de5-ff53-4ab1-aeff-dc2884b7fb50 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81523) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 00:05:40.784876 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writer thread running {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 00:05:40.972671 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG passlib.handlers.bcrypt [None req-b4966de5-ff53-4ab1-aeff-dc2884b7fb50 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81523) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 31 00:05:40.972988 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG passlib.handlers.bcrypt [None req-b4966de5-ff53-4ab1-aeff-dc2884b7fb50 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81523) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 31 00:05:41.032716 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-b4966de5-ff53-4ab1-aeff-dc2884b7fb50 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:05:41.034602 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-b4966de5-ff53-4ab1-aeff-dc2884b7fb50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:05:41.166948 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1/3] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 00:05:40 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 483 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 31 00:05:41.614967 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8923cd1-1f97-41e2-90e2-332a75d4ea4f None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:41.685464 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: INFO dbcounter [None req-a8923cd1-1f97-41e2-90e2-332a75d4ea4f None None] Registered counter for database keystone Aug 31 00:05:41.707116 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG oslo_db.sqlalchemy.engines [None req-a8923cd1-1f97-41e2-90e2-332a75d4ea4f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81524) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 00:05:41.713493 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writer thread running {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 00:05:41.833984 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8923cd1-1f97-41e2-90e2-332a75d4ea4f None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:41.838294 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d866a8b-9778-4492-be0e-dbdedf2998e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:41.838928 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d866a8b-9778-4492-be0e-dbdedf2998e7 admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:41.839212 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d866a8b-9778-4492-be0e-dbdedf2998e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:41.839489 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d866a8b-9778-4492-be0e-dbdedf2998e7 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:41.848520 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d866a8b-9778-4492-be0e-dbdedf2998e7 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:41.899985 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: WARNING keystone.common.rbac_enforcer.enforcer [None req-4d866a8b-9778-4492-be0e-dbdedf2998e7 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 31 00:05:41.900347 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d866a8b-9778-4492-be0e-dbdedf2998e7 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:41.910973 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 3/4] 10.222.0.47 () {58 vars in 1324 bytes} [Wed Aug 31 00:05:41 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 00:05:41.917013 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4966de5-ff53-4ab1-aeff-dc2884b7fb50 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:41.931986 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4966de5-ff53-4ab1-aeff-dc2884b7fb50 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:41.937152 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320cd1f9-26aa-4d5e-b85e-b94e992c4dd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:41.938245 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320cd1f9-26aa-4d5e-b85e-b94e992c4dd6 admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:41.938521 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320cd1f9-26aa-4d5e-b85e-b94e992c4dd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:41.938789 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320cd1f9-26aa-4d5e-b85e-b94e992c4dd6 admin admin] PATH_INFO: `/v3/projects/549d5b0e486743c994271a9e51f4023c` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:41.940269 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320cd1f9-26aa-4d5e-b85e-b94e992c4dd6 admin admin] RBAC: Authorizing `identity:get_project(project_id=549d5b0e486743c994271a9e51f4023c)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:41.992524 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: WARNING keystone.common.rbac_enforcer.enforcer [None req-320cd1f9-26aa-4d5e-b85e-b94e992c4dd6 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 31 00:05:41.992879 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320cd1f9-26aa-4d5e-b85e-b94e992c4dd6 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:41.997679 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 2/5] 10.222.0.47 () {56 vars in 1207 bytes} [Wed Aug 31 00:05:41 2022] GET /identity/v3/projects/549d5b0e486743c994271a9e51f4023c => generated 344 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:05:43.927669 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0495e275-f0b9-48e5-95dc-7a4b799f7501 None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:43.928253 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0495e275-f0b9-48e5-95dc-7a4b799f7501 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:43.928253 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0495e275-f0b9-48e5-95dc-7a4b799f7501 None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:43.932409 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 4/6] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 00:05:43 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 00:05:43.937801 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa16f04d-42a1-41ed-afcb-6141b96fce39 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:43.938229 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa16f04d-42a1-41ed-afcb-6141b96fce39 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:43.938358 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa16f04d-42a1-41ed-afcb-6141b96fce39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:43.959013 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-fa16f04d-42a1-41ed-afcb-6141b96fce39 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:05:43.960618 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-fa16f04d-42a1-41ed-afcb-6141b96fce39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:05:43.969402 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 3/7] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 00:05:43 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 31 00:05:44.243184 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0495e275-f0b9-48e5-95dc-7a4b799f7501 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:44.255432 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0495e275-f0b9-48e5-95dc-7a4b799f7501 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:44.259668 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b040e9-d993-4c5c-9132-d2e965fa0e61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:44.260307 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b040e9-d993-4c5c-9132-d2e965fa0e61 admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:44.260595 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b040e9-d993-4c5c-9132-d2e965fa0e61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:44.260873 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b040e9-d993-4c5c-9132-d2e965fa0e61 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:44.269158 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b040e9-d993-4c5c-9132-d2e965fa0e61 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:44.270952 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b040e9-d993-4c5c-9132-d2e965fa0e61 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:44.280362 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 5/8] 10.222.0.47 () {58 vars in 1324 bytes} [Wed Aug 31 00:05:44 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 00:05:44.286293 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa16f04d-42a1-41ed-afcb-6141b96fce39 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:44.296524 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa16f04d-42a1-41ed-afcb-6141b96fce39 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:44.300858 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51aac855-638d-49a1-85f6-e819b430b05e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:44.301481 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aac855-638d-49a1-85f6-e819b430b05e admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:44.301761 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aac855-638d-49a1-85f6-e819b430b05e admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:44.302033 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aac855-638d-49a1-85f6-e819b430b05e admin admin] PATH_INFO: `/v3/users/11b70534c08c4c45883d75f7a7aeed08` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:44.303345 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51aac855-638d-49a1-85f6-e819b430b05e admin admin] RBAC: Authorizing `identity:get_user(user_id=11b70534c08c4c45883d75f7a7aeed08)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:44.305216 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51aac855-638d-49a1-85f6-e819b430b05e admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:44.306747 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 4/9] 10.222.0.47 () {56 vars in 1198 bytes} [Wed Aug 31 00:05:44 2022] GET /identity/v3/users/11b70534c08c4c45883d75f7a7aeed08 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:05:46.331645 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26013c8a-2213-49a1-9ac1-0dd570e76379 None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:46.332125 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26013c8a-2213-49a1-9ac1-0dd570e76379 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:46.332125 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26013c8a-2213-49a1-9ac1-0dd570e76379 None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:46.333475 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 6/10] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 00:05:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:05:46.338872 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d39660-8e79-4f6b-9887-604837e39f8c None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:46.339364 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d39660-8e79-4f6b-9887-604837e39f8c None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:46.339453 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d39660-8e79-4f6b-9887-604837e39f8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:46.358544 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-46d39660-8e79-4f6b-9887-604837e39f8c None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:05:46.359757 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-46d39660-8e79-4f6b-9887-604837e39f8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:05:46.363677 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef8d6c2-dc24-4603-9256-8bd794018e81 None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:46.363967 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef8d6c2-dc24-4603-9256-8bd794018e81 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:46.364285 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef8d6c2-dc24-4603-9256-8bd794018e81 None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:46.365621 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 7/11] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 00:05:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 00:05:46.371331 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae4bb6e-4bca-4e71-a15c-171689d3f23e None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:46.371617 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae4bb6e-4bca-4e71-a15c-171689d3f23e None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:46.372666 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae4bb6e-4bca-4e71-a15c-171689d3f23e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:46.416802 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG passlib.handlers.bcrypt [None req-0ae4bb6e-4bca-4e71-a15c-171689d3f23e None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81524) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 31 00:05:46.417208 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG passlib.handlers.bcrypt [None req-0ae4bb6e-4bca-4e71-a15c-171689d3f23e None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81524) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 31 00:05:46.455214 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 5/12] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 00:05:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:05:46.466983 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-0ae4bb6e-4bca-4e71-a15c-171689d3f23e None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:05:46.468641 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-0ae4bb6e-4bca-4e71-a15c-171689d3f23e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:05:46.575882 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 8/13] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 00:05:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 00:05:46.730084 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d39660-8e79-4f6b-9887-604837e39f8c None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:46.756809 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:46.840418 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae4bb6e-4bca-4e71-a15c-171689d3f23e None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:46.842880 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d39660-8e79-4f6b-9887-604837e39f8c None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:46.879615 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dfc4af-837d-4228-a183-d3cf6bca74ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:46.880295 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dfc4af-837d-4228-a183-d3cf6bca74ec None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:46.880580 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dfc4af-837d-4228-a183-d3cf6bca74ec None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:46.880854 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dfc4af-837d-4228-a183-d3cf6bca74ec None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:46.895035 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dfc4af-837d-4228-a183-d3cf6bca74ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:05:46.904599 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-64dfc4af-837d-4228-a183-d3cf6bca74ec None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:05:46.904599 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:05:46.904599 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:05:46.904599 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:05:46.904599 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:05:46.904599 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:05:46.904599 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:05:46.904599 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:05:46.904599 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:05:46.904599 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:05:46.904599 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:05:46.904599 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:05:46.904599 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:05:46.904599 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:05:46.904599 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:05:46.904599 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:05:46.906146 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:05:46.906146 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:05:46.906146 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:05:46.906146 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:05:46.906146 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:05:46.906146 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:05:46.906146 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:05:46.906146 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:05:46.906146 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:05:46.906146 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:05:46.906146 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:05:46.906146 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 31 00:05:46.906146 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:05:46.906146 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:05:46.906146 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:05:46.906146 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:05:46.907225 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:05:46.907225 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:05:46.907225 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:05:46.907225 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:05:46.907225 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:05:46.907225 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:05:46.907225 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:05:46.907225 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:05:46.907225 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:05:46.907225 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:05:46.907225 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:05:46.907225 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 31 00:05:46.907225 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 6/14] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Aug 31 00:05:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:05:46.912577 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dfc4af-837d-4228-a183-d3cf6bca74ec None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:46.953926 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae4bb6e-4bca-4e71-a15c-171689d3f23e None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:46.956324 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:46.992458 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c70b744-c9a4-4842-a577-cea8ff7e0177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:46.993351 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c70b744-c9a4-4842-a577-cea8ff7e0177 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:46.993653 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c70b744-c9a4-4842-a577-cea8ff7e0177 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:46.993928 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c70b744-c9a4-4842-a577-cea8ff7e0177 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:47.003576 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:47.022328 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dfc4af-837d-4228-a183-d3cf6bca74ec None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:47.057430 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569b5f3f-0f6c-4bb0-a86a-9f70c69639ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:47.058037 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569b5f3f-0f6c-4bb0-a86a-9f70c69639ca None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:47.058314 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569b5f3f-0f6c-4bb0-a86a-9f70c69639ca None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:47.058583 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569b5f3f-0f6c-4bb0-a86a-9f70c69639ca None admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:47.059838 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569b5f3f-0f6c-4bb0-a86a-9f70c69639ca None admin] RBAC: Adding query filter params (name=admin) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:05:47.060230 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569b5f3f-0f6c-4bb0-a86a-9f70c69639ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:47.061633 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569b5f3f-0f6c-4bb0-a86a-9f70c69639ca None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:47.065238 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c70b744-c9a4-4842-a577-cea8ff7e0177 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:47.066758 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c70b744-c9a4-4842-a577-cea8ff7e0177 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:47.078463 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 7/15] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 31 00:05:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:05:47.079894 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569b5f3f-0f6c-4bb0-a86a-9f70c69639ca None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:47.169375 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 9/16] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 31 00:05:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 31 00:05:47.174863 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c70b744-c9a4-4842-a577-cea8ff7e0177 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:47.177638 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:47.187933 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569b5f3f-0f6c-4bb0-a86a-9f70c69639ca None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:47.222679 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b05d12-dfc2-4d48-9fae-530b2d69106a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:47.223360 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b05d12-dfc2-4d48-9fae-530b2d69106a None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:47.223647 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b05d12-dfc2-4d48-9fae-530b2d69106a None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:47.223920 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b05d12-dfc2-4d48-9fae-530b2d69106a None admin] PATH_INFO: `/v3/users/11b70534c08c4c45883d75f7a7aeed08` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:47.225096 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b05d12-dfc2-4d48-9fae-530b2d69106a None admin] RBAC: Authorizing `identity:get_user(user_id=11b70534c08c4c45883d75f7a7aeed08)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:47.226574 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b05d12-dfc2-4d48-9fae-530b2d69106a None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:47.228253 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 8/17] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 31 00:05:47 2022] GET /identity/v3/users/11b70534c08c4c45883d75f7a7aeed08 => generated 247 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:05:47.235366 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b05d12-dfc2-4d48-9fae-530b2d69106a None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:47.253012 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:47.288165 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c70b744-c9a4-4842-a577-cea8ff7e0177 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:47.324417 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e609eb21-4123-4108-a604-37def9120ebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:47.325322 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e609eb21-4123-4108-a604-37def9120ebc None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:47.325597 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e609eb21-4123-4108-a604-37def9120ebc None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:47.325870 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e609eb21-4123-4108-a604-37def9120ebc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:47.349345 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e609eb21-4123-4108-a604-37def9120ebc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:47.351373 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e609eb21-4123-4108-a604-37def9120ebc None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:47.363450 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b05d12-dfc2-4d48-9fae-530b2d69106a None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:47.380496 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-e609eb21-4123-4108-a604-37def9120ebc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:05:47.380496 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:05:47.380496 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:05:47.380496 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:05:47.380496 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:05:47.380496 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:05:47.380496 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:05:47.380496 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:05:47.380496 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:05:47.380496 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:05:47.380496 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:05:47.380496 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:05:47.380496 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:05:47.380496 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:05:47.380496 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:05:47.380496 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:05:47.381775 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:05:47.381775 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:05:47.381775 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:05:47.381775 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:05:47.381775 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:05:47.381775 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:05:47.381775 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:05:47.381775 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Aug 31 00:05:47.381775 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:05:47.381775 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:05:47.381775 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:05:47.381775 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:05:47.381775 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:05:47.381775 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:05:47.381775 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:05:47.381775 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:05:47.381775 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:05:47.383276 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:05:47.383276 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:05:47.383276 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Aug 31 00:05:47.383276 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 10/18] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 00:05:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:05:47.388198 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e609eb21-4123-4108-a604-37def9120ebc None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:47.403751 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9420de9-3423-48b2-9807-a59acf337dfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:47.404601 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9420de9-3423-48b2-9807-a59acf337dfe None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:47.405059 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9420de9-3423-48b2-9807-a59acf337dfe None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:47.405503 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9420de9-3423-48b2-9807-a59acf337dfe None admin] PATH_INFO: `/v3/domains/default` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:47.407060 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9420de9-3423-48b2-9807-a59acf337dfe None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:47.409877 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9420de9-3423-48b2-9807-a59acf337dfe None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:47.412209 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 9/19] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 00:05:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:05:47.419829 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9420de9-3423-48b2-9807-a59acf337dfe None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:47.449606 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:47.495896 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e609eb21-4123-4108-a604-37def9120ebc None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:47.514404 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:47.530549 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb635ac-fe11-4168-bbea-2ff86ba258a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:47.531170 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb635ac-fe11-4168-bbea-2ff86ba258a0 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:47.531454 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb635ac-fe11-4168-bbea-2ff86ba258a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:47.531729 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb635ac-fe11-4168-bbea-2ff86ba258a0 None admin] PATH_INFO: `/v3/domains` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:47.532416 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb635ac-fe11-4168-bbea-2ff86ba258a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:05:47.532724 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb635ac-fe11-4168-bbea-2ff86ba258a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:47.534133 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb635ac-fe11-4168-bbea-2ff86ba258a0 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:47.535104 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9420de9-3423-48b2-9807-a59acf337dfe None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:47.553179 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 11/20] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 31 00:05:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:05:47.571895 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8e8083-644c-4e35-812f-d5525e8fea46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:47.572563 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8e8083-644c-4e35-812f-d5525e8fea46 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:47.572842 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8e8083-644c-4e35-812f-d5525e8fea46 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:47.573116 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8e8083-644c-4e35-812f-d5525e8fea46 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:47.573877 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8e8083-644c-4e35-812f-d5525e8fea46 None admin] RBAC: Adding query filter params (role.id=12f6817f9aaa4e2bb477095a6bed5d0f, scope.domain.id=default, user.id=11b70534c08c4c45883d75f7a7aeed08) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:05:47.574180 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8e8083-644c-4e35-812f-d5525e8fea46 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:47.575732 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8e8083-644c-4e35-812f-d5525e8fea46 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:47.583797 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 10/21] 10.222.0.47 () {56 vars in 1322 bytes} [Wed Aug 31 00:05:47 2022] GET /identity/v3/role_assignments?user.id=11b70534c08c4c45883d75f7a7aeed08&scope.domain.id=default&role.id=12f6817f9aaa4e2bb477095a6bed5d0f => generated 233 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:05:50.188893 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac94cad-5258-4e92-a296-0448e166f0b3 None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:50.189399 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac94cad-5258-4e92-a296-0448e166f0b3 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:50.189844 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac94cad-5258-4e92-a296-0448e166f0b3 None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:50.192536 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 12/22] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 00:05:50 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:05:50.199159 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c77fc2-ffae-4abc-bafe-fa7509fbee9d None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:50.200496 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c77fc2-ffae-4abc-bafe-fa7509fbee9d None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:50.200631 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c77fc2-ffae-4abc-bafe-fa7509fbee9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:50.244023 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-25c77fc2-ffae-4abc-bafe-fa7509fbee9d None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:05:50.245994 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-25c77fc2-ffae-4abc-bafe-fa7509fbee9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:05:50.410844 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 11/23] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 00:05:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 00:05:50.679021 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787004b6-81b9-4b7e-84cb-0fa341799256 None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:50.679754 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787004b6-81b9-4b7e-84cb-0fa341799256 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:50.680292 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787004b6-81b9-4b7e-84cb-0fa341799256 None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:50.682130 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 13/24] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 00:05:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:05:50.688265 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c0b2db-0b0a-4359-9192-c4b89355d09c None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:50.688551 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c0b2db-0b0a-4359-9192-c4b89355d09c None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:50.688815 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c0b2db-0b0a-4359-9192-c4b89355d09c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:50.721221 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-27c0b2db-0b0a-4359-9192-c4b89355d09c None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:05:50.722428 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-27c0b2db-0b0a-4359-9192-c4b89355d09c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:05:50.733027 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b42c1d-bf9b-4c09-800b-4f45093e2a53 None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:50.733657 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b42c1d-bf9b-4c09-800b-4f45093e2a53 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:50.734210 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b42c1d-bf9b-4c09-800b-4f45093e2a53 None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:50.735745 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 14/25] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 00:05:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 00:05:50.746015 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de79a8ba-1c3e-4d73-b3c2-50aadd70f7bf None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:50.747247 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de79a8ba-1c3e-4d73-b3c2-50aadd70f7bf None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:50.748064 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de79a8ba-1c3e-4d73-b3c2-50aadd70f7bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:50.806348 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-de79a8ba-1c3e-4d73-b3c2-50aadd70f7bf None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:05:50.807918 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-de79a8ba-1c3e-4d73-b3c2-50aadd70f7bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:05:50.862320 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 12/26] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 00:05:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:05:50.863710 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c0b2db-0b0a-4359-9192-c4b89355d09c None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:50.884525 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:50.950956 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 15/27] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 00:05:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:05:50.954307 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee32278e-8fb8-4e9a-92d6-a5c2731e0673 None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:50.954597 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee32278e-8fb8-4e9a-92d6-a5c2731e0673 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:50.954872 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee32278e-8fb8-4e9a-92d6-a5c2731e0673 None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:50.959146 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 16/28] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 00:05:50 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:05:50.961716 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506321d1-d852-41a2-b363-cc21ab497208 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:50.962005 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506321d1-d852-41a2-b363-cc21ab497208 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:50.962279 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506321d1-d852-41a2-b363-cc21ab497208 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:51.030071 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-506321d1-d852-41a2-b363-cc21ab497208 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:05:51.031868 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-506321d1-d852-41a2-b363-cc21ab497208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:05:51.038138 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c0b2db-0b0a-4359-9192-c4b89355d09c None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:51.109958 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:51.114912 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fd6a01-c90c-43d3-b69a-a98cdbf176a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:51.115249 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fd6a01-c90c-43d3-b69a-a98cdbf176a2 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:51.115531 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fd6a01-c90c-43d3-b69a-a98cdbf176a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:51.115801 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fd6a01-c90c-43d3-b69a-a98cdbf176a2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:51.130983 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fd6a01-c90c-43d3-b69a-a98cdbf176a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:51.132840 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fd6a01-c90c-43d3-b69a-a98cdbf176a2 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:51.165339 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 17/29] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 00:05:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:05:51.165998 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-62fd6a01-c90c-43d3-b69a-a98cdbf176a2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:05:51.165998 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:05:51.165998 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:05:51.165998 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:05:51.165998 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:05:51.165998 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:05:51.165998 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:05:51.165998 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:05:51.165998 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:05:51.165998 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:05:51.165998 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:05:51.165998 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:05:51.165998 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:05:51.165998 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:05:51.165998 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:05:51.165998 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:05:51.166898 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:05:51.166898 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:05:51.166898 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:05:51.166898 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:05:51.166898 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:05:51.166898 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:05:51.166898 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:05:51.166898 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 31 00:05:51.166898 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:05:51.166898 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:05:51.166898 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:05:51.166898 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:05:51.166898 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:05:51.166898 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:05:51.166898 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:05:51.166898 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:05:51.166898 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:05:51.167719 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:05:51.167719 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:05:51.167719 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 31 00:05:51.169870 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 13/30] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 00:05:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:05:51.176028 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506321d1-d852-41a2-b363-cc21ab497208 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:51.236378 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fd6a01-c90c-43d3-b69a-a98cdbf176a2 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:51.345701 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506321d1-d852-41a2-b363-cc21ab497208 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:51.365223 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:51.399469 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4726c9c-3bc4-4b4e-8a52-34c6e7a5ea20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:51.400104 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4726c9c-3bc4-4b4e-8a52-34c6e7a5ea20 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:51.400489 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4726c9c-3bc4-4b4e-8a52-34c6e7a5ea20 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:51.400772 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4726c9c-3bc4-4b4e-8a52-34c6e7a5ea20 None admin] PATH_INFO: `/v3/domains` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:51.401438 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4726c9c-3bc4-4b4e-8a52-34c6e7a5ea20 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:05:51.401745 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4726c9c-3bc4-4b4e-8a52-34c6e7a5ea20 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:51.403702 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4726c9c-3bc4-4b4e-8a52-34c6e7a5ea20 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:51.416689 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 18/31] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 31 00:05:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:05:51.417325 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4726c9c-3bc4-4b4e-8a52-34c6e7a5ea20 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:51.476674 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:51.490499 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fd6a01-c90c-43d3-b69a-a98cdbf176a2 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:51.538447 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4726c9c-3bc4-4b4e-8a52-34c6e7a5ea20 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:51.582590 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0286995-d638-4fbd-89f0-d2bae7eef44c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:51.583239 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0286995-d638-4fbd-89f0-d2bae7eef44c None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:51.583522 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0286995-d638-4fbd-89f0-d2bae7eef44c None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:51.583798 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0286995-d638-4fbd-89f0-d2bae7eef44c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:51.587043 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a252fb5-e94b-41db-b584-4ba1dd8a817a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:51.587671 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a252fb5-e94b-41db-b584-4ba1dd8a817a None admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:51.587946 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a252fb5-e94b-41db-b584-4ba1dd8a817a None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:51.592199 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a252fb5-e94b-41db-b584-4ba1dd8a817a None admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:51.592199 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a252fb5-e94b-41db-b584-4ba1dd8a817a None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:51.592199 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a252fb5-e94b-41db-b584-4ba1dd8a817a None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:51.604704 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0286995-d638-4fbd-89f0-d2bae7eef44c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:05:51.610825 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-d0286995-d638-4fbd-89f0-d2bae7eef44c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:05:51.610825 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:05:51.610825 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:05:51.610825 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:05:51.610825 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:05:51.610825 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:05:51.610825 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:05:51.610825 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:05:51.610825 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:05:51.610825 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:05:51.610825 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:05:51.610825 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:05:51.610825 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:05:51.610825 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:05:51.610825 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:05:51.610825 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:05:51.611666 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:05:51.611666 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:05:51.611666 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:05:51.611666 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:05:51.611666 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:05:51.611666 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:05:51.611666 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:05:51.611666 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:05:51.611666 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:05:51.611666 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:05:51.611666 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:05:51.611666 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Aug 31 00:05:51.611666 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:05:51.611666 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:05:51.611666 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:05:51.611666 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:05:51.612569 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:05:51.612569 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:05:51.612569 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:05:51.612569 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:05:51.612569 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:05:51.612569 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:05:51.612569 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:05:51.612569 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:05:51.612569 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:05:51.612569 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:05:51.612569 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:05:51.612569 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Aug 31 00:05:51.612569 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 19/32] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Aug 31 00:05:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:05:51.636661 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0286995-d638-4fbd-89f0-d2bae7eef44c None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:51.752402 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:51.761688 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0286995-d638-4fbd-89f0-d2bae7eef44c None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:51.761913 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 14/33] 10.222.0.47 () {60 vars in 1131 bytes} [Wed Aug 31 00:05:51 2022] POST /identity/v3/roles => generated 225 bytes in 526 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:05:51.763275 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a252fb5-e94b-41db-b584-4ba1dd8a817a None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:51.814709 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294e4e78-d845-49c4-974a-41562d49fe0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:51.815772 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294e4e78-d845-49c4-974a-41562d49fe0f None admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:51.816221 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294e4e78-d845-49c4-974a-41562d49fe0f None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:51.816642 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294e4e78-d845-49c4-974a-41562d49fe0f None admin] PATH_INFO: `/v3/projects` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:51.817763 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294e4e78-d845-49c4-974a-41562d49fe0f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:51.819568 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294e4e78-d845-49c4-974a-41562d49fe0f None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:51.912099 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a252fb5-e94b-41db-b584-4ba1dd8a817a None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:51.931419 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:51.955509 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc15280-66c6-4011-b585-70f86ead2c08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:51.956359 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc15280-66c6-4011-b585-70f86ead2c08 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:51.956744 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc15280-66c6-4011-b585-70f86ead2c08 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:51.957122 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc15280-66c6-4011-b585-70f86ead2c08 None admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:51.957940 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc15280-66c6-4011-b585-70f86ead2c08 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:05:51.958373 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc15280-66c6-4011-b585-70f86ead2c08 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:51.960061 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc15280-66c6-4011-b585-70f86ead2c08 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:51.971165 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 15/34] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 31 00:05:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:05:51.972195 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc15280-66c6-4011-b585-70f86ead2c08 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:51.993544 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 20/35] 10.222.0.47 () {60 vars in 1141 bytes} [Wed Aug 31 00:05:51 2022] POST /identity/v3/projects => generated 301 bytes in 381 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:05:51.995059 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63635264-c686-4579-8c5d-c71eb0379621 None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:51.995349 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63635264-c686-4579-8c5d-c71eb0379621 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:51.995627 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63635264-c686-4579-8c5d-c71eb0379621 None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:52.000294 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 21/36] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 00:05:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:05:52.000294 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e6c4c0-260c-4cac-9ee7-837316a108af None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:52.000294 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e6c4c0-260c-4cac-9ee7-837316a108af None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:52.000294 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e6c4c0-260c-4cac-9ee7-837316a108af None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:52.001844 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 22/37] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 00:05:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:05:52.002765 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e6c4c0-260c-4cac-9ee7-837316a108af None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:52.131305 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc15280-66c6-4011-b585-70f86ead2c08 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:52.161536 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e6c4c0-260c-4cac-9ee7-837316a108af None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:52.188543 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1abf557-d43a-46a2-b56d-8b043ce11cab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:52.189171 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1abf557-d43a-46a2-b56d-8b043ce11cab None admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:52.189455 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1abf557-d43a-46a2-b56d-8b043ce11cab None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:52.189731 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1abf557-d43a-46a2-b56d-8b043ce11cab None admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:52.190418 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1abf557-d43a-46a2-b56d-8b043ce11cab None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:52.191845 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1abf557-d43a-46a2-b56d-8b043ce11cab None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:52.212472 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 16/38] 10.222.0.47 () {60 vars in 1131 bytes} [Wed Aug 31 00:05:51 2022] POST /identity/v3/roles => generated 219 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:05:52.213836 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8887ef9-70b4-45f7-ac0f-155d3261e180 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:52.214128 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8887ef9-70b4-45f7-ac0f-155d3261e180 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:52.214284 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db89c18a-11db-41a0-88d8-5d10cd3745d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:52.214427 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8887ef9-70b4-45f7-ac0f-155d3261e180 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:52.214941 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db89c18a-11db-41a0-88d8-5d10cd3745d3 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:52.215219 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db89c18a-11db-41a0-88d8-5d10cd3745d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:52.215654 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db89c18a-11db-41a0-88d8-5d10cd3745d3 None admin] PATH_INFO: `/v3/users/11b70534c08c4c45883d75f7a7aeed08` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:52.218656 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db89c18a-11db-41a0-88d8-5d10cd3745d3 None admin] RBAC: Authorizing `identity:get_user(user_id=11b70534c08c4c45883d75f7a7aeed08)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:52.220680 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db89c18a-11db-41a0-88d8-5d10cd3745d3 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:52.222598 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 23/39] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 31 00:05:52 2022] GET /identity/v3/users/11b70534c08c4c45883d75f7a7aeed08 => generated 247 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:05:52.223767 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8162aef8-a466-46ae-bdd2-26826ca127ad None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:52.224061 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8162aef8-a466-46ae-bdd2-26826ca127ad None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:52.224371 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8162aef8-a466-46ae-bdd2-26826ca127ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:52.249053 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-c8887ef9-70b4-45f7-ac0f-155d3261e180 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:05:52.249596 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-8162aef8-a466-46ae-bdd2-26826ca127ad None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:05:52.251168 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-8162aef8-a466-46ae-bdd2-26826ca127ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:05:52.251365 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-c8887ef9-70b4-45f7-ac0f-155d3261e180 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:05:52.269918 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:52.302153 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:52.359785 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 17/40] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 00:05:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:05:52.361166 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8887ef9-70b4-45f7-ac0f-155d3261e180 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:52.369873 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 24/41] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 00:05:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:05:52.617577 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8887ef9-70b4-45f7-ac0f-155d3261e180 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:52.644207 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8162aef8-a466-46ae-bdd2-26826ca127ad None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:52.668613 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f14cfc0-1639-4c85-894a-1f782b98dff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:52.670926 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f14cfc0-1639-4c85-894a-1f782b98dff7 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:52.671397 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f14cfc0-1639-4c85-894a-1f782b98dff7 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:52.671869 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f14cfc0-1639-4c85-894a-1f782b98dff7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:52.673845 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f14cfc0-1639-4c85-894a-1f782b98dff7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:52.676493 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f14cfc0-1639-4c85-894a-1f782b98dff7 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:52.679550 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 18/42] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 00:05:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:05:52.680718 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f14cfc0-1639-4c85-894a-1f782b98dff7 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:52.721299 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:52.753283 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8162aef8-a466-46ae-bdd2-26826ca127ad None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:52.790785 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083ec68c-f7a6-405f-80b6-195190b173dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:52.791405 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083ec68c-f7a6-405f-80b6-195190b173dc None admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:52.791690 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083ec68c-f7a6-405f-80b6-195190b173dc None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:52.791967 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083ec68c-f7a6-405f-80b6-195190b173dc None admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:52.792669 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083ec68c-f7a6-405f-80b6-195190b173dc None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:52.794749 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083ec68c-f7a6-405f-80b6-195190b173dc None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:52.795496 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f14cfc0-1639-4c85-894a-1f782b98dff7 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:52.811760 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 25/43] 10.222.0.47 () {60 vars in 1131 bytes} [Wed Aug 31 00:05:52 2022] POST /identity/v3/roles => generated 223 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:05:52.811760 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083ec68c-f7a6-405f-80b6-195190b173dc None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:52.823048 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:52.845969 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449661f0-528d-4f07-a76a-dd48cf4c177d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:52.846641 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449661f0-528d-4f07-a76a-dd48cf4c177d None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:52.847072 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449661f0-528d-4f07-a76a-dd48cf4c177d None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:52.847221 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449661f0-528d-4f07-a76a-dd48cf4c177d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:52.848488 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449661f0-528d-4f07-a76a-dd48cf4c177d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:52.850591 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449661f0-528d-4f07-a76a-dd48cf4c177d None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:52.852320 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 19/44] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 00:05:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:05:52.859004 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449661f0-528d-4f07-a76a-dd48cf4c177d None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:52.951088 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083ec68c-f7a6-405f-80b6-195190b173dc None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:52.990154 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449661f0-528d-4f07-a76a-dd48cf4c177d None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:52.993023 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:53.007395 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c750c2-be8e-45b3-aa9d-be51e3a01e46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:53.007682 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c750c2-be8e-45b3-aa9d-be51e3a01e46 None admin] REQUEST_METHOD: `PUT` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:53.007890 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c750c2-be8e-45b3-aa9d-be51e3a01e46 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:53.009401 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c750c2-be8e-45b3-aa9d-be51e3a01e46 None admin] PATH_INFO: `/v3/domains/default/users/11b70534c08c4c45883d75f7a7aeed08/roles/12f6817f9aaa4e2bb477095a6bed5d0f` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:53.014316 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c750c2-be8e-45b3-aa9d-be51e3a01e46 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=11b70534c08c4c45883d75f7a7aeed08, role_id=12f6817f9aaa4e2bb477095a6bed5d0f)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:53.015815 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c750c2-be8e-45b3-aa9d-be51e3a01e46 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:53.038868 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 26/45] 10.222.0.47 () {58 vars in 1361 bytes} [Wed Aug 31 00:05:52 2022] PUT /identity/v3/domains/default/users/11b70534c08c4c45883d75f7a7aeed08/roles/12f6817f9aaa4e2bb477095a6bed5d0f => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:05:53.043297 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3def1a-f9fa-446c-83a4-c2a86edb8f24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:53.044903 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3def1a-f9fa-446c-83a4-c2a86edb8f24 None admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:53.045405 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3def1a-f9fa-446c-83a4-c2a86edb8f24 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:53.045875 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3def1a-f9fa-446c-83a4-c2a86edb8f24 None admin] PATH_INFO: `/v3/projects` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:53.046766 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3def1a-f9fa-446c-83a4-c2a86edb8f24 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:53.048534 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3def1a-f9fa-446c-83a4-c2a86edb8f24 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:53.083723 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 20/46] 10.222.0.47 () {60 vars in 1141 bytes} [Wed Aug 31 00:05:52 2022] POST /identity/v3/projects => generated 312 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:05:55.018105 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36f62b1-591e-474d-929c-d5d597de99a6 None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:55.018678 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36f62b1-591e-474d-929c-d5d597de99a6 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:55.018678 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36f62b1-591e-474d-929c-d5d597de99a6 None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:55.020040 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 27/47] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 00:05:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:05:55.025814 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0810277-2236-41ce-a190-549e2ebed7fe None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:55.026347 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0810277-2236-41ce-a190-549e2ebed7fe None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:55.026465 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0810277-2236-41ce-a190-549e2ebed7fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:55.048018 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-e0810277-2236-41ce-a190-549e2ebed7fe None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:05:55.049296 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-e0810277-2236-41ce-a190-549e2ebed7fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:05:55.128918 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 21/48] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 00:05:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 00:05:55.177679 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc33df6-0dbf-49e0-8682-716ec4c06ad8 None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:55.177953 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc33df6-0dbf-49e0-8682-716ec4c06ad8 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:55.178238 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc33df6-0dbf-49e0-8682-716ec4c06ad8 None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:55.179664 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 28/49] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 00:05:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:05:55.188584 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8674f252-9694-433e-ba3f-4b011ff19b38 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:55.189062 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8674f252-9694-433e-ba3f-4b011ff19b38 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:55.189515 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8674f252-9694-433e-ba3f-4b011ff19b38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:55.214771 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-8674f252-9694-433e-ba3f-4b011ff19b38 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:05:55.217096 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-8674f252-9694-433e-ba3f-4b011ff19b38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:05:55.328799 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 22/50] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 00:05:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:05:55.436227 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc33df6-0dbf-49e0-8682-716ec4c06ad8 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:55.514320 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:55.568025 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc33df6-0dbf-49e0-8682-716ec4c06ad8 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:55.602966 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8674f252-9694-433e-ba3f-4b011ff19b38 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:55.606697 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871809bd-1cf5-4ad1-8112-efbf779605a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:55.607538 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871809bd-1cf5-4ad1-8112-efbf779605a7 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:55.607941 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871809bd-1cf5-4ad1-8112-efbf779605a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:55.608346 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871809bd-1cf5-4ad1-8112-efbf779605a7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:55.619962 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871809bd-1cf5-4ad1-8112-efbf779605a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:05:55.625925 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-871809bd-1cf5-4ad1-8112-efbf779605a7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:05:55.625925 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:05:55.625925 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:05:55.625925 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:05:55.625925 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:05:55.625925 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:05:55.625925 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:05:55.625925 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:05:55.625925 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:05:55.625925 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:05:55.625925 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:05:55.625925 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:05:55.625925 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:05:55.625925 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:05:55.625925 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:05:55.625925 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:05:55.627683 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:05:55.627683 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:05:55.627683 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:05:55.627683 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:05:55.627683 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:05:55.627683 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:05:55.627683 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:05:55.627683 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:05:55.627683 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:05:55.627683 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:05:55.627683 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:05:55.627683 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Aug 31 00:05:55.627683 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:05:55.627683 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:05:55.627683 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:05:55.627683 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:05:55.629363 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:05:55.629363 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:05:55.629363 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:05:55.629363 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:05:55.629363 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:05:55.629363 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:05:55.629363 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:05:55.629363 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:05:55.629363 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:05:55.629363 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:05:55.629363 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:05:55.629363 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Aug 31 00:05:55.629363 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 29/51] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Aug 31 00:05:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:05:55.633915 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:55.634329 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871809bd-1cf5-4ad1-8112-efbf779605a7 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:55.739515 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8674f252-9694-433e-ba3f-4b011ff19b38 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:55.781240 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb4ce2c-b10e-4ee7-aec8-adc2957a706e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:55.781911 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb4ce2c-b10e-4ee7-aec8-adc2957a706e None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:55.782192 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb4ce2c-b10e-4ee7-aec8-adc2957a706e None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:55.782464 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb4ce2c-b10e-4ee7-aec8-adc2957a706e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:55.783664 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb4ce2c-b10e-4ee7-aec8-adc2957a706e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:55.785477 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb4ce2c-b10e-4ee7-aec8-adc2957a706e None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:55.787141 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 23/52] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 00:05:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:05:55.793137 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb4ce2c-b10e-4ee7-aec8-adc2957a706e None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:55.869121 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871809bd-1cf5-4ad1-8112-efbf779605a7 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:55.897071 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:55.907059 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab7673f-a6e8-441a-93e6-e5718797f304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:55.907680 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab7673f-a6e8-441a-93e6-e5718797f304 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:55.907962 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab7673f-a6e8-441a-93e6-e5718797f304 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:55.908274 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab7673f-a6e8-441a-93e6-e5718797f304 None admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:55.908956 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab7673f-a6e8-441a-93e6-e5718797f304 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:05:55.909521 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab7673f-a6e8-441a-93e6-e5718797f304 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:55.910940 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab7673f-a6e8-441a-93e6-e5718797f304 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:55.921002 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:55.925263 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 30/53] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 31 00:05:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:05:55.931265 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab7673f-a6e8-441a-93e6-e5718797f304 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:55.944455 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb4ce2c-b10e-4ee7-aec8-adc2957a706e None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:55.992923 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8a7b77-50ed-4d4b-b86f-250884c936ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:55.993674 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8a7b77-50ed-4d4b-b86f-250884c936ca None admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:55.994124 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8a7b77-50ed-4d4b-b86f-250884c936ca None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:55.994481 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8a7b77-50ed-4d4b-b86f-250884c936ca None admin] PATH_INFO: `/v3/projects` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:55.995234 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8a7b77-50ed-4d4b-b86f-250884c936ca None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:55.997703 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8a7b77-50ed-4d4b-b86f-250884c936ca None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:56.034636 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 24/54] 10.222.0.47 () {60 vars in 1140 bytes} [Wed Aug 31 00:05:55 2022] POST /identity/v3/projects => generated 298 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:05:56.083293 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab7673f-a6e8-441a-93e6-e5718797f304 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:56.128101 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d460ce75-f554-4446-a482-a9e5d58e1f0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:56.128695 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d460ce75-f554-4446-a482-a9e5d58e1f0c None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:56.128983 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d460ce75-f554-4446-a482-a9e5d58e1f0c None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:56.129263 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d460ce75-f554-4446-a482-a9e5d58e1f0c None admin] PATH_INFO: `/v3/users/11b70534c08c4c45883d75f7a7aeed08` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:56.130483 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d460ce75-f554-4446-a482-a9e5d58e1f0c None admin] RBAC: Authorizing `identity:get_user(user_id=11b70534c08c4c45883d75f7a7aeed08)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:56.131995 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d460ce75-f554-4446-a482-a9e5d58e1f0c None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:56.133716 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 31/55] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 31 00:05:55 2022] GET /identity/v3/users/11b70534c08c4c45883d75f7a7aeed08 => generated 247 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:05:56.142950 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8a7b77-50ed-4d4b-b86f-250884c936ca None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:56.301176 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8a7b77-50ed-4d4b-b86f-250884c936ca None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:56.342452 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac714d9-475c-4ea7-b94e-f41a382dbff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:56.343119 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac714d9-475c-4ea7-b94e-f41a382dbff1 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:56.343402 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac714d9-475c-4ea7-b94e-f41a382dbff1 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:56.343674 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac714d9-475c-4ea7-b94e-f41a382dbff1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:56.345010 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac714d9-475c-4ea7-b94e-f41a382dbff1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:56.346520 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac714d9-475c-4ea7-b94e-f41a382dbff1 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:56.348234 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 25/56] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 00:05:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:05:56.357626 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d460ce75-f554-4446-a482-a9e5d58e1f0c None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:56.429266 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:56.478628 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d460ce75-f554-4446-a482-a9e5d58e1f0c None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:56.517433 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583ea22c-ec1d-40e7-91f0-35e284684dea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:56.518053 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583ea22c-ec1d-40e7-91f0-35e284684dea None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:56.518336 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583ea22c-ec1d-40e7-91f0-35e284684dea None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:56.518610 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583ea22c-ec1d-40e7-91f0-35e284684dea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:56.519355 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583ea22c-ec1d-40e7-91f0-35e284684dea None admin] RBAC: Adding query filter params (role.id=12f6817f9aaa4e2bb477095a6bed5d0f, scope.domain.id=default, user.id=11b70534c08c4c45883d75f7a7aeed08) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:05:56.519665 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583ea22c-ec1d-40e7-91f0-35e284684dea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:56.521187 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583ea22c-ec1d-40e7-91f0-35e284684dea None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:56.530700 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 32/57] 10.222.0.47 () {56 vars in 1322 bytes} [Wed Aug 31 00:05:56 2022] GET /identity/v3/role_assignments?user.id=11b70534c08c4c45883d75f7a7aeed08&scope.domain.id=default&role.id=12f6817f9aaa4e2bb477095a6bed5d0f => generated 530 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:05:58.039169 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491c318b-7a58-4cce-ac16-69c256f31e36 None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:58.039716 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491c318b-7a58-4cce-ac16-69c256f31e36 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:58.039716 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491c318b-7a58-4cce-ac16-69c256f31e36 None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:58.041105 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 26/58] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 00:05:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:05:58.047796 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55502197-6252-428f-9bc2-863baf1d6afa None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:58.048332 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55502197-6252-428f-9bc2-863baf1d6afa None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:58.048480 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55502197-6252-428f-9bc2-863baf1d6afa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:58.069508 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-55502197-6252-428f-9bc2-863baf1d6afa None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:05:58.070766 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-55502197-6252-428f-9bc2-863baf1d6afa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:05:58.145044 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 33/59] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 00:05:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 00:05:58.416894 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491c318b-7a58-4cce-ac16-69c256f31e36 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:58.421411 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:58.558390 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491c318b-7a58-4cce-ac16-69c256f31e36 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:58.596791 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d847a9c-8931-485d-a364-03cef2b1af12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:58.597433 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d847a9c-8931-485d-a364-03cef2b1af12 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:58.597721 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d847a9c-8931-485d-a364-03cef2b1af12 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:58.598000 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d847a9c-8931-485d-a364-03cef2b1af12 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:58.599131 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d847a9c-8931-485d-a364-03cef2b1af12 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:58.600636 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d847a9c-8931-485d-a364-03cef2b1af12 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:58.602236 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 27/60] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 00:05:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:05:58.608613 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55502197-6252-428f-9bc2-863baf1d6afa None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:05:58.659775 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:05:58.709698 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55502197-6252-428f-9bc2-863baf1d6afa None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:05:58.744082 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea81177-1244-459a-8b1f-9f0e018e2bf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:05:58.744732 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea81177-1244-459a-8b1f-9f0e018e2bf5 None admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:05:58.745013 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea81177-1244-459a-8b1f-9f0e018e2bf5 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:05:58.745289 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea81177-1244-459a-8b1f-9f0e018e2bf5 None admin] PATH_INFO: `/v3/users` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:05:58.745935 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea81177-1244-459a-8b1f-9f0e018e2bf5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:05:58.747549 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea81177-1244-459a-8b1f-9f0e018e2bf5 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:05:58.779329 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 34/61] 10.222.0.47 () {60 vars in 1132 bytes} [Wed Aug 31 00:05:58 2022] POST /identity/v3/users => generated 275 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:06:02.178526 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dd52af-c26d-41e4-a3bc-19803aac0203 None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:02.179550 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dd52af-c26d-41e4-a3bc-19803aac0203 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:02.180071 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dd52af-c26d-41e4-a3bc-19803aac0203 None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:02.181702 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 28/62] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 00:06:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:06:02.188018 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94962ad3-1cb6-4c67-8e44-87e85d7683d0 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:02.188998 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94962ad3-1cb6-4c67-8e44-87e85d7683d0 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:02.189481 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94962ad3-1cb6-4c67-8e44-87e85d7683d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:02.221048 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-94962ad3-1cb6-4c67-8e44-87e85d7683d0 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:06:02.222637 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-94962ad3-1cb6-4c67-8e44-87e85d7683d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:06:02.333690 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 35/63] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 00:06:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:06:02.345452 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc47f53-d3fe-4c34-952f-34dc7aaef68b None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:02.346057 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc47f53-d3fe-4c34-952f-34dc7aaef68b None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:02.346536 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc47f53-d3fe-4c34-952f-34dc7aaef68b None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:02.348120 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 29/64] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 00:06:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:06:02.355904 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff618c22-a886-4f41-bd3e-99983a20dcd5 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:02.357154 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff618c22-a886-4f41-bd3e-99983a20dcd5 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:02.357642 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff618c22-a886-4f41-bd3e-99983a20dcd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:02.380698 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-ff618c22-a886-4f41-bd3e-99983a20dcd5 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:06:02.382307 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-ff618c22-a886-4f41-bd3e-99983a20dcd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:06:02.420816 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:02.487010 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 36/65] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 00:06:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:06:02.695888 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a4624c-25bb-4649-b348-6807107fce25 None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:02.696388 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a4624c-25bb-4649-b348-6807107fce25 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:02.696573 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a4624c-25bb-4649-b348-6807107fce25 None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:02.697833 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 30/66] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 00:06:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:06:02.703838 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1257ede3-1e02-4560-91f1-57d61af3f774 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:02.704227 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1257ede3-1e02-4560-91f1-57d61af3f774 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:02.704464 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1257ede3-1e02-4560-91f1-57d61af3f774 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:02.732426 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-1257ede3-1e02-4560-91f1-57d61af3f774 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:06:02.733667 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-1257ede3-1e02-4560-91f1-57d61af3f774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:06:02.794376 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb705dda-13bf-401f-9bf2-fbcb0e7ca7e5 None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:02.794769 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb705dda-13bf-401f-9bf2-fbcb0e7ca7e5 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:02.794990 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb705dda-13bf-401f-9bf2-fbcb0e7ca7e5 None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:02.796330 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 31/67] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 00:06:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 00:06:02.802014 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b9b0e1-86bc-4287-9524-0bea80d0b927 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:02.802612 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b9b0e1-86bc-4287-9524-0bea80d0b927 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:02.803111 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b9b0e1-86bc-4287-9524-0bea80d0b927 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:02.840733 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-78b9b0e1-86bc-4287-9524-0bea80d0b927 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:06:02.842737 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-78b9b0e1-86bc-4287-9524-0bea80d0b927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:06:02.901668 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 37/68] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 00:06:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:06:02.945435 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1257ede3-1e02-4560-91f1-57d61af3f774 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:03.060229 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 32/69] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 00:06:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 00:06:03.134110 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b9b0e1-86bc-4287-9524-0bea80d0b927 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:03.153363 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:03.162828 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:03.177440 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1257ede3-1e02-4560-91f1-57d61af3f774 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:03.243015 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8fcc76-4734-4d56-9a7a-8f24dbb0fbb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:03.245219 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8fcc76-4734-4d56-9a7a-8f24dbb0fbb5 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:03.245865 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8fcc76-4734-4d56-9a7a-8f24dbb0fbb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:03.246600 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8fcc76-4734-4d56-9a7a-8f24dbb0fbb5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:03.271205 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8fcc76-4734-4d56-9a7a-8f24dbb0fbb5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:06:03.283203 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-7c8fcc76-4734-4d56-9a7a-8f24dbb0fbb5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 00:06:03.283203 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:03.283203 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:06:03.283203 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:06:03.283203 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:06:03.283203 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:06:03.283203 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:06:03.283203 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:06:03.283203 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:06:03.283203 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:06:03.283203 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:06:03.283203 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:06:03.283203 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:06:03.283203 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:06:03.283203 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:06:03.283203 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:06:03.285109 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:06:03.285109 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:06:03.285109 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:06:03.285109 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:06:03.285109 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:06:03.285109 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:06:03.285109 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:06:03.285109 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:06:03.285109 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:06:03.285109 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:06:03.285109 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:06:03.285109 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Aug 31 00:06:03.285109 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:06:03.285109 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:06:03.285109 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:06:03.285109 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:06:03.286562 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:06:03.286562 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:06:03.286562 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:06:03.286562 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:06:03.286562 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:06:03.286562 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:06:03.286562 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:06:03.286562 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:06:03.286562 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:06:03.286562 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:06:03.286562 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 00:06:03.286562 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Aug 31 00:06:03.290090 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 38/70] 10.222.0.47 () {56 vars in 1114 bytes} [Wed Aug 31 00:06:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 346 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:06:03.292826 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b447f0-ebe4-4025-8831-f3e8aae52084 None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:03.293435 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b447f0-ebe4-4025-8831-f3e8aae52084 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:03.294825 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b447f0-ebe4-4025-8831-f3e8aae52084 None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:03.302629 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 39/71] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 00:06:03 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:06:03.302629 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b447f0-ebe4-4025-8831-f3e8aae52084 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:03.311522 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b9b0e1-86bc-4287-9524-0bea80d0b927 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:03.357752 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce3ea4b-8e84-4b80-a998-8c50c1c60656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:03.358890 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce3ea4b-8e84-4b80-a998-8c50c1c60656 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:03.359436 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce3ea4b-8e84-4b80-a998-8c50c1c60656 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:03.359962 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce3ea4b-8e84-4b80-a998-8c50c1c60656 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:03.377670 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce3ea4b-8e84-4b80-a998-8c50c1c60656 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:06:03.383974 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-dce3ea4b-8e84-4b80-a998-8c50c1c60656 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 00:06:03.383974 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:03.383974 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:06:03.383974 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:06:03.383974 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:06:03.383974 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:06:03.383974 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:06:03.383974 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:06:03.383974 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:06:03.383974 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:06:03.383974 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:06:03.383974 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:06:03.383974 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:06:03.383974 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:06:03.383974 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:06:03.383974 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:06:03.385003 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:06:03.385003 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:06:03.385003 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:06:03.385003 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:06:03.385003 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:06:03.385003 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:06:03.385003 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:06:03.385003 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:06:03.385003 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:06:03.385003 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:06:03.385003 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:06:03.385003 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 31 00:06:03.385003 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:06:03.385003 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:06:03.385003 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:06:03.385003 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:06:03.391530 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:06:03.391530 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:06:03.391530 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:06:03.391530 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:06:03.391530 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:06:03.391530 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:06:03.391530 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:06:03.391530 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:06:03.391530 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:06:03.391530 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:06:03.391530 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 00:06:03.391530 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 31 00:06:03.391530 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 33/72] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 31 00:06:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:06:03.391530 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f572a1-5e07-409a-a1a1-5a70ac3be90d None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:03.392266 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f572a1-5e07-409a-a1a1-5a70ac3be90d None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:03.392266 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f572a1-5e07-409a-a1a1-5a70ac3be90d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:03.416737 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-25f572a1-5e07-409a-a1a1-5a70ac3be90d None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:06:03.418192 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-25f572a1-5e07-409a-a1a1-5a70ac3be90d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:06:03.460781 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b447f0-ebe4-4025-8831-f3e8aae52084 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:03.513449 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:03.514198 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b31eee2-83c4-469b-9bb8-897256eaac76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:03.515648 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b31eee2-83c4-469b-9bb8-897256eaac76 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:03.515924 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b31eee2-83c4-469b-9bb8-897256eaac76 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:03.516355 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b31eee2-83c4-469b-9bb8-897256eaac76 None admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:03.517305 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b31eee2-83c4-469b-9bb8-897256eaac76 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:03.517714 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b31eee2-83c4-469b-9bb8-897256eaac76 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:03.519416 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b31eee2-83c4-469b-9bb8-897256eaac76 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:03.525646 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 34/73] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 00:06:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:06:03.526535 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f572a1-5e07-409a-a1a1-5a70ac3be90d None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:03.533706 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 40/74] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 31 00:06:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:03.534460 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b31eee2-83c4-469b-9bb8-897256eaac76 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:03.574445 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:03.659543 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f572a1-5e07-409a-a1a1-5a70ac3be90d None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:03.720290 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5743895-1367-47b3-a29e-a805294cca9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:03.721399 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5743895-1367-47b3-a29e-a805294cca9c None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:03.721910 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5743895-1367-47b3-a29e-a805294cca9c None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:03.722390 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5743895-1367-47b3-a29e-a805294cca9c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:03.734490 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b31eee2-83c4-469b-9bb8-897256eaac76 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:03.742929 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5743895-1367-47b3-a29e-a805294cca9c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:06:03.754764 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-b5743895-1367-47b3-a29e-a805294cca9c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 00:06:03.754764 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:03.754764 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:06:03.754764 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:06:03.754764 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:06:03.754764 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:06:03.754764 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:06:03.754764 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:06:03.754764 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:06:03.754764 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:06:03.754764 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:06:03.754764 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:06:03.754764 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:06:03.754764 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:06:03.754764 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:06:03.754764 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:06:03.755718 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:06:03.755718 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:06:03.755718 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:06:03.755718 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:06:03.755718 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:06:03.755718 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:06:03.755718 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:06:03.755718 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:06:03.755718 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:06:03.755718 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:06:03.755718 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:06:03.755718 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 31 00:06:03.755718 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:06:03.755718 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:06:03.755718 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:06:03.755718 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:06:03.756536 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:06:03.756536 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:06:03.756536 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:06:03.756536 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:06:03.756536 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:06:03.756536 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:06:03.756536 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:06:03.756536 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:06:03.756536 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:06:03.756536 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:06:03.756536 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 00:06:03.756536 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 31 00:06:03.757145 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 35/75] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 31 00:06:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:06:03.758603 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5743895-1367-47b3-a29e-a805294cca9c None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:03.795052 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90b3148-17a2-4301-ba2a-67d594e3c72c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:03.795994 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90b3148-17a2-4301-ba2a-67d594e3c72c None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:03.796331 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90b3148-17a2-4301-ba2a-67d594e3c72c None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:03.796597 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90b3148-17a2-4301-ba2a-67d594e3c72c None admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:03.797346 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90b3148-17a2-4301-ba2a-67d594e3c72c None admin] RBAC: Adding query filter params (name=member) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:03.797688 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90b3148-17a2-4301-ba2a-67d594e3c72c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:03.799174 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90b3148-17a2-4301-ba2a-67d594e3c72c None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:03.818390 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 41/76] 10.222.0.47 () {56 vars in 1101 bytes} [Wed Aug 31 00:06:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:03.818390 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90b3148-17a2-4301-ba2a-67d594e3c72c None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:03.862515 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:03.954169 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5743895-1367-47b3-a29e-a805294cca9c None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:03.955344 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:03.987485 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90b3148-17a2-4301-ba2a-67d594e3c72c None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:04.011310 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3685b01e-9f94-482e-aa13-cabd8bad6e7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:04.011974 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3685b01e-9f94-482e-aa13-cabd8bad6e7f None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:04.012493 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3685b01e-9f94-482e-aa13-cabd8bad6e7f None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:04.012638 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3685b01e-9f94-482e-aa13-cabd8bad6e7f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:04.025723 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3685b01e-9f94-482e-aa13-cabd8bad6e7f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:06:04.029571 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759d85bc-77e8-4129-9ee8-2766e0a48965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:04.030218 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759d85bc-77e8-4129-9ee8-2766e0a48965 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:04.030503 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759d85bc-77e8-4129-9ee8-2766e0a48965 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:04.030784 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759d85bc-77e8-4129-9ee8-2766e0a48965 None admin] PATH_INFO: `/v3/users/053c6535fa2e4cb595fbd3b2fe32ca43` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:04.034042 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-3685b01e-9f94-482e-aa13-cabd8bad6e7f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:06:04.034042 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:04.034042 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:06:04.034042 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:06:04.034042 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:06:04.034042 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:06:04.034042 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:06:04.034042 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:06:04.034042 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:06:04.034042 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:06:04.034042 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:06:04.034042 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:06:04.034042 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:06:04.034042 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:06:04.034042 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:06:04.034042 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:06:04.035997 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:06:04.035997 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:06:04.035997 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:06:04.035997 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:06:04.035997 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:06:04.035997 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:06:04.035997 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:06:04.035997 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:06:04.035997 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:06:04.035997 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:06:04.035997 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:06:04.035997 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 31 00:06:04.035997 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:06:04.035997 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:06:04.035997 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:06:04.035997 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:06:04.037639 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:06:04.037639 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:06:04.037639 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:06:04.037639 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:06:04.037639 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:06:04.037639 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:06:04.037639 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:06:04.037639 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:06:04.037639 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:06:04.037639 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:06:04.037639 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:06:04.037639 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 31 00:06:04.037639 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 36/77] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Aug 31 00:06:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:06:04.037639 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3685b01e-9f94-482e-aa13-cabd8bad6e7f None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:04.049420 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759d85bc-77e8-4129-9ee8-2766e0a48965 None admin] RBAC: Authorizing `identity:get_user(user_id=053c6535fa2e4cb595fbd3b2fe32ca43)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:04.050843 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759d85bc-77e8-4129-9ee8-2766e0a48965 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:04.052579 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 42/78] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 31 00:06:03 2022] GET /identity/v3/users/053c6535fa2e4cb595fbd3b2fe32ca43 => generated 275 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:04.053354 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759d85bc-77e8-4129-9ee8-2766e0a48965 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:04.158986 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3685b01e-9f94-482e-aa13-cabd8bad6e7f None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:04.162359 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759d85bc-77e8-4129-9ee8-2766e0a48965 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:04.175708 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:04.198888 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969a5173-c4bf-4457-9092-70898a777da0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:04.199511 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969a5173-c4bf-4457-9092-70898a777da0 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:04.200452 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969a5173-c4bf-4457-9092-70898a777da0 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:04.200730 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969a5173-c4bf-4457-9092-70898a777da0 None admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:04.201411 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969a5173-c4bf-4457-9092-70898a777da0 None admin] RBAC: Adding query filter params (name=member) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:04.201724 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969a5173-c4bf-4457-9092-70898a777da0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:04.203148 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969a5173-c4bf-4457-9092-70898a777da0 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:04.204675 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d07e96-7cc5-4c21-b213-4c57282e4a7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:04.204866 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d07e96-7cc5-4c21-b213-4c57282e4a7b None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:04.205026 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d07e96-7cc5-4c21-b213-4c57282e4a7b None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:04.205441 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d07e96-7cc5-4c21-b213-4c57282e4a7b None admin] PATH_INFO: `/v3/users/053c6535fa2e4cb595fbd3b2fe32ca43` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:04.206476 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d07e96-7cc5-4c21-b213-4c57282e4a7b None admin] RBAC: Authorizing `identity:get_user(user_id=053c6535fa2e4cb595fbd3b2fe32ca43)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:04.207957 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d07e96-7cc5-4c21-b213-4c57282e4a7b None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:04.209629 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 43/79] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 31 00:06:04 2022] GET /identity/v3/users/053c6535fa2e4cb595fbd3b2fe32ca43 => generated 275 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:04.212883 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 37/80] 10.222.0.47 () {56 vars in 1101 bytes} [Wed Aug 31 00:06:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:04.213766 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969a5173-c4bf-4457-9092-70898a777da0 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:04.214351 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d07e96-7cc5-4c21-b213-4c57282e4a7b None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:04.230391 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:04.328950 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969a5173-c4bf-4457-9092-70898a777da0 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:04.363436 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d07e96-7cc5-4c21-b213-4c57282e4a7b None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:04.374978 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d42c43-9f22-4875-b0e4-a39a45ed3d06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:04.375944 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d42c43-9f22-4875-b0e4-a39a45ed3d06 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:04.376385 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d42c43-9f22-4875-b0e4-a39a45ed3d06 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:04.376807 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d42c43-9f22-4875-b0e4-a39a45ed3d06 None admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:04.377930 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d42c43-9f22-4875-b0e4-a39a45ed3d06 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:04.378444 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d42c43-9f22-4875-b0e4-a39a45ed3d06 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:04.380784 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d42c43-9f22-4875-b0e4-a39a45ed3d06 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:04.395051 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 38/81] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 31 00:06:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:04.396311 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d42c43-9f22-4875-b0e4-a39a45ed3d06 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:04.420798 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b3a629-4e56-44fd-a92a-d6747b147263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:04.421451 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b3a629-4e56-44fd-a92a-d6747b147263 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:04.421735 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b3a629-4e56-44fd-a92a-d6747b147263 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:04.422017 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b3a629-4e56-44fd-a92a-d6747b147263 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:04.423171 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b3a629-4e56-44fd-a92a-d6747b147263 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:04.424688 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b3a629-4e56-44fd-a92a-d6747b147263 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:04.426525 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 44/82] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 00:06:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:04.427093 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b3a629-4e56-44fd-a92a-d6747b147263 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:04.446695 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:04.521059 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:04.540401 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d42c43-9f22-4875-b0e4-a39a45ed3d06 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:04.549192 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b3a629-4e56-44fd-a92a-d6747b147263 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:04.581116 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8bef2a-485e-4ab2-ac70-31ee6a021131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:04.581671 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8bef2a-485e-4ab2-ac70-31ee6a021131 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:04.581950 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8bef2a-485e-4ab2-ac70-31ee6a021131 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:04.582229 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8bef2a-485e-4ab2-ac70-31ee6a021131 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:04.587537 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b19238-c40f-4580-affb-67be5f8e971a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:04.588180 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b19238-c40f-4580-affb-67be5f8e971a None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:04.588513 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b19238-c40f-4580-affb-67be5f8e971a None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:04.588747 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b19238-c40f-4580-affb-67be5f8e971a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:04.659534 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8bef2a-485e-4ab2-ac70-31ee6a021131 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:04.661372 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8bef2a-485e-4ab2-ac70-31ee6a021131 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:04.666590 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b19238-c40f-4580-affb-67be5f8e971a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:04.668105 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b19238-c40f-4580-affb-67be5f8e971a None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:04.700569 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:04.771334 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:04.789772 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 39/83] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 31 00:06:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 00:06:04.792984 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8bef2a-485e-4ab2-ac70-31ee6a021131 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:04.799922 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 45/84] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 31 00:06:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 00:06:04.800723 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b19238-c40f-4580-affb-67be5f8e971a None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:04.920578 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8bef2a-485e-4ab2-ac70-31ee6a021131 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:04.921250 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b19238-c40f-4580-affb-67be5f8e971a None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:04.960857 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5ac005-d17f-44d3-af34-38a63ab7e5b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:04.961634 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5ac005-d17f-44d3-af34-38a63ab7e5b0 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:04.962003 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5ac005-d17f-44d3-af34-38a63ab7e5b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:04.962393 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5ac005-d17f-44d3-af34-38a63ab7e5b0 None admin] PATH_INFO: `/v3/users/053c6535fa2e4cb595fbd3b2fe32ca43` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:04.963419 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d34ecd-6315-4f4d-b73f-0f5222b08a35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:04.963782 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5ac005-d17f-44d3-af34-38a63ab7e5b0 None admin] RBAC: Authorizing `identity:get_user(user_id=053c6535fa2e4cb595fbd3b2fe32ca43)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:04.964229 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d34ecd-6315-4f4d-b73f-0f5222b08a35 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:04.964570 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d34ecd-6315-4f4d-b73f-0f5222b08a35 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:04.964918 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d34ecd-6315-4f4d-b73f-0f5222b08a35 None admin] PATH_INFO: `/v3/users/11b70534c08c4c45883d75f7a7aeed08` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:04.965797 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5ac005-d17f-44d3-af34-38a63ab7e5b0 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:04.966325 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d34ecd-6315-4f4d-b73f-0f5222b08a35 None admin] RBAC: Authorizing `identity:get_user(user_id=11b70534c08c4c45883d75f7a7aeed08)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:04.967828 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 40/85] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 31 00:06:04 2022] GET /identity/v3/users/053c6535fa2e4cb595fbd3b2fe32ca43 => generated 275 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:04.968048 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d34ecd-6315-4f4d-b73f-0f5222b08a35 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:04.968863 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5ac005-d17f-44d3-af34-38a63ab7e5b0 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:04.971277 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 46/86] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 31 00:06:04 2022] GET /identity/v3/users/11b70534c08c4c45883d75f7a7aeed08 => generated 247 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:04.974586 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:04.975009 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d34ecd-6315-4f4d-b73f-0f5222b08a35 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:05.026005 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:05.089243 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5ac005-d17f-44d3-af34-38a63ab7e5b0 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:05.099706 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d34ecd-6315-4f4d-b73f-0f5222b08a35 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:05.130112 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba73f224-7762-4a3d-8cfa-db116f57659f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:05.130753 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba73f224-7762-4a3d-8cfa-db116f57659f None admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:05.131046 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba73f224-7762-4a3d-8cfa-db116f57659f None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:05.131320 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba73f224-7762-4a3d-8cfa-db116f57659f None admin] PATH_INFO: `/v3/users` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:05.132020 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba73f224-7762-4a3d-8cfa-db116f57659f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:05.133610 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba73f224-7762-4a3d-8cfa-db116f57659f None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:05.142576 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e573f9-28ab-48e2-a34d-fd98a07a9649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:05.143238 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e573f9-28ab-48e2-a34d-fd98a07a9649 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:05.143517 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e573f9-28ab-48e2-a34d-fd98a07a9649 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:05.143796 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e573f9-28ab-48e2-a34d-fd98a07a9649 None admin] PATH_INFO: `/v3/projects/24b0845707914a1f9ffa3665e80a3533` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:05.145072 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e573f9-28ab-48e2-a34d-fd98a07a9649 None admin] RBAC: Authorizing `identity:get_project(project_id=24b0845707914a1f9ffa3665e80a3533)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:05.146592 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e573f9-28ab-48e2-a34d-fd98a07a9649 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:05.148336 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 47/87] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 31 00:06:04 2022] GET /identity/v3/projects/24b0845707914a1f9ffa3665e80a3533 => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:05.149167 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e573f9-28ab-48e2-a34d-fd98a07a9649 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:05.167522 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 41/88] 10.222.0.47 () {60 vars in 1132 bytes} [Wed Aug 31 00:06:04 2022] POST /identity/v3/users => generated 289 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:06:05.170381 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba73f224-7762-4a3d-8cfa-db116f57659f None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:05.285163 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:05.359212 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e573f9-28ab-48e2-a34d-fd98a07a9649 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:05.363236 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba73f224-7762-4a3d-8cfa-db116f57659f None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:05.380644 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:05.421661 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2f6eef-d5cd-4298-a4a9-8a55aa6eaee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:05.422307 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2f6eef-d5cd-4298-a4a9-8a55aa6eaee4 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:05.422594 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2f6eef-d5cd-4298-a4a9-8a55aa6eaee4 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:05.422872 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2f6eef-d5cd-4298-a4a9-8a55aa6eaee4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:05.423292 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c33afe6-6ba6-4716-adab-d5e30fea9088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:05.425299 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c33afe6-6ba6-4716-adab-d5e30fea9088 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:05.425299 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c33afe6-6ba6-4716-adab-d5e30fea9088 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:05.425299 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c33afe6-6ba6-4716-adab-d5e30fea9088 None admin] PATH_INFO: `/v3/projects/24b0845707914a1f9ffa3665e80a3533` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:05.428114 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c33afe6-6ba6-4716-adab-d5e30fea9088 None admin] RBAC: Authorizing `identity:get_project(project_id=24b0845707914a1f9ffa3665e80a3533)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:05.429621 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c33afe6-6ba6-4716-adab-d5e30fea9088 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:05.433253 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 48/89] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 31 00:06:05 2022] GET /identity/v3/projects/24b0845707914a1f9ffa3665e80a3533 => generated 298 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:05.433704 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c33afe6-6ba6-4716-adab-d5e30fea9088 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:05.539937 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2f6eef-d5cd-4298-a4a9-8a55aa6eaee4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:05.542605 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2f6eef-d5cd-4298-a4a9-8a55aa6eaee4 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:05.618625 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:05.637386 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c33afe6-6ba6-4716-adab-d5e30fea9088 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:05.677302 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 42/90] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 31 00:06:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 509 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 00:06:05.678209 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2f6eef-d5cd-4298-a4a9-8a55aa6eaee4 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:05.698719 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9e8223-2781-4023-ae61-745d359b4f79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:05.700296 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9e8223-2781-4023-ae61-745d359b4f79 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:05.700840 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9e8223-2781-4023-ae61-745d359b4f79 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:05.701312 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9e8223-2781-4023-ae61-745d359b4f79 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:05.759589 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:05.792475 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9e8223-2781-4023-ae61-745d359b4f79 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:05.794357 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9e8223-2781-4023-ae61-745d359b4f79 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:05.856606 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2f6eef-d5cd-4298-a4a9-8a55aa6eaee4 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:05.898853 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4550bc59-9bd0-4616-a438-69e55f9ee5b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:05.899585 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4550bc59-9bd0-4616-a438-69e55f9ee5b2 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:05.899930 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4550bc59-9bd0-4616-a438-69e55f9ee5b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:05.900294 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4550bc59-9bd0-4616-a438-69e55f9ee5b2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:05.901109 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4550bc59-9bd0-4616-a438-69e55f9ee5b2 None admin] RBAC: Adding query filter params (role.id=89f25837440e4981bad54fe74d242232, scope.project.id=24b0845707914a1f9ffa3665e80a3533, user.id=053c6535fa2e4cb595fbd3b2fe32ca43) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:05.901489 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4550bc59-9bd0-4616-a438-69e55f9ee5b2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:05.903850 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4550bc59-9bd0-4616-a438-69e55f9ee5b2 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:05.910940 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 43/91] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 31 00:06:05 2022] GET /identity/v3/role_assignments?user.id=053c6535fa2e4cb595fbd3b2fe32ca43&scope.project.id=24b0845707914a1f9ffa3665e80a3533&role.id=89f25837440e4981bad54fe74d242232 => generated 259 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:05.912102 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4550bc59-9bd0-4616-a438-69e55f9ee5b2 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:05.963862 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:05.964752 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 49/92] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 31 00:06:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 532 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 00:06:05.967233 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9e8223-2781-4023-ae61-745d359b4f79 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:06.053200 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4550bc59-9bd0-4616-a438-69e55f9ee5b2 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:06.118342 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe221b3d-829b-4dc8-bc44-8ef6010f38ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:06.119092 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe221b3d-829b-4dc8-bc44-8ef6010f38ad None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:06.119554 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe221b3d-829b-4dc8-bc44-8ef6010f38ad None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:06.119921 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe221b3d-829b-4dc8-bc44-8ef6010f38ad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:06.120788 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe221b3d-829b-4dc8-bc44-8ef6010f38ad None admin] RBAC: Adding query filter params (role.id=fdad79ffbcbb4fa380dc9cf7dd108618, scope.project.id=24b0845707914a1f9ffa3665e80a3533, user.id=053c6535fa2e4cb595fbd3b2fe32ca43) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:06.121261 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe221b3d-829b-4dc8-bc44-8ef6010f38ad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:06.122888 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe221b3d-829b-4dc8-bc44-8ef6010f38ad None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:06.129549 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 44/93] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 31 00:06:05 2022] GET /identity/v3/role_assignments?user.id=053c6535fa2e4cb595fbd3b2fe32ca43&scope.project.id=24b0845707914a1f9ffa3665e80a3533&role.id=fdad79ffbcbb4fa380dc9cf7dd108618 => generated 259 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:06.130545 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe221b3d-829b-4dc8-bc44-8ef6010f38ad None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:06.195001 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:06.292001 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9e8223-2781-4023-ae61-745d359b4f79 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:06.296123 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:06.336142 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe221b3d-829b-4dc8-bc44-8ef6010f38ad None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:06.418768 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a7bcce-2828-44ba-89a3-77987cd00ae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:06.419600 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a7bcce-2828-44ba-89a3-77987cd00ae6 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:06.419963 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a7bcce-2828-44ba-89a3-77987cd00ae6 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:06.420279 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a7bcce-2828-44ba-89a3-77987cd00ae6 None admin] PATH_INFO: `/v3/projects/e4f79fa1cc7344d39e95ab1075fe7fb5` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:06.421598 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a7bcce-2828-44ba-89a3-77987cd00ae6 None admin] RBAC: Authorizing `identity:get_project(project_id=e4f79fa1cc7344d39e95ab1075fe7fb5)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:06.423167 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a7bcce-2828-44ba-89a3-77987cd00ae6 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:06.424969 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 50/94] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 31 00:06:05 2022] GET /identity/v3/projects/e4f79fa1cc7344d39e95ab1075fe7fb5 => generated 312 bytes in 460 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:06.428942 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd62db2-6e55-4f69-98d5-afe1b7567837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:06.429606 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd62db2-6e55-4f69-98d5-afe1b7567837 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:06.429886 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd62db2-6e55-4f69-98d5-afe1b7567837 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:06.430156 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd62db2-6e55-4f69-98d5-afe1b7567837 None admin] PATH_INFO: `/v3/projects/24b0845707914a1f9ffa3665e80a3533` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:06.431362 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd62db2-6e55-4f69-98d5-afe1b7567837 None admin] RBAC: Authorizing `identity:get_project(project_id=24b0845707914a1f9ffa3665e80a3533)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:06.433003 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd62db2-6e55-4f69-98d5-afe1b7567837 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:06.435385 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 45/95] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 31 00:06:06 2022] GET /identity/v3/projects/24b0845707914a1f9ffa3665e80a3533 => generated 298 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:06.436482 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a7bcce-2828-44ba-89a3-77987cd00ae6 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:06.442045 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd62db2-6e55-4f69-98d5-afe1b7567837 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:06.725806 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a7bcce-2828-44ba-89a3-77987cd00ae6 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:06.730304 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd62db2-6e55-4f69-98d5-afe1b7567837 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:06.789621 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb6aca9-b900-462a-b6f5-efdb86ea98a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:06.790249 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb6aca9-b900-462a-b6f5-efdb86ea98a2 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:06.790532 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb6aca9-b900-462a-b6f5-efdb86ea98a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:06.790806 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb6aca9-b900-462a-b6f5-efdb86ea98a2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:06.791550 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb6aca9-b900-462a-b6f5-efdb86ea98a2 None admin] RBAC: Adding query filter params (role.id=fdad79ffbcbb4fa380dc9cf7dd108618, scope.project.id=e4f79fa1cc7344d39e95ab1075fe7fb5, user.id=053c6535fa2e4cb595fbd3b2fe32ca43) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:06.791858 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb6aca9-b900-462a-b6f5-efdb86ea98a2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:06.793912 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb6aca9-b900-462a-b6f5-efdb86ea98a2 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:06.801700 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dd1ff6-c04c-4e20-a780-3c0559cef028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:06.802330 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dd1ff6-c04c-4e20-a780-3c0559cef028 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:06.802609 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dd1ff6-c04c-4e20-a780-3c0559cef028 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:06.802883 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dd1ff6-c04c-4e20-a780-3c0559cef028 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:06.803617 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dd1ff6-c04c-4e20-a780-3c0559cef028 None admin] RBAC: Adding query filter params (role.id=12f6817f9aaa4e2bb477095a6bed5d0f, scope.project.id=24b0845707914a1f9ffa3665e80a3533, user.id=11b70534c08c4c45883d75f7a7aeed08) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:06.803928 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dd1ff6-c04c-4e20-a780-3c0559cef028 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:06.805454 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dd1ff6-c04c-4e20-a780-3c0559cef028 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:06.814063 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 51/96] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 31 00:06:06 2022] GET /identity/v3/role_assignments?user.id=053c6535fa2e4cb595fbd3b2fe32ca43&scope.project.id=e4f79fa1cc7344d39e95ab1075fe7fb5&role.id=fdad79ffbcbb4fa380dc9cf7dd108618 => generated 259 bytes in 378 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:06.816260 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 46/97] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 31 00:06:06 2022] GET /identity/v3/role_assignments?user.id=11b70534c08c4c45883d75f7a7aeed08&scope.project.id=24b0845707914a1f9ffa3665e80a3533&role.id=12f6817f9aaa4e2bb477095a6bed5d0f => generated 259 bytes in 375 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:08.546421 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f9d80a-2dee-4644-a60e-1ea4d61b8370 None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:08.547479 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f9d80a-2dee-4644-a60e-1ea4d61b8370 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:08.547963 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f9d80a-2dee-4644-a60e-1ea4d61b8370 None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:08.549875 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 52/98] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 00:06:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:06:08.555410 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d93abb-5f25-4c11-831a-f62b7801d00c None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:08.556400 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d93abb-5f25-4c11-831a-f62b7801d00c None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:08.556873 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d93abb-5f25-4c11-831a-f62b7801d00c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:08.581809 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-f2d93abb-5f25-4c11-831a-f62b7801d00c None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:06:08.583028 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-f2d93abb-5f25-4c11-831a-f62b7801d00c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:06:08.605112 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:08.678959 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 47/99] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 00:06:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:06:08.703130 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602aaa13-5457-441f-8897-789303a7911b None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:08.703780 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602aaa13-5457-441f-8897-789303a7911b None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:08.704292 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602aaa13-5457-441f-8897-789303a7911b None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:08.705904 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 53/100] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 00:06:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:06:08.711761 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd4f996-7fa8-4137-863c-45bf0e7b3b22 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:08.712391 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd4f996-7fa8-4137-863c-45bf0e7b3b22 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:08.712863 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd4f996-7fa8-4137-863c-45bf0e7b3b22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:08.739290 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-5dd4f996-7fa8-4137-863c-45bf0e7b3b22 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:06:08.740885 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-5dd4f996-7fa8-4137-863c-45bf0e7b3b22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:06:08.831952 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 48/101] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 00:06:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 00:06:08.864607 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f67803-15f2-4c01-810a-10f510a8e35c None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:08.865227 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f67803-15f2-4c01-810a-10f510a8e35c None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:08.865696 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f67803-15f2-4c01-810a-10f510a8e35c None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:08.867238 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 54/102] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 00:06:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:06:08.873901 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf607d9d-b62f-4049-8e46-dce15819e56d None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:08.874523 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf607d9d-b62f-4049-8e46-dce15819e56d None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:08.874990 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf607d9d-b62f-4049-8e46-dce15819e56d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:08.893919 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-cf607d9d-b62f-4049-8e46-dce15819e56d None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:06:08.895438 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-cf607d9d-b62f-4049-8e46-dce15819e56d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:06:08.973117 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 49/103] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 00:06:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 00:06:09.071778 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f67803-15f2-4c01-810a-10f510a8e35c None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:09.086309 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:09.184875 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f67803-15f2-4c01-810a-10f510a8e35c None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:09.222111 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b4fe22-e8d3-4a3b-b40f-59b6e7be67b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:09.223087 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b4fe22-e8d3-4a3b-b40f-59b6e7be67b8 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:09.223662 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b4fe22-e8d3-4a3b-b40f-59b6e7be67b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:09.224177 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b4fe22-e8d3-4a3b-b40f-59b6e7be67b8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:09.236172 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b4fe22-e8d3-4a3b-b40f-59b6e7be67b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:06:09.241418 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-76b4fe22-e8d3-4a3b-b40f-59b6e7be67b8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 00:06:09.241418 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:09.241418 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:06:09.241418 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:06:09.241418 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:06:09.241418 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:06:09.241418 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:06:09.241418 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:06:09.241418 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:06:09.241418 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:06:09.241418 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:06:09.241418 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:06:09.241418 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:06:09.241418 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:06:09.241418 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:06:09.241418 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:06:09.242260 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:06:09.242260 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:06:09.242260 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:06:09.242260 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:06:09.242260 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:06:09.242260 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:06:09.242260 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:06:09.242260 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:06:09.242260 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:06:09.242260 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:06:09.242260 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:06:09.242260 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Aug 31 00:06:09.242260 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:06:09.242260 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:06:09.242260 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:06:09.242260 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:06:09.243015 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:06:09.243015 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:06:09.243015 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:06:09.243015 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:06:09.243015 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:06:09.243015 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:06:09.243015 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:06:09.243015 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:06:09.243015 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:06:09.243015 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:06:09.243015 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 00:06:09.243015 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Aug 31 00:06:09.245324 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 55/104] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 31 00:06:09 2022] GET /identity/v3/roles/reader => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:06:09.251904 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf607d9d-b62f-4049-8e46-dce15819e56d None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:09.266595 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:09.285114 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73416cc-fb13-43b4-bfff-82d8bc2b75e9 None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:09.285480 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73416cc-fb13-43b4-bfff-82d8bc2b75e9 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:09.285664 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73416cc-fb13-43b4-bfff-82d8bc2b75e9 None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:09.286998 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 56/105] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 00:06:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:06:09.293222 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85a490e-bd46-4eae-b81f-425df3870739 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:09.294162 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85a490e-bd46-4eae-b81f-425df3870739 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:09.294557 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85a490e-bd46-4eae-b81f-425df3870739 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:09.336999 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-f85a490e-bd46-4eae-b81f-425df3870739 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:06:09.338869 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-f85a490e-bd46-4eae-b81f-425df3870739 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:06:09.432612 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf607d9d-b62f-4049-8e46-dce15819e56d None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:09.475342 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257b9129-b6ff-464e-a876-d65d8b4803b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:09.476554 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257b9129-b6ff-464e-a876-d65d8b4803b5 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:09.476953 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:09.477895 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257b9129-b6ff-464e-a876-d65d8b4803b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:09.478762 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257b9129-b6ff-464e-a876-d65d8b4803b5 None admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:09.479702 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257b9129-b6ff-464e-a876-d65d8b4803b5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:09.480249 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257b9129-b6ff-464e-a876-d65d8b4803b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:09.482324 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257b9129-b6ff-464e-a876-d65d8b4803b5 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:09.483251 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 57/106] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 00:06:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:06:09.484437 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85a490e-bd46-4eae-b81f-425df3870739 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:09.502540 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 50/107] 10.222.0.47 () {56 vars in 1101 bytes} [Wed Aug 31 00:06:09 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:09.503776 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257b9129-b6ff-464e-a876-d65d8b4803b5 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:09.622543 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85a490e-bd46-4eae-b81f-425df3870739 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:09.660873 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c894bd-3cd7-40a9-9cd0-689c55287832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:09.661753 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c894bd-3cd7-40a9-9cd0-689c55287832 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:09.662175 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c894bd-3cd7-40a9-9cd0-689c55287832 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:09.662595 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c894bd-3cd7-40a9-9cd0-689c55287832 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:09.663859 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c894bd-3cd7-40a9-9cd0-689c55287832 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:09.665519 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c894bd-3cd7-40a9-9cd0-689c55287832 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:09.667626 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 58/108] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 00:06:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:09.668648 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c894bd-3cd7-40a9-9cd0-689c55287832 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:09.684616 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:09.745838 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257b9129-b6ff-464e-a876-d65d8b4803b5 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:09.782371 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:09.812941 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddd197d-1892-49b3-b58c-fc2b32075244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:09.813596 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddd197d-1892-49b3-b58c-fc2b32075244 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:09.813876 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddd197d-1892-49b3-b58c-fc2b32075244 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:09.814149 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddd197d-1892-49b3-b58c-fc2b32075244 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:09.835574 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddd197d-1892-49b3-b58c-fc2b32075244 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:06:09.842221 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-0ddd197d-1892-49b3-b58c-fc2b32075244 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 00:06:09.842221 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:09.842221 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:06:09.842221 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:06:09.842221 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:06:09.842221 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:06:09.842221 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:06:09.842221 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:06:09.842221 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:06:09.842221 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:06:09.842221 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:06:09.842221 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:06:09.842221 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:06:09.842221 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:06:09.842221 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:06:09.842221 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:06:09.843166 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:06:09.843166 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:06:09.843166 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:06:09.843166 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:06:09.843166 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:06:09.843166 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:06:09.843166 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:06:09.843166 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:06:09.843166 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:06:09.843166 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:06:09.843166 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:06:09.843166 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 31 00:06:09.843166 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:06:09.843166 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:06:09.843166 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:06:09.843166 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:06:09.843949 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:06:09.843949 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:06:09.843949 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:06:09.843949 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:06:09.843949 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:06:09.843949 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:06:09.843949 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:06:09.843949 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:06:09.843949 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:06:09.843949 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:06:09.843949 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 00:06:09.843949 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 31 00:06:09.843949 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 51/109] 10.222.0.47 () {56 vars in 1114 bytes} [Wed Aug 31 00:06:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 340 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:06:09.845732 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddd197d-1892-49b3-b58c-fc2b32075244 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:09.853005 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c894bd-3cd7-40a9-9cd0-689c55287832 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:09.899676 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e790e5f-5f6f-443b-9da3-04378d75b463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:09.900772 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e790e5f-5f6f-443b-9da3-04378d75b463 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:09.901249 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e790e5f-5f6f-443b-9da3-04378d75b463 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:09.901713 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e790e5f-5f6f-443b-9da3-04378d75b463 None admin] PATH_INFO: `/v3/users/81bab12f67734758a540fedd9d641156` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:09.921657 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e790e5f-5f6f-443b-9da3-04378d75b463 None admin] RBAC: Authorizing `identity:get_user(user_id=81bab12f67734758a540fedd9d641156)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:09.923213 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e790e5f-5f6f-443b-9da3-04378d75b463 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:09.925047 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 59/110] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 31 00:06:09 2022] GET /identity/v3/users/81bab12f67734758a540fedd9d641156 => generated 289 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:09.925880 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e790e5f-5f6f-443b-9da3-04378d75b463 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:09.999193 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddd197d-1892-49b3-b58c-fc2b32075244 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:10.035638 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:10.041783 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6ae4a4-1466-4b5b-9a44-c81c85d2029a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:10.042398 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6ae4a4-1466-4b5b-9a44-c81c85d2029a None admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:10.042676 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6ae4a4-1466-4b5b-9a44-c81c85d2029a None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:10.042949 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6ae4a4-1466-4b5b-9a44-c81c85d2029a None admin] PATH_INFO: `/v3/projects` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:10.044211 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6ae4a4-1466-4b5b-9a44-c81c85d2029a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:10.045728 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6ae4a4-1466-4b5b-9a44-c81c85d2029a None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:10.051643 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e790e5f-5f6f-443b-9da3-04378d75b463 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:10.076088 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 52/111] 10.222.0.47 () {60 vars in 1141 bytes} [Wed Aug 31 00:06:09 2022] POST /identity/v3/projects => generated 302 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:06:10.077349 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6ae4a4-1466-4b5b-9a44-c81c85d2029a None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:10.094496 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:10.108884 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5071b640-2d49-44ed-b4da-ba781f126f2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:10.110133 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5071b640-2d49-44ed-b4da-ba781f126f2a None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:10.111052 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5071b640-2d49-44ed-b4da-ba781f126f2a None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:10.111588 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5071b640-2d49-44ed-b4da-ba781f126f2a None admin] PATH_INFO: `/v3/roles/member` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:10.127111 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5071b640-2d49-44ed-b4da-ba781f126f2a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:06:10.134172 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-5071b640-2d49-44ed-b4da-ba781f126f2a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 00:06:10.134172 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:10.134172 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:06:10.134172 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:06:10.134172 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:06:10.134172 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:06:10.134172 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:06:10.134172 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:06:10.134172 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:06:10.134172 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:06:10.134172 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:06:10.134172 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:06:10.134172 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:06:10.134172 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:06:10.134172 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:06:10.134172 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:06:10.135178 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:06:10.135178 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:06:10.135178 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:06:10.135178 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:06:10.135178 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:06:10.135178 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:06:10.135178 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:06:10.135178 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:06:10.135178 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:06:10.135178 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:06:10.135178 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:06:10.135178 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Aug 31 00:06:10.135178 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:06:10.135178 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:06:10.135178 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:06:10.135178 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:06:10.136008 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:06:10.136008 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:06:10.136008 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:06:10.136008 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:06:10.136008 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:06:10.136008 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:06:10.136008 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:06:10.136008 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:06:10.136008 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:06:10.136008 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:06:10.136008 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 00:06:10.136008 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Aug 31 00:06:10.138804 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 60/112] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 31 00:06:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:06:10.141125 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5071b640-2d49-44ed-b4da-ba781f126f2a None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:10.222990 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6ae4a4-1466-4b5b-9a44-c81c85d2029a None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:10.268260 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e459b4-cf24-4480-aad3-cba6d6a7c340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:10.268892 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e459b4-cf24-4480-aad3-cba6d6a7c340 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:10.269169 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e459b4-cf24-4480-aad3-cba6d6a7c340 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:10.269442 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e459b4-cf24-4480-aad3-cba6d6a7c340 None admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:10.270118 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e459b4-cf24-4480-aad3-cba6d6a7c340 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:10.270418 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e459b4-cf24-4480-aad3-cba6d6a7c340 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:10.271816 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e459b4-cf24-4480-aad3-cba6d6a7c340 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:10.276615 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5071b640-2d49-44ed-b4da-ba781f126f2a None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:10.282896 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 53/113] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 31 00:06:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:10.285107 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d744f25-9354-4821-aabc-df2789e913bd None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:10.286038 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d744f25-9354-4821-aabc-df2789e913bd None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:10.286325 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d744f25-9354-4821-aabc-df2789e913bd None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:10.288026 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 54/114] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 00:06:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:06:10.288872 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d744f25-9354-4821-aabc-df2789e913bd None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:10.316745 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fefc68-da19-403a-8d25-5d2d4fc82983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:10.317374 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fefc68-da19-403a-8d25-5d2d4fc82983 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:10.317655 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fefc68-da19-403a-8d25-5d2d4fc82983 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:10.317931 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fefc68-da19-403a-8d25-5d2d4fc82983 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:10.343756 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:10.378794 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:10.394327 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fefc68-da19-403a-8d25-5d2d4fc82983 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:10.395817 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fefc68-da19-403a-8d25-5d2d4fc82983 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:10.409760 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d744f25-9354-4821-aabc-df2789e913bd None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:10.455025 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5922fff1-12d1-4a15-9c32-ad94efe304f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:10.455652 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5922fff1-12d1-4a15-9c32-ad94efe304f6 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:10.455931 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5922fff1-12d1-4a15-9c32-ad94efe304f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:10.456236 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5922fff1-12d1-4a15-9c32-ad94efe304f6 None admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:10.456918 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5922fff1-12d1-4a15-9c32-ad94efe304f6 None admin] RBAC: Adding query filter params (name=member) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:10.457228 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5922fff1-12d1-4a15-9c32-ad94efe304f6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:10.458645 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5922fff1-12d1-4a15-9c32-ad94efe304f6 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:10.468538 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 55/115] 10.222.0.47 () {56 vars in 1101 bytes} [Wed Aug 31 00:06:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:10.469811 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73f296c-65cd-4403-9e5e-0b702bb70451 None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:10.470100 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73f296c-65cd-4403-9e5e-0b702bb70451 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:10.470379 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73f296c-65cd-4403-9e5e-0b702bb70451 None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:10.471788 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 56/116] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 00:06:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:06:10.473803 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73f296c-65cd-4403-9e5e-0b702bb70451 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:10.520211 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 61/117] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 31 00:06:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 00:06:10.521813 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e3ae8a-c08a-4a67-a3b2-a283a04ac78f None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:10.522101 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e3ae8a-c08a-4a67-a3b2-a283a04ac78f None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:10.522377 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e3ae8a-c08a-4a67-a3b2-a283a04ac78f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:10.542022 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-36e3ae8a-c08a-4a67-a3b2-a283a04ac78f None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:06:10.544040 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-36e3ae8a-c08a-4a67-a3b2-a283a04ac78f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:06:10.596585 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73f296c-65cd-4403-9e5e-0b702bb70451 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:10.607518 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:10.632185 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 62/118] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 00:06:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:06:10.632185 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e3ae8a-c08a-4a67-a3b2-a283a04ac78f None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:10.647704 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7a6e27-bb9a-4691-9efa-cc0dbd5c39b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:10.648547 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7a6e27-bb9a-4691-9efa-cc0dbd5c39b5 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:10.648953 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7a6e27-bb9a-4691-9efa-cc0dbd5c39b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:10.649296 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7a6e27-bb9a-4691-9efa-cc0dbd5c39b5 None admin] PATH_INFO: `/v3/users/053c6535fa2e4cb595fbd3b2fe32ca43` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:10.650596 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7a6e27-bb9a-4691-9efa-cc0dbd5c39b5 None admin] RBAC: Authorizing `identity:get_user(user_id=053c6535fa2e4cb595fbd3b2fe32ca43)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:10.652210 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7a6e27-bb9a-4691-9efa-cc0dbd5c39b5 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:10.654489 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 57/119] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 31 00:06:10 2022] GET /identity/v3/users/053c6535fa2e4cb595fbd3b2fe32ca43 => generated 275 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:10.654951 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:10.655963 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c715c5-99dc-4c12-8ded-0cdbcfb834d1 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:10.656454 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c715c5-99dc-4c12-8ded-0cdbcfb834d1 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:10.656798 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c715c5-99dc-4c12-8ded-0cdbcfb834d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:10.678488 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-c0c715c5-99dc-4c12-8ded-0cdbcfb834d1 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:06:10.680412 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-c0c715c5-99dc-4c12-8ded-0cdbcfb834d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:06:10.766186 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 58/120] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 00:06:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:06:10.768445 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c715c5-99dc-4c12-8ded-0cdbcfb834d1 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:10.785203 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e3ae8a-c08a-4a67-a3b2-a283a04ac78f None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:10.857089 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9b62a7-f007-4ddb-9828-2c39f6cc9683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:10.857841 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9b62a7-f007-4ddb-9828-2c39f6cc9683 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:10.858250 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9b62a7-f007-4ddb-9828-2c39f6cc9683 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:10.858600 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9b62a7-f007-4ddb-9828-2c39f6cc9683 None admin] PATH_INFO: `/v3/users/053c6535fa2e4cb595fbd3b2fe32ca43` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:10.864467 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9b62a7-f007-4ddb-9828-2c39f6cc9683 None admin] RBAC: Authorizing `identity:get_user(user_id=053c6535fa2e4cb595fbd3b2fe32ca43)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:10.866080 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9b62a7-f007-4ddb-9828-2c39f6cc9683 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:10.867809 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 63/121] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 31 00:06:10 2022] GET /identity/v3/users/053c6535fa2e4cb595fbd3b2fe32ca43 => generated 275 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:10.872330 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9b62a7-f007-4ddb-9828-2c39f6cc9683 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:10.901599 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c715c5-99dc-4c12-8ded-0cdbcfb834d1 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:10.920672 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:10.968699 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7cf4de-0f9e-49e7-ac27-5a7f1b9c6ff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:10.970282 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7cf4de-0f9e-49e7-ac27-5a7f1b9c6ff8 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:10.971031 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7cf4de-0f9e-49e7-ac27-5a7f1b9c6ff8 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:10.971520 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7cf4de-0f9e-49e7-ac27-5a7f1b9c6ff8 None admin] PATH_INFO: `/v3/projects/24b0845707914a1f9ffa3665e80a3533` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:10.973597 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7cf4de-0f9e-49e7-ac27-5a7f1b9c6ff8 None admin] RBAC: Authorizing `identity:get_project(project_id=24b0845707914a1f9ffa3665e80a3533)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:10.975816 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7cf4de-0f9e-49e7-ac27-5a7f1b9c6ff8 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:10.978660 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 59/122] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 31 00:06:10 2022] GET /identity/v3/projects/24b0845707914a1f9ffa3665e80a3533 => generated 298 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:10.979803 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7cf4de-0f9e-49e7-ac27-5a7f1b9c6ff8 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:11.010750 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:11.028657 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9b62a7-f007-4ddb-9828-2c39f6cc9683 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:11.068466 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0c2e4e-e781-41fe-b0a2-537d4f97f4b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:11.069192 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0c2e4e-e781-41fe-b0a2-537d4f97f4b5 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:11.069482 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0c2e4e-e781-41fe-b0a2-537d4f97f4b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:11.069762 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0c2e4e-e781-41fe-b0a2-537d4f97f4b5 None admin] PATH_INFO: `/v3/projects/24b0845707914a1f9ffa3665e80a3533` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:11.070904 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0c2e4e-e781-41fe-b0a2-537d4f97f4b5 None admin] RBAC: Authorizing `identity:get_project(project_id=24b0845707914a1f9ffa3665e80a3533)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:11.072417 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0c2e4e-e781-41fe-b0a2-537d4f97f4b5 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:11.074338 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 64/123] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 31 00:06:10 2022] GET /identity/v3/projects/24b0845707914a1f9ffa3665e80a3533 => generated 298 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:11.075461 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0c2e4e-e781-41fe-b0a2-537d4f97f4b5 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:11.120133 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7cf4de-0f9e-49e7-ac27-5a7f1b9c6ff8 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:11.161160 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fa0f12-d957-427d-9a00-d787385e46ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:11.162092 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fa0f12-d957-427d-9a00-d787385e46ee None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:11.162375 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fa0f12-d957-427d-9a00-d787385e46ee None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:11.162656 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fa0f12-d957-427d-9a00-d787385e46ee None admin] PATH_INFO: `/v3/projects/24b0845707914a1f9ffa3665e80a3533` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:11.163806 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fa0f12-d957-427d-9a00-d787385e46ee None admin] RBAC: Authorizing `identity:get_project(project_id=24b0845707914a1f9ffa3665e80a3533)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:11.165309 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fa0f12-d957-427d-9a00-d787385e46ee None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:11.174105 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 60/124] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 31 00:06:10 2022] GET /identity/v3/projects/24b0845707914a1f9ffa3665e80a3533 => generated 298 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:11.174105 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fa0f12-d957-427d-9a00-d787385e46ee None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:11.197158 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0c2e4e-e781-41fe-b0a2-537d4f97f4b5 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:11.220283 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:11.234617 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daa910a-47ac-41d0-87d6-d804eca87757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:11.235307 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daa910a-47ac-41d0-87d6-d804eca87757 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:11.235588 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daa910a-47ac-41d0-87d6-d804eca87757 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:11.235862 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daa910a-47ac-41d0-87d6-d804eca87757 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:11.248896 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8daa910a-47ac-41d0-87d6-d804eca87757 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:06:11.255360 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-8daa910a-47ac-41d0-87d6-d804eca87757 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 00:06:11.255360 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:11.255360 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:06:11.255360 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:06:11.255360 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:06:11.255360 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:06:11.255360 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:06:11.255360 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:06:11.255360 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:06:11.255360 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:06:11.255360 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:06:11.255360 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:06:11.255360 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:06:11.255360 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:06:11.255360 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:06:11.255360 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:06:11.256504 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:06:11.256504 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:06:11.256504 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:06:11.256504 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:06:11.256504 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:06:11.256504 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:06:11.256504 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:06:11.256504 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:06:11.256504 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:06:11.256504 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:06:11.256504 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:06:11.256504 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Aug 31 00:06:11.256504 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:06:11.256504 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:06:11.256504 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:06:11.256504 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:06:11.257315 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:06:11.257315 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:06:11.257315 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:06:11.257315 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:06:11.257315 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:06:11.257315 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:06:11.257315 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:06:11.257315 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:06:11.257315 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:06:11.257315 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:06:11.257315 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 00:06:11.257315 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Aug 31 00:06:11.257315 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 65/125] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 31 00:06:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:06:11.261714 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daa910a-47ac-41d0-87d6-d804eca87757 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:11.277150 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:11.298669 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fa0f12-d957-427d-9a00-d787385e46ee None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:11.336586 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a6e948-fe0b-4776-9d47-ddda75cc9c23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:11.337209 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a6e948-fe0b-4776-9d47-ddda75cc9c23 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:11.337495 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a6e948-fe0b-4776-9d47-ddda75cc9c23 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:11.337773 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a6e948-fe0b-4776-9d47-ddda75cc9c23 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:11.338657 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a6e948-fe0b-4776-9d47-ddda75cc9c23 None admin] RBAC: Adding query filter params (role.id=4d8eb43f443c46d3aaaf3c515e374839, scope.project.id=24b0845707914a1f9ffa3665e80a3533, user.id=81bab12f67734758a540fedd9d641156) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:11.338974 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a6e948-fe0b-4776-9d47-ddda75cc9c23 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:11.341083 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a6e948-fe0b-4776-9d47-ddda75cc9c23 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:11.347241 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 61/126] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 31 00:06:11 2022] GET /identity/v3/role_assignments?user.id=81bab12f67734758a540fedd9d641156&scope.project.id=24b0845707914a1f9ffa3665e80a3533&role.id=4d8eb43f443c46d3aaaf3c515e374839 => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:11.348372 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a6e948-fe0b-4776-9d47-ddda75cc9c23 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:11.381427 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daa910a-47ac-41d0-87d6-d804eca87757 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:11.435403 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d059ee2-4740-4341-b4e0-7d004f4eafa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:11.437425 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d059ee2-4740-4341-b4e0-7d004f4eafa2 None admin] REQUEST_METHOD: `PUT` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:11.438206 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d059ee2-4740-4341-b4e0-7d004f4eafa2 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:11.439049 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d059ee2-4740-4341-b4e0-7d004f4eafa2 None admin] PATH_INFO: `/v3/projects/24b0845707914a1f9ffa3665e80a3533/users/053c6535fa2e4cb595fbd3b2fe32ca43/roles/89f25837440e4981bad54fe74d242232` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:11.443100 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d059ee2-4740-4341-b4e0-7d004f4eafa2 None admin] RBAC: Authorizing `identity:create_grant(project_id=24b0845707914a1f9ffa3665e80a3533, user_id=053c6535fa2e4cb595fbd3b2fe32ca43, role_id=89f25837440e4981bad54fe74d242232)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:11.446111 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d059ee2-4740-4341-b4e0-7d004f4eafa2 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:11.472185 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 66/127] 10.222.0.47 () {58 vars in 1439 bytes} [Wed Aug 31 00:06:11 2022] PUT /identity/v3/projects/24b0845707914a1f9ffa3665e80a3533/users/053c6535fa2e4cb595fbd3b2fe32ca43/roles/89f25837440e4981bad54fe74d242232 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:06:11.472185 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d059ee2-4740-4341-b4e0-7d004f4eafa2 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:11.541551 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a6e948-fe0b-4776-9d47-ddda75cc9c23 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:11.551024 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:11.588462 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d760d8-6743-4d6c-aefa-ab3b84633c71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:11.589126 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d760d8-6743-4d6c-aefa-ab3b84633c71 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:11.589404 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d760d8-6743-4d6c-aefa-ab3b84633c71 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:11.589782 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d760d8-6743-4d6c-aefa-ab3b84633c71 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:11.598361 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:11.603566 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d760d8-6743-4d6c-aefa-ab3b84633c71 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:06:11.609524 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-16d760d8-6743-4d6c-aefa-ab3b84633c71 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:06:11.609524 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:11.609524 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:06:11.609524 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:06:11.609524 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:06:11.609524 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:06:11.609524 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:06:11.609524 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:06:11.609524 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:06:11.609524 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:06:11.609524 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:06:11.609524 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:06:11.609524 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:06:11.609524 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:06:11.609524 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:06:11.609524 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:06:11.610497 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:06:11.610497 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:06:11.610497 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:06:11.610497 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:06:11.610497 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:06:11.610497 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:06:11.610497 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:06:11.610497 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:06:11.610497 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:06:11.610497 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:06:11.610497 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:06:11.610497 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 31 00:06:11.610497 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:06:11.610497 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:06:11.610497 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:06:11.610497 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:06:11.611286 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:06:11.611286 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:06:11.611286 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:06:11.611286 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:06:11.611286 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:06:11.611286 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:06:11.611286 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:06:11.611286 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:06:11.611286 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:06:11.611286 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:06:11.611286 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:06:11.611286 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 31 00:06:11.611286 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 62/128] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Aug 31 00:06:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:06:11.612639 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d760d8-6743-4d6c-aefa-ab3b84633c71 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:11.680184 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d059ee2-4740-4341-b4e0-7d004f4eafa2 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:11.737222 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390f954c-19de-475e-bfa7-29aa74ff4ffb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:11.738583 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390f954c-19de-475e-bfa7-29aa74ff4ffb None admin] REQUEST_METHOD: `PUT` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:11.739078 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390f954c-19de-475e-bfa7-29aa74ff4ffb None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:11.739556 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390f954c-19de-475e-bfa7-29aa74ff4ffb None admin] PATH_INFO: `/v3/projects/24b0845707914a1f9ffa3665e80a3533/users/053c6535fa2e4cb595fbd3b2fe32ca43/roles/fdad79ffbcbb4fa380dc9cf7dd108618` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:11.739848 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d760d8-6743-4d6c-aefa-ab3b84633c71 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:11.743252 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390f954c-19de-475e-bfa7-29aa74ff4ffb None admin] RBAC: Authorizing `identity:create_grant(project_id=24b0845707914a1f9ffa3665e80a3533, user_id=053c6535fa2e4cb595fbd3b2fe32ca43, role_id=fdad79ffbcbb4fa380dc9cf7dd108618)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:11.745178 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390f954c-19de-475e-bfa7-29aa74ff4ffb None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:11.766690 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 67/129] 10.222.0.47 () {58 vars in 1439 bytes} [Wed Aug 31 00:06:11 2022] PUT /identity/v3/projects/24b0845707914a1f9ffa3665e80a3533/users/053c6535fa2e4cb595fbd3b2fe32ca43/roles/fdad79ffbcbb4fa380dc9cf7dd108618 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:06:11.768175 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390f954c-19de-475e-bfa7-29aa74ff4ffb None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:11.799302 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192cf02d-a16f-4282-8493-c503dddb4ba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:11.799995 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192cf02d-a16f-4282-8493-c503dddb4ba9 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:11.800309 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192cf02d-a16f-4282-8493-c503dddb4ba9 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:11.800790 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192cf02d-a16f-4282-8493-c503dddb4ba9 None admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:11.801541 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192cf02d-a16f-4282-8493-c503dddb4ba9 None admin] RBAC: Adding query filter params (name=member) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:11.803789 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192cf02d-a16f-4282-8493-c503dddb4ba9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:11.806142 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192cf02d-a16f-4282-8493-c503dddb4ba9 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:11.826136 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 63/130] 10.222.0.47 () {56 vars in 1101 bytes} [Wed Aug 31 00:06:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:11.834232 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192cf02d-a16f-4282-8493-c503dddb4ba9 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:11.895583 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:11.998242 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390f954c-19de-475e-bfa7-29aa74ff4ffb None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:12.021735 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192cf02d-a16f-4282-8493-c503dddb4ba9 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:12.062726 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:12.073713 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14168d21-b341-4dcb-bae9-391b4a1c4340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:12.075489 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14168d21-b341-4dcb-bae9-391b4a1c4340 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:12.077116 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14168d21-b341-4dcb-bae9-391b4a1c4340 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:12.077544 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14168d21-b341-4dcb-bae9-391b4a1c4340 None admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:12.078395 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14168d21-b341-4dcb-bae9-391b4a1c4340 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:12.078856 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14168d21-b341-4dcb-bae9-391b4a1c4340 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:12.080420 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14168d21-b341-4dcb-bae9-391b4a1c4340 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:12.093532 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 68/131] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 31 00:06:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:12.094937 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6345100d-40ce-4b4b-a4c3-911edc069b65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:12.095775 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6345100d-40ce-4b4b-a4c3-911edc069b65 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:12.096309 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6345100d-40ce-4b4b-a4c3-911edc069b65 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:12.096728 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6345100d-40ce-4b4b-a4c3-911edc069b65 None admin] PATH_INFO: `/v3/users/053c6535fa2e4cb595fbd3b2fe32ca43` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:12.098082 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6345100d-40ce-4b4b-a4c3-911edc069b65 None admin] RBAC: Authorizing `identity:get_user(user_id=053c6535fa2e4cb595fbd3b2fe32ca43)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:12.099900 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14168d21-b341-4dcb-bae9-391b4a1c4340 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:12.100889 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6345100d-40ce-4b4b-a4c3-911edc069b65 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:12.102989 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 64/132] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 31 00:06:11 2022] GET /identity/v3/users/053c6535fa2e4cb595fbd3b2fe32ca43 => generated 275 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:06:12.108960 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6345100d-40ce-4b4b-a4c3-911edc069b65 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:12.279100 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14168d21-b341-4dcb-bae9-391b4a1c4340 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:12.333700 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:12.336027 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ababafb3-7f99-44cf-921c-6df626379191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:12.337658 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ababafb3-7f99-44cf-921c-6df626379191 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:12.337954 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ababafb3-7f99-44cf-921c-6df626379191 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:12.338239 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ababafb3-7f99-44cf-921c-6df626379191 None admin] PATH_INFO: `/v3/users/11b70534c08c4c45883d75f7a7aeed08` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:12.345469 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ababafb3-7f99-44cf-921c-6df626379191 None admin] RBAC: Authorizing `identity:get_user(user_id=11b70534c08c4c45883d75f7a7aeed08)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:12.347380 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ababafb3-7f99-44cf-921c-6df626379191 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:12.349258 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6345100d-40ce-4b4b-a4c3-911edc069b65 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:12.349388 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 69/133] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 31 00:06:12 2022] GET /identity/v3/users/11b70534c08c4c45883d75f7a7aeed08 => generated 247 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:12.354854 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ababafb3-7f99-44cf-921c-6df626379191 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:12.422413 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6826cfe-7ecc-422f-85f3-492a7799954a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:12.424555 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6826cfe-7ecc-422f-85f3-492a7799954a None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:12.424850 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6826cfe-7ecc-422f-85f3-492a7799954a None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:12.425133 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6826cfe-7ecc-422f-85f3-492a7799954a None admin] PATH_INFO: `/v3/projects/e4f79fa1cc7344d39e95ab1075fe7fb5` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:12.431168 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6826cfe-7ecc-422f-85f3-492a7799954a None admin] RBAC: Authorizing `identity:get_project(project_id=e4f79fa1cc7344d39e95ab1075fe7fb5)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:12.432686 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6826cfe-7ecc-422f-85f3-492a7799954a None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:12.441834 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 65/134] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 31 00:06:12 2022] GET /identity/v3/projects/e4f79fa1cc7344d39e95ab1075fe7fb5 => generated 312 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:12.443178 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033cc12f-dce8-4abf-8690-adbb302cf6e2 None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:12.443466 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033cc12f-dce8-4abf-8690-adbb302cf6e2 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:12.443746 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033cc12f-dce8-4abf-8690-adbb302cf6e2 None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:12.449319 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 66/135] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 00:06:12 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:06:12.450681 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033cc12f-dce8-4abf-8690-adbb302cf6e2 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:12.493460 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:12.545699 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ababafb3-7f99-44cf-921c-6df626379191 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:12.609543 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c7d739-3f53-487c-a7de-70ece5d462ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:12.610116 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c7d739-3f53-487c-a7de-70ece5d462ae None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:12.610399 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c7d739-3f53-487c-a7de-70ece5d462ae None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:12.610676 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c7d739-3f53-487c-a7de-70ece5d462ae None admin] PATH_INFO: `/v3/projects/24b0845707914a1f9ffa3665e80a3533` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:12.612945 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c7d739-3f53-487c-a7de-70ece5d462ae None admin] RBAC: Authorizing `identity:get_project(project_id=24b0845707914a1f9ffa3665e80a3533)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:12.614427 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c7d739-3f53-487c-a7de-70ece5d462ae None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:12.628355 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 70/136] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 31 00:06:12 2022] GET /identity/v3/projects/24b0845707914a1f9ffa3665e80a3533 => generated 298 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:12.630765 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209ef45f-f416-49c5-b5a2-e4054364371d None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:12.631240 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209ef45f-f416-49c5-b5a2-e4054364371d None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:12.631562 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209ef45f-f416-49c5-b5a2-e4054364371d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:12.653465 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-209ef45f-f416-49c5-b5a2-e4054364371d None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:06:12.654762 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-209ef45f-f416-49c5-b5a2-e4054364371d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:06:12.663726 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033cc12f-dce8-4abf-8690-adbb302cf6e2 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:12.701524 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0addc20a-f88c-44af-9c67-1eebf684fe55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:12.702205 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0addc20a-f88c-44af-9c67-1eebf684fe55 None admin] REQUEST_METHOD: `PUT` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:12.702490 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0addc20a-f88c-44af-9c67-1eebf684fe55 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:12.702767 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0addc20a-f88c-44af-9c67-1eebf684fe55 None admin] PATH_INFO: `/v3/projects/e4f79fa1cc7344d39e95ab1075fe7fb5/users/053c6535fa2e4cb595fbd3b2fe32ca43/roles/fdad79ffbcbb4fa380dc9cf7dd108618` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:12.704725 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0addc20a-f88c-44af-9c67-1eebf684fe55 None admin] RBAC: Authorizing `identity:create_grant(project_id=e4f79fa1cc7344d39e95ab1075fe7fb5, user_id=053c6535fa2e4cb595fbd3b2fe32ca43, role_id=fdad79ffbcbb4fa380dc9cf7dd108618)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:12.706185 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0addc20a-f88c-44af-9c67-1eebf684fe55 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:12.724651 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 67/137] 10.222.0.47 () {58 vars in 1439 bytes} [Wed Aug 31 00:06:12 2022] PUT /identity/v3/projects/e4f79fa1cc7344d39e95ab1075fe7fb5/users/053c6535fa2e4cb595fbd3b2fe32ca43/roles/fdad79ffbcbb4fa380dc9cf7dd108618 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:06:12.725464 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0addc20a-f88c-44af-9c67-1eebf684fe55 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:12.779654 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:12.782522 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 71/138] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 00:06:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:06:12.900736 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0addc20a-f88c-44af-9c67-1eebf684fe55 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:12.954694 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47ccdae-c024-4c99-a58f-cc5637617b24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:12.955397 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47ccdae-c024-4c99-a58f-cc5637617b24 None admin] REQUEST_METHOD: `PUT` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:12.955687 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47ccdae-c024-4c99-a58f-cc5637617b24 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:12.955968 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47ccdae-c024-4c99-a58f-cc5637617b24 None admin] PATH_INFO: `/v3/projects/24b0845707914a1f9ffa3665e80a3533/users/11b70534c08c4c45883d75f7a7aeed08/roles/12f6817f9aaa4e2bb477095a6bed5d0f` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:12.957944 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47ccdae-c024-4c99-a58f-cc5637617b24 None admin] RBAC: Authorizing `identity:create_grant(project_id=24b0845707914a1f9ffa3665e80a3533, user_id=11b70534c08c4c45883d75f7a7aeed08, role_id=12f6817f9aaa4e2bb477095a6bed5d0f)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:12.959466 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47ccdae-c024-4c99-a58f-cc5637617b24 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:12.980055 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 68/139] 10.222.0.47 () {58 vars in 1439 bytes} [Wed Aug 31 00:06:12 2022] PUT /identity/v3/projects/24b0845707914a1f9ffa3665e80a3533/users/11b70534c08c4c45883d75f7a7aeed08/roles/12f6817f9aaa4e2bb477095a6bed5d0f => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:06:13.145646 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209ef45f-f416-49c5-b5a2-e4054364371d None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:13.227605 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:13.286136 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209ef45f-f416-49c5-b5a2-e4054364371d None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:13.336929 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee046c5-24a1-4b46-a509-2e57cf8403d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:13.337632 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee046c5-24a1-4b46-a509-2e57cf8403d4 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:13.337924 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee046c5-24a1-4b46-a509-2e57cf8403d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:13.338205 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee046c5-24a1-4b46-a509-2e57cf8403d4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:13.341171 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee046c5-24a1-4b46-a509-2e57cf8403d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:13.342672 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee046c5-24a1-4b46-a509-2e57cf8403d4 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:13.344629 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 72/140] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 00:06:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:13.353321 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47ccdae-c024-4c99-a58f-cc5637617b24 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:13.461754 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:13.487260 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47ccdae-c024-4c99-a58f-cc5637617b24 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:13.537331 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b740b6-a120-4a90-8ce8-30348f2be79d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:13.538323 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b740b6-a120-4a90-8ce8-30348f2be79d None admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:13.538822 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b740b6-a120-4a90-8ce8-30348f2be79d None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:13.539309 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b740b6-a120-4a90-8ce8-30348f2be79d None admin] PATH_INFO: `/v3/users` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:13.540225 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b740b6-a120-4a90-8ce8-30348f2be79d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:13.541945 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b740b6-a120-4a90-8ce8-30348f2be79d None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:13.581062 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 69/141] 10.222.0.47 () {60 vars in 1132 bytes} [Wed Aug 31 00:06:13 2022] POST /identity/v3/users => generated 283 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:06:13.774687 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32bb1bc-0073-4d0c-972e-c3f4f18290f6 None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:13.774873 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32bb1bc-0073-4d0c-972e-c3f4f18290f6 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:13.775158 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32bb1bc-0073-4d0c-972e-c3f4f18290f6 None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:13.776704 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 73/142] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 00:06:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:06:13.782615 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7ab25c-0622-4518-aa7c-0699215904ea None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:13.782905 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7ab25c-0622-4518-aa7c-0699215904ea None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:13.783185 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7ab25c-0622-4518-aa7c-0699215904ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:13.803733 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-8c7ab25c-0622-4518-aa7c-0699215904ea None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:06:13.804982 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-8c7ab25c-0622-4518-aa7c-0699215904ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:06:13.898741 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 70/143] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 00:06:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:06:14.257498 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32bb1bc-0073-4d0c-972e-c3f4f18290f6 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:14.364389 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dc748b-c6a4-4741-9aa5-09bc90d4fe45 None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:14.364916 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dc748b-c6a4-4741-9aa5-09bc90d4fe45 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:14.364916 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dc748b-c6a4-4741-9aa5-09bc90d4fe45 None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:14.366453 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 71/144] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 00:06:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 00:06:14.375619 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8fd090-a3e2-4ae4-b726-e6c55bda5869 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:14.375935 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8fd090-a3e2-4ae4-b726-e6c55bda5869 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:14.376187 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8fd090-a3e2-4ae4-b726-e6c55bda5869 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:14.405962 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32bb1bc-0073-4d0c-972e-c3f4f18290f6 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:14.407615 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-ab8fd090-a3e2-4ae4-b726-e6c55bda5869 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:06:14.409102 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-ab8fd090-a3e2-4ae4-b726-e6c55bda5869 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:06:14.459549 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:14.477756 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ad0b72-4eb0-46db-9dd3-f6bf26833905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:14.478422 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ad0b72-4eb0-46db-9dd3-f6bf26833905 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:14.478727 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ad0b72-4eb0-46db-9dd3-f6bf26833905 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:14.478981 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ad0b72-4eb0-46db-9dd3-f6bf26833905 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:14.514176 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:14.522448 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ad0b72-4eb0-46db-9dd3-f6bf26833905 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:06:14.526892 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 72/145] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 00:06:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:06:14.533375 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-27ad0b72-4eb0-46db-9dd3-f6bf26833905 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 00:06:14.533375 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:14.533375 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:06:14.533375 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:06:14.533375 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:06:14.533375 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:06:14.533375 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:06:14.533375 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:06:14.533375 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:06:14.533375 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:06:14.533375 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:06:14.533375 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:06:14.533375 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:06:14.533375 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:06:14.533375 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:06:14.533375 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:06:14.534676 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:06:14.534676 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:06:14.534676 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:06:14.534676 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:06:14.534676 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:06:14.534676 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:06:14.534676 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:06:14.534676 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:06:14.534676 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:06:14.534676 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:06:14.534676 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:06:14.534676 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Aug 31 00:06:14.534676 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:06:14.534676 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:06:14.534676 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:06:14.534676 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:06:14.535508 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:06:14.535508 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:06:14.535508 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:06:14.535508 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:06:14.535508 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:06:14.535508 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:06:14.535508 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:06:14.535508 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:06:14.535508 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:06:14.535508 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:06:14.535508 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 00:06:14.535508 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Aug 31 00:06:14.536108 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 74/146] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 31 00:06:14 2022] GET /identity/v3/roles/reader => generated 84 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:06:14.542631 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8fd090-a3e2-4ae4-b726-e6c55bda5869 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:14.670440 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8fd090-a3e2-4ae4-b726-e6c55bda5869 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:14.715148 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea7e04d-776f-4992-b0e4-37096a5e75d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:14.716002 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea7e04d-776f-4992-b0e4-37096a5e75d4 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:14.716332 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea7e04d-776f-4992-b0e4-37096a5e75d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:14.716668 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea7e04d-776f-4992-b0e4-37096a5e75d4 None admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:14.717395 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea7e04d-776f-4992-b0e4-37096a5e75d4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:14.717774 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea7e04d-776f-4992-b0e4-37096a5e75d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:14.719253 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea7e04d-776f-4992-b0e4-37096a5e75d4 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:14.733984 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 73/147] 10.222.0.47 () {56 vars in 1101 bytes} [Wed Aug 31 00:06:14 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:14.739726 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ad0b72-4eb0-46db-9dd3-f6bf26833905 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:14.814044 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0d9108-67f4-4957-b0e3-51e6ac23daa1 None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:14.814363 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0d9108-67f4-4957-b0e3-51e6ac23daa1 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:14.814528 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0d9108-67f4-4957-b0e3-51e6ac23daa1 None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:14.815868 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 74/148] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 00:06:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:06:14.821533 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fe62af-d92a-4974-8324-f9e7c6185050 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:14.821824 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fe62af-d92a-4974-8324-f9e7c6185050 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:14.822083 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fe62af-d92a-4974-8324-f9e7c6185050 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:14.853219 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-99fe62af-d92a-4974-8324-f9e7c6185050 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:06:14.854443 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-99fe62af-d92a-4974-8324-f9e7c6185050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:06:14.863888 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ad0b72-4eb0-46db-9dd3-f6bf26833905 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:14.925883 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9982d847-3220-4821-8e47-069de6d78333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:14.927013 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9982d847-3220-4821-8e47-069de6d78333 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:14.927509 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9982d847-3220-4821-8e47-069de6d78333 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:14.928013 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9982d847-3220-4821-8e47-069de6d78333 None admin] PATH_INFO: `/v3/users/81bab12f67734758a540fedd9d641156` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:14.933206 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9982d847-3220-4821-8e47-069de6d78333 None admin] RBAC: Authorizing `identity:get_user(user_id=81bab12f67734758a540fedd9d641156)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:14.939330 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9982d847-3220-4821-8e47-069de6d78333 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:14.941221 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 75/149] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 31 00:06:14 2022] GET /identity/v3/users/81bab12f67734758a540fedd9d641156 => generated 289 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:14.946900 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9982d847-3220-4821-8e47-069de6d78333 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:15.000001 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:15.022957 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 75/150] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 00:06:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 00:06:15.058140 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:15.123121 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fe62af-d92a-4974-8324-f9e7c6185050 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:15.126792 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9982d847-3220-4821-8e47-069de6d78333 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:15.189498 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f0e30c-c5ea-4324-aa9e-63cf8f14cc72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:15.190376 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f0e30c-c5ea-4324-aa9e-63cf8f14cc72 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:15.190665 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f0e30c-c5ea-4324-aa9e-63cf8f14cc72 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:15.190944 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f0e30c-c5ea-4324-aa9e-63cf8f14cc72 None admin] PATH_INFO: `/v3/projects/24b0845707914a1f9ffa3665e80a3533` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:15.192564 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f0e30c-c5ea-4324-aa9e-63cf8f14cc72 None admin] RBAC: Authorizing `identity:get_project(project_id=24b0845707914a1f9ffa3665e80a3533)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:15.194698 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f0e30c-c5ea-4324-aa9e-63cf8f14cc72 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:15.196862 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 76/151] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 31 00:06:14 2022] GET /identity/v3/projects/24b0845707914a1f9ffa3665e80a3533 => generated 298 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:15.203705 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f0e30c-c5ea-4324-aa9e-63cf8f14cc72 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:15.378603 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fe62af-d92a-4974-8324-f9e7c6185050 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:15.393685 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f0e30c-c5ea-4324-aa9e-63cf8f14cc72 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:15.437734 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:15.439551 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8969d73b-86c1-427f-8e5d-838438706ebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:15.440242 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8969d73b-86c1-427f-8e5d-838438706ebb None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:15.440527 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8969d73b-86c1-427f-8e5d-838438706ebb None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:15.440801 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8969d73b-86c1-427f-8e5d-838438706ebb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:15.462302 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8969d73b-86c1-427f-8e5d-838438706ebb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:06:15.472896 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-8969d73b-86c1-427f-8e5d-838438706ebb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 00:06:15.472896 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:15.472896 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:06:15.472896 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:06:15.472896 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:06:15.472896 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:06:15.472896 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:06:15.472896 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:06:15.472896 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:06:15.472896 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:06:15.472896 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:06:15.472896 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:06:15.472896 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:06:15.472896 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:06:15.472896 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:06:15.472896 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:06:15.473788 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:06:15.473788 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:06:15.473788 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:06:15.473788 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:06:15.473788 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:06:15.473788 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:06:15.473788 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:06:15.473788 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:06:15.473788 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:06:15.473788 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:06:15.473788 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:06:15.473788 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 31 00:06:15.473788 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:06:15.473788 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:06:15.473788 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:06:15.473788 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:06:15.474560 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:06:15.474560 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:06:15.474560 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:06:15.474560 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:06:15.474560 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:06:15.474560 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:06:15.474560 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:06:15.474560 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:06:15.474560 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:06:15.474560 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:06:15.474560 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 00:06:15.474560 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 31 00:06:15.475153 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84b4cfd-f131-438f-9f9c-90e8996b533d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:15.475153 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84b4cfd-f131-438f-9f9c-90e8996b533d None admin] REQUEST_METHOD: `PUT` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:15.475153 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84b4cfd-f131-438f-9f9c-90e8996b533d None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:15.475367 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 76/152] 10.222.0.47 () {56 vars in 1114 bytes} [Wed Aug 31 00:06:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 352 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:06:15.475468 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84b4cfd-f131-438f-9f9c-90e8996b533d None admin] PATH_INFO: `/v3/projects/24b0845707914a1f9ffa3665e80a3533/users/81bab12f67734758a540fedd9d641156/roles/4d8eb43f443c46d3aaaf3c515e374839` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:15.481632 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84b4cfd-f131-438f-9f9c-90e8996b533d None admin] RBAC: Authorizing `identity:create_grant(project_id=24b0845707914a1f9ffa3665e80a3533, user_id=81bab12f67734758a540fedd9d641156, role_id=4d8eb43f443c46d3aaaf3c515e374839)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:15.483140 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84b4cfd-f131-438f-9f9c-90e8996b533d None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:15.487547 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8969d73b-86c1-427f-8e5d-838438706ebb None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:15.505072 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 77/153] 10.222.0.47 () {58 vars in 1439 bytes} [Wed Aug 31 00:06:15 2022] PUT /identity/v3/projects/24b0845707914a1f9ffa3665e80a3533/users/81bab12f67734758a540fedd9d641156/roles/4d8eb43f443c46d3aaaf3c515e374839 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:06:15.569254 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:15.627551 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8969d73b-86c1-427f-8e5d-838438706ebb None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:15.666846 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c3b9da-3dc3-4a97-b5f2-3f6f22cfa512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:15.667479 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c3b9da-3dc3-4a97-b5f2-3f6f22cfa512 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:15.667763 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c3b9da-3dc3-4a97-b5f2-3f6f22cfa512 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:15.668123 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c3b9da-3dc3-4a97-b5f2-3f6f22cfa512 None admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:15.669493 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c3b9da-3dc3-4a97-b5f2-3f6f22cfa512 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:15.669798 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c3b9da-3dc3-4a97-b5f2-3f6f22cfa512 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:15.671319 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c3b9da-3dc3-4a97-b5f2-3f6f22cfa512 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:15.680623 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 77/154] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 31 00:06:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:06:15.687231 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84b4cfd-f131-438f-9f9c-90e8996b533d None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:15.759996 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c3b9da-3dc3-4a97-b5f2-3f6f22cfa512 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:15.844800 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84b4cfd-f131-438f-9f9c-90e8996b533d None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:15.899758 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135383a4-ee19-450d-ab3a-945163cdbc77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:15.900434 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135383a4-ee19-450d-ab3a-945163cdbc77 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:15.900719 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135383a4-ee19-450d-ab3a-945163cdbc77 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:15.901169 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135383a4-ee19-450d-ab3a-945163cdbc77 None admin] PATH_INFO: `/v3/users/053c6535fa2e4cb595fbd3b2fe32ca43` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:15.904981 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135383a4-ee19-450d-ab3a-945163cdbc77 None admin] RBAC: Authorizing `identity:get_user(user_id=053c6535fa2e4cb595fbd3b2fe32ca43)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:15.907402 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135383a4-ee19-450d-ab3a-945163cdbc77 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:15.909493 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 78/155] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 31 00:06:15 2022] GET /identity/v3/users/053c6535fa2e4cb595fbd3b2fe32ca43 => generated 275 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:15.915774 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135383a4-ee19-450d-ab3a-945163cdbc77 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:15.973047 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c3b9da-3dc3-4a97-b5f2-3f6f22cfa512 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:15.999598 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:16.041895 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dae5a8-9f7a-4379-9adc-7ad0084a2d3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:16.042571 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dae5a8-9f7a-4379-9adc-7ad0084a2d3c None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:16.042847 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dae5a8-9f7a-4379-9adc-7ad0084a2d3c None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:16.043152 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dae5a8-9f7a-4379-9adc-7ad0084a2d3c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:16.052925 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:16.061931 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dae5a8-9f7a-4379-9adc-7ad0084a2d3c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:06:16.068373 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-f4dae5a8-9f7a-4379-9adc-7ad0084a2d3c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 00:06:16.068373 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:16.068373 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:06:16.068373 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:06:16.068373 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:06:16.068373 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:06:16.068373 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:06:16.068373 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:06:16.068373 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:06:16.068373 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:06:16.068373 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:06:16.068373 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:06:16.068373 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:06:16.068373 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:06:16.068373 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:06:16.068373 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:06:16.069514 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:06:16.069514 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:06:16.069514 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:06:16.069514 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:06:16.069514 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:06:16.069514 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:06:16.069514 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:06:16.069514 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:06:16.069514 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:06:16.069514 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:06:16.069514 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:06:16.069514 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 31 00:06:16.069514 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:06:16.069514 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:06:16.069514 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:06:16.069514 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:06:16.070368 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:06:16.070368 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:06:16.070368 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:06:16.070368 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:06:16.070368 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:06:16.070368 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:06:16.070368 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:06:16.070368 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:06:16.070368 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:06:16.070368 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:06:16.070368 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 00:06:16.070368 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 31 00:06:16.070368 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 78/156] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 31 00:06:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:06:16.071006 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1549bd5-dea1-4e73-8c3e-e403c86fe283 None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:16.071006 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1549bd5-dea1-4e73-8c3e-e403c86fe283 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:16.071638 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1549bd5-dea1-4e73-8c3e-e403c86fe283 None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:16.072523 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 79/157] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 00:06:16 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:06:16.078769 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b700644d-ad0b-49d6-b2fe-8237b8db059d None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:16.079031 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b700644d-ad0b-49d6-b2fe-8237b8db059d None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:16.079305 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b700644d-ad0b-49d6-b2fe-8237b8db059d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:16.099446 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-b700644d-ad0b-49d6-b2fe-8237b8db059d None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:06:16.100678 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-b700644d-ad0b-49d6-b2fe-8237b8db059d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:06:16.157972 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135383a4-ee19-450d-ab3a-945163cdbc77 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:16.190074 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 80/158] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 00:06:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:06:16.190962 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b700644d-ad0b-49d6-b2fe-8237b8db059d None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:16.237458 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ee08e5-691a-49a5-bc40-ee081ac0788c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:16.238010 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ee08e5-691a-49a5-bc40-ee081ac0788c None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:16.238306 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ee08e5-691a-49a5-bc40-ee081ac0788c None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:16.238571 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ee08e5-691a-49a5-bc40-ee081ac0788c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:16.301459 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b700644d-ad0b-49d6-b2fe-8237b8db059d None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:16.303972 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:16.355398 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f40468-90eb-4a6a-8e59-c078c9c598c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:16.357131 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f40468-90eb-4a6a-8e59-c078c9c598c9 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:16.357410 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f40468-90eb-4a6a-8e59-c078c9c598c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:16.357854 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f40468-90eb-4a6a-8e59-c078c9c598c9 None admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:16.358633 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f40468-90eb-4a6a-8e59-c078c9c598c9 None admin] RBAC: Adding query filter params (name=member) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:16.358940 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f40468-90eb-4a6a-8e59-c078c9c598c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:16.359039 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ee08e5-691a-49a5-bc40-ee081ac0788c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:16.360393 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f40468-90eb-4a6a-8e59-c078c9c598c9 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:16.360534 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ee08e5-691a-49a5-bc40-ee081ac0788c None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:16.370983 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 81/159] 10.222.0.47 () {56 vars in 1101 bytes} [Wed Aug 31 00:06:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:16.379569 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f40468-90eb-4a6a-8e59-c078c9c598c9 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:16.475676 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:16.573873 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f40468-90eb-4a6a-8e59-c078c9c598c9 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:16.603045 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 79/160] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 31 00:06:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 688 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 31 00:06:16.629873 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ee08e5-691a-49a5-bc40-ee081ac0788c None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:16.635167 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f21852f-1aad-4720-9ed5-bc0cc97c3f2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:16.635896 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f21852f-1aad-4720-9ed5-bc0cc97c3f2a None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:16.636199 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f21852f-1aad-4720-9ed5-bc0cc97c3f2a None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:16.636477 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f21852f-1aad-4720-9ed5-bc0cc97c3f2a None admin] PATH_INFO: `/v3/users/053c6535fa2e4cb595fbd3b2fe32ca43` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:16.641925 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f21852f-1aad-4720-9ed5-bc0cc97c3f2a None admin] RBAC: Authorizing `identity:get_user(user_id=053c6535fa2e4cb595fbd3b2fe32ca43)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:16.644578 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f21852f-1aad-4720-9ed5-bc0cc97c3f2a None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:16.647434 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 82/161] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 31 00:06:16 2022] GET /identity/v3/users/053c6535fa2e4cb595fbd3b2fe32ca43 => generated 275 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:06:16.655382 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f21852f-1aad-4720-9ed5-bc0cc97c3f2a None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:16.723951 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:16.869824 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f21852f-1aad-4720-9ed5-bc0cc97c3f2a None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:16.880089 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ee08e5-691a-49a5-bc40-ee081ac0788c None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:16.963697 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889eaa46-e5a1-4e9e-b79f-ce79eb2f6c40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:16.964711 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889eaa46-e5a1-4e9e-b79f-ce79eb2f6c40 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:16.965231 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889eaa46-e5a1-4e9e-b79f-ce79eb2f6c40 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:16.966637 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889eaa46-e5a1-4e9e-b79f-ce79eb2f6c40 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:16.968045 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fa6856-7b58-454c-bf28-b2ef98f9fce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:16.968918 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fa6856-7b58-454c-bf28-b2ef98f9fce6 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:16.969326 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fa6856-7b58-454c-bf28-b2ef98f9fce6 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:16.969724 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fa6856-7b58-454c-bf28-b2ef98f9fce6 None admin] PATH_INFO: `/v3/projects/24b0845707914a1f9ffa3665e80a3533` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:16.976982 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fa6856-7b58-454c-bf28-b2ef98f9fce6 None admin] RBAC: Authorizing `identity:get_project(project_id=24b0845707914a1f9ffa3665e80a3533)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:16.978746 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fa6856-7b58-454c-bf28-b2ef98f9fce6 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:16.987266 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 80/162] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 31 00:06:16 2022] GET /identity/v3/projects/24b0845707914a1f9ffa3665e80a3533 => generated 298 bytes in 358 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:16.988316 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fa6856-7b58-454c-bf28-b2ef98f9fce6 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:17.041463 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:17.146987 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889eaa46-e5a1-4e9e-b79f-ce79eb2f6c40 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:17.148828 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889eaa46-e5a1-4e9e-b79f-ce79eb2f6c40 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:17.239175 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:17.266481 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fa6856-7b58-454c-bf28-b2ef98f9fce6 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:17.333066 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ce9dfc-3118-4087-ae4b-0c10c02cb22b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:17.334231 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ce9dfc-3118-4087-ae4b-0c10c02cb22b None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:17.334732 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ce9dfc-3118-4087-ae4b-0c10c02cb22b None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:17.335312 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ce9dfc-3118-4087-ae4b-0c10c02cb22b None admin] PATH_INFO: `/v3/roles/member` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:17.357512 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 83/163] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 31 00:06:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 703 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 31 00:06:17.358599 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889eaa46-e5a1-4e9e-b79f-ce79eb2f6c40 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:17.359265 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ce9dfc-3118-4087-ae4b-0c10c02cb22b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:06:17.367568 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-b0ce9dfc-3118-4087-ae4b-0c10c02cb22b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 00:06:17.367568 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:17.367568 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:06:17.367568 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:06:17.367568 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:06:17.367568 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:06:17.367568 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:06:17.367568 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:06:17.367568 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:06:17.367568 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:06:17.367568 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:06:17.367568 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:06:17.367568 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:06:17.367568 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:06:17.367568 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:06:17.367568 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:06:17.368551 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:06:17.368551 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:06:17.368551 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:06:17.368551 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:06:17.368551 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:06:17.368551 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:06:17.368551 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:06:17.368551 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:06:17.368551 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:06:17.368551 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:06:17.368551 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:06:17.368551 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Aug 31 00:06:17.368551 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:06:17.368551 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:06:17.368551 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:06:17.368551 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:06:17.369769 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:06:17.369769 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:06:17.369769 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:06:17.369769 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:06:17.369769 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:06:17.369769 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:06:17.369769 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:06:17.369769 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:06:17.369769 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:06:17.369769 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:06:17.369769 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 00:06:17.369769 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Aug 31 00:06:17.369769 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 81/164] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 31 00:06:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 381 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:06:17.369769 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ce9dfc-3118-4087-ae4b-0c10c02cb22b None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:17.506549 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:17.545941 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ce9dfc-3118-4087-ae4b-0c10c02cb22b None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:17.576236 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889eaa46-e5a1-4e9e-b79f-ce79eb2f6c40 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:17.618058 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b447285-3a4d-4c7d-ae50-37dbe673a084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:17.618711 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b447285-3a4d-4c7d-ae50-37dbe673a084 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:17.618987 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b447285-3a4d-4c7d-ae50-37dbe673a084 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:17.619257 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b447285-3a4d-4c7d-ae50-37dbe673a084 None admin] PATH_INFO: `/v3/projects/24b0845707914a1f9ffa3665e80a3533` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:17.620572 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b447285-3a4d-4c7d-ae50-37dbe673a084 None admin] RBAC: Authorizing `identity:get_project(project_id=24b0845707914a1f9ffa3665e80a3533)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:17.622224 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b447285-3a4d-4c7d-ae50-37dbe673a084 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:17.624285 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 82/165] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 31 00:06:17 2022] GET /identity/v3/projects/24b0845707914a1f9ffa3665e80a3533 => generated 298 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:17.625675 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b447285-3a4d-4c7d-ae50-37dbe673a084 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:17.659541 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d999cd-0814-4115-990c-38dbf786f23a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:17.660484 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d999cd-0814-4115-990c-38dbf786f23a None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:17.660901 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d999cd-0814-4115-990c-38dbf786f23a None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:17.661307 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d999cd-0814-4115-990c-38dbf786f23a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:17.662202 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d999cd-0814-4115-990c-38dbf786f23a None admin] RBAC: Adding query filter params (role.id=89f25837440e4981bad54fe74d242232, scope.project.id=24b0845707914a1f9ffa3665e80a3533, user.id=053c6535fa2e4cb595fbd3b2fe32ca43) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:17.662743 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d999cd-0814-4115-990c-38dbf786f23a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:17.664386 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d999cd-0814-4115-990c-38dbf786f23a None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:17.669137 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:17.678345 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 84/166] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 31 00:06:17 2022] GET /identity/v3/role_assignments?user.id=053c6535fa2e4cb595fbd3b2fe32ca43&scope.project.id=24b0845707914a1f9ffa3665e80a3533&role.id=89f25837440e4981bad54fe74d242232 => generated 608 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:17.679833 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824bb9a6-3a55-4d6b-93ae-893834badcac None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:17.680308 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824bb9a6-3a55-4d6b-93ae-893834badcac None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:17.680722 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824bb9a6-3a55-4d6b-93ae-893834badcac None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:17.682344 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 85/167] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 00:06:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:06:17.683213 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824bb9a6-3a55-4d6b-93ae-893834badcac None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:17.800798 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b447285-3a4d-4c7d-ae50-37dbe673a084 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:17.863841 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a80675-b44f-4abf-87d8-a7665f31630f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:17.864495 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a80675-b44f-4abf-87d8-a7665f31630f None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:17.864769 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a80675-b44f-4abf-87d8-a7665f31630f None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:17.865039 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a80675-b44f-4abf-87d8-a7665f31630f None admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:17.865708 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a80675-b44f-4abf-87d8-a7665f31630f None admin] RBAC: Adding query filter params (name=member) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:17.866006 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a80675-b44f-4abf-87d8-a7665f31630f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:17.867404 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a80675-b44f-4abf-87d8-a7665f31630f None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:17.895175 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 83/168] 10.222.0.47 () {56 vars in 1101 bytes} [Wed Aug 31 00:06:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:17.896507 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde017f4-45c5-453c-a8db-f42562a3fe3c None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:17.896780 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde017f4-45c5-453c-a8db-f42562a3fe3c None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:17.897055 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde017f4-45c5-453c-a8db-f42562a3fe3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:17.919854 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824bb9a6-3a55-4d6b-93ae-893834badcac None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:17.946669 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-cde017f4-45c5-453c-a8db-f42562a3fe3c None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:06:17.947859 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-cde017f4-45c5-453c-a8db-f42562a3fe3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:06:17.956485 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:18.001674 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720f2589-bc30-44ba-a9f6-216958073af9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:18.003528 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720f2589-bc30-44ba-a9f6-216958073af9 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:18.003950 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720f2589-bc30-44ba-a9f6-216958073af9 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:18.004439 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720f2589-bc30-44ba-a9f6-216958073af9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:18.005335 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720f2589-bc30-44ba-a9f6-216958073af9 None admin] RBAC: Adding query filter params (role.id=fdad79ffbcbb4fa380dc9cf7dd108618, scope.project.id=24b0845707914a1f9ffa3665e80a3533, user.id=053c6535fa2e4cb595fbd3b2fe32ca43) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:18.005782 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720f2589-bc30-44ba-a9f6-216958073af9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:18.007392 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720f2589-bc30-44ba-a9f6-216958073af9 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:18.026332 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 86/169] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 31 00:06:17 2022] GET /identity/v3/role_assignments?user.id=053c6535fa2e4cb595fbd3b2fe32ca43&scope.project.id=24b0845707914a1f9ffa3665e80a3533&role.id=fdad79ffbcbb4fa380dc9cf7dd108618 => generated 608 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:18.027651 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720f2589-bc30-44ba-a9f6-216958073af9 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:18.110115 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 84/170] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 00:06:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:06:18.116322 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae759e53-a31a-4cf6-9dae-6b6367159e06 None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:18.116791 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae759e53-a31a-4cf6-9dae-6b6367159e06 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:18.117246 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae759e53-a31a-4cf6-9dae-6b6367159e06 None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:18.118772 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 85/171] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 00:06:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:06:18.124769 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae04dd9-f605-4798-93cf-c68b7c41814f None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:18.125289 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae04dd9-f605-4798-93cf-c68b7c41814f None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:18.125698 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae04dd9-f605-4798-93cf-c68b7c41814f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:18.159644 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-bae04dd9-f605-4798-93cf-c68b7c41814f None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:06:18.162095 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-bae04dd9-f605-4798-93cf-c68b7c41814f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:06:18.171193 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:18.275110 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720f2589-bc30-44ba-a9f6-216958073af9 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:18.276222 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 86/172] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 00:06:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:06:18.338046 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207cf9dc-6134-422e-876d-2b05dffbb76d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:18.338710 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207cf9dc-6134-422e-876d-2b05dffbb76d None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:18.338990 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207cf9dc-6134-422e-876d-2b05dffbb76d None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:18.339266 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207cf9dc-6134-422e-876d-2b05dffbb76d None admin] PATH_INFO: `/v3/users/053c6535fa2e4cb595fbd3b2fe32ca43` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:18.340996 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207cf9dc-6134-422e-876d-2b05dffbb76d None admin] RBAC: Authorizing `identity:get_user(user_id=053c6535fa2e4cb595fbd3b2fe32ca43)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:18.342471 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207cf9dc-6134-422e-876d-2b05dffbb76d None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:18.344083 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 87/173] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 31 00:06:18 2022] GET /identity/v3/users/053c6535fa2e4cb595fbd3b2fe32ca43 => generated 275 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:18.350068 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae04dd9-f605-4798-93cf-c68b7c41814f None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:18.456088 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:18.506056 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae04dd9-f605-4798-93cf-c68b7c41814f None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:18.522972 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207cf9dc-6134-422e-876d-2b05dffbb76d None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:18.577648 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da2b0ff-43e4-49f9-aa49-cb8fe65832f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:18.578315 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da2b0ff-43e4-49f9-aa49-cb8fe65832f1 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:18.578579 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da2b0ff-43e4-49f9-aa49-cb8fe65832f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:18.578828 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da2b0ff-43e4-49f9-aa49-cb8fe65832f1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:18.719636 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207cf9dc-6134-422e-876d-2b05dffbb76d None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:18.722122 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da2b0ff-43e4-49f9-aa49-cb8fe65832f1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:18.723643 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da2b0ff-43e4-49f9-aa49-cb8fe65832f1 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:18.764612 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:18.774991 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db41adbd-7e1f-4063-8e54-edcaf0150693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:18.775655 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db41adbd-7e1f-4063-8e54-edcaf0150693 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:18.776355 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db41adbd-7e1f-4063-8e54-edcaf0150693 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:18.776644 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db41adbd-7e1f-4063-8e54-edcaf0150693 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:18.790914 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db41adbd-7e1f-4063-8e54-edcaf0150693 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:06:18.797316 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-db41adbd-7e1f-4063-8e54-edcaf0150693 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:06:18.797316 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:18.797316 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:06:18.797316 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:06:18.797316 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:06:18.797316 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:06:18.797316 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:06:18.797316 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:06:18.797316 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:06:18.797316 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:06:18.797316 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:06:18.797316 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:06:18.797316 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:06:18.797316 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:06:18.797316 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:06:18.797316 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:06:18.798250 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:06:18.798250 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:06:18.798250 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:06:18.798250 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:06:18.798250 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:06:18.798250 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:06:18.798250 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:06:18.798250 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:06:18.798250 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:06:18.798250 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:06:18.798250 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:06:18.798250 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 31 00:06:18.798250 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:06:18.798250 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:06:18.798250 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:06:18.798250 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:06:18.799055 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:06:18.799055 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:06:18.799055 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:06:18.799055 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:06:18.799055 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:06:18.799055 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:06:18.799055 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:06:18.799055 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:06:18.799055 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:06:18.799055 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:06:18.799055 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:06:18.799055 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 31 00:06:18.805668 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 88/174] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Aug 31 00:06:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:06:18.806912 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db41adbd-7e1f-4063-8e54-edcaf0150693 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:18.857778 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:18.929573 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 87/175] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 31 00:06:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 580 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 00:06:18.930792 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da2b0ff-43e4-49f9-aa49-cb8fe65832f1 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:18.939708 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db41adbd-7e1f-4063-8e54-edcaf0150693 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:18.983310 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6771d059-0ba1-45c5-a92e-1c52e6bf01ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:18.984188 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6771d059-0ba1-45c5-a92e-1c52e6bf01ac None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:18.984711 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6771d059-0ba1-45c5-a92e-1c52e6bf01ac None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:18.985118 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6771d059-0ba1-45c5-a92e-1c52e6bf01ac None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:18.997554 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6771d059-0ba1-45c5-a92e-1c52e6bf01ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:06:19.004282 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-6771d059-0ba1-45c5-a92e-1c52e6bf01ac None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:06:19.004282 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:19.004282 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:06:19.004282 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:06:19.004282 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:06:19.004282 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:06:19.004282 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:06:19.004282 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:06:19.004282 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:06:19.004282 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:06:19.004282 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:06:19.004282 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:06:19.004282 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:06:19.004282 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:06:19.004282 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:06:19.004282 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:06:19.005202 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:06:19.005202 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:06:19.005202 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:06:19.005202 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:06:19.005202 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:06:19.005202 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:06:19.005202 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:06:19.005202 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:06:19.005202 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:06:19.005202 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:06:19.005202 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:06:19.005202 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 31 00:06:19.005202 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:06:19.005202 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:06:19.005202 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:06:19.005202 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:06:19.006000 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:06:19.006000 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:06:19.006000 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:06:19.006000 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:06:19.006000 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:06:19.006000 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:06:19.006000 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:06:19.006000 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:06:19.006000 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:06:19.006000 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:06:19.006000 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:06:19.006000 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 31 00:06:19.008676 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 89/176] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Aug 31 00:06:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:06:19.009772 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6771d059-0ba1-45c5-a92e-1c52e6bf01ac None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:19.073874 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:19.082847 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da2b0ff-43e4-49f9-aa49-cb8fe65832f1 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:19.132753 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd41c7e3-9e00-4ef5-b478-98ac703c4d2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:19.134240 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd41c7e3-9e00-4ef5-b478-98ac703c4d2f None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:19.134717 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd41c7e3-9e00-4ef5-b478-98ac703c4d2f None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:19.135276 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd41c7e3-9e00-4ef5-b478-98ac703c4d2f None admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:19.136325 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd41c7e3-9e00-4ef5-b478-98ac703c4d2f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:19.138088 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd41c7e3-9e00-4ef5-b478-98ac703c4d2f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:19.139880 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd41c7e3-9e00-4ef5-b478-98ac703c4d2f None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:19.140485 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6771d059-0ba1-45c5-a92e-1c52e6bf01ac None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:19.151420 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 88/177] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 31 00:06:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:19.153942 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d1eb7f-a1aa-4d09-91d8-84745464edce None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:19.154397 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d1eb7f-a1aa-4d09-91d8-84745464edce None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:19.154838 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d1eb7f-a1aa-4d09-91d8-84745464edce None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:19.156573 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 89/178] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 00:06:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:06:19.162863 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d1eb7f-a1aa-4d09-91d8-84745464edce None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:19.187244 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9126d09-c1bc-444b-af6e-4f14c5f4517e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:19.188343 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9126d09-c1bc-444b-af6e-4f14c5f4517e None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:19.188879 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9126d09-c1bc-444b-af6e-4f14c5f4517e None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:19.189296 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9126d09-c1bc-444b-af6e-4f14c5f4517e None admin] PATH_INFO: `/v3/projects/e4f79fa1cc7344d39e95ab1075fe7fb5` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:19.190664 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9126d09-c1bc-444b-af6e-4f14c5f4517e None admin] RBAC: Authorizing `identity:get_project(project_id=e4f79fa1cc7344d39e95ab1075fe7fb5)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:19.192626 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9126d09-c1bc-444b-af6e-4f14c5f4517e None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:19.194870 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 90/179] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 31 00:06:19 2022] GET /identity/v3/projects/e4f79fa1cc7344d39e95ab1075fe7fb5 => generated 312 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:19.195960 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9126d09-c1bc-444b-af6e-4f14c5f4517e None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:19.209852 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:19.300017 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d1eb7f-a1aa-4d09-91d8-84745464edce None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:19.314647 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9126d09-c1bc-444b-af6e-4f14c5f4517e None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:19.332547 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:19.336092 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1256d27-4d9d-4661-8ca4-eeac408c0631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:19.336756 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1256d27-4d9d-4661-8ca4-eeac408c0631 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:19.337037 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1256d27-4d9d-4661-8ca4-eeac408c0631 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:19.337311 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1256d27-4d9d-4661-8ca4-eeac408c0631 None admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:19.337984 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1256d27-4d9d-4661-8ca4-eeac408c0631 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:19.338288 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1256d27-4d9d-4661-8ca4-eeac408c0631 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:19.339667 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1256d27-4d9d-4661-8ca4-eeac408c0631 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:19.348399 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 90/180] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 31 00:06:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:19.349617 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a574798f-7c90-421c-a7e9-7eb6a030f9f2 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:19.349897 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a574798f-7c90-421c-a7e9-7eb6a030f9f2 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:19.350171 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a574798f-7c90-421c-a7e9-7eb6a030f9f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:19.354652 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a726232b-cb49-4f1a-8235-c34fbdf1a6a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:19.355292 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a726232b-cb49-4f1a-8235-c34fbdf1a6a3 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:19.356484 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a726232b-cb49-4f1a-8235-c34fbdf1a6a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:19.356840 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a726232b-cb49-4f1a-8235-c34fbdf1a6a3 None admin] PATH_INFO: `/v3/users/11b70534c08c4c45883d75f7a7aeed08` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:19.358840 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a726232b-cb49-4f1a-8235-c34fbdf1a6a3 None admin] RBAC: Authorizing `identity:get_user(user_id=11b70534c08c4c45883d75f7a7aeed08)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:19.359481 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a726232b-cb49-4f1a-8235-c34fbdf1a6a3 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:19.366554 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 91/181] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 31 00:06:19 2022] GET /identity/v3/users/11b70534c08c4c45883d75f7a7aeed08 => generated 247 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:19.366554 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a726232b-cb49-4f1a-8235-c34fbdf1a6a3 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:19.375683 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-a574798f-7c90-421c-a7e9-7eb6a030f9f2 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:06:19.376923 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-a574798f-7c90-421c-a7e9-7eb6a030f9f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:06:19.449624 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 91/182] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 00:06:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:06:19.450909 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f6322f-4b20-409a-9510-6d744c33dd77 None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:19.451197 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f6322f-4b20-409a-9510-6d744c33dd77 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:19.451475 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f6322f-4b20-409a-9510-6d744c33dd77 None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:19.452804 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 92/183] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 00:06:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:06:19.453888 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73ea5bb-b302-4535-8efd-16eac2d34e98 None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:19.454134 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73ea5bb-b302-4535-8efd-16eac2d34e98 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:19.454407 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73ea5bb-b302-4535-8efd-16eac2d34e98 None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:19.456219 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 93/184] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 00:06:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:06:19.459485 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73ea5bb-b302-4535-8efd-16eac2d34e98 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:19.479892 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a726232b-cb49-4f1a-8235-c34fbdf1a6a3 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:19.498021 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:19.521718 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e391c7-c153-475b-b790-8ecd8ffd6b23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:19.522341 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e391c7-c153-475b-b790-8ecd8ffd6b23 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:19.522620 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e391c7-c153-475b-b790-8ecd8ffd6b23 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:19.522898 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e391c7-c153-475b-b790-8ecd8ffd6b23 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:19.523630 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e391c7-c153-475b-b790-8ecd8ffd6b23 None admin] RBAC: Adding query filter params (role.id=fdad79ffbcbb4fa380dc9cf7dd108618, scope.project.id=e4f79fa1cc7344d39e95ab1075fe7fb5, user.id=053c6535fa2e4cb595fbd3b2fe32ca43) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:19.523937 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e391c7-c153-475b-b790-8ecd8ffd6b23 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:19.525462 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e391c7-c153-475b-b790-8ecd8ffd6b23 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:19.533049 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 92/185] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 31 00:06:19 2022] GET /identity/v3/role_assignments?user.id=053c6535fa2e4cb595fbd3b2fe32ca43&scope.project.id=e4f79fa1cc7344d39e95ab1075fe7fb5&role.id=fdad79ffbcbb4fa380dc9cf7dd108618 => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:19.534053 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e391c7-c153-475b-b790-8ecd8ffd6b23 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:19.604908 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:19.611948 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73ea5bb-b302-4535-8efd-16eac2d34e98 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:19.672124 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e25fe86-d49d-405b-9fe1-ec9a2348820f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:19.673148 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e25fe86-d49d-405b-9fe1-ec9a2348820f None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:19.673615 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e25fe86-d49d-405b-9fe1-ec9a2348820f None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:19.673719 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e391c7-c153-475b-b790-8ecd8ffd6b23 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:19.674177 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e25fe86-d49d-405b-9fe1-ec9a2348820f None admin] PATH_INFO: `/v3/users/489c773cda004ed793f4e3e9a81c23bf` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:19.697038 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e25fe86-d49d-405b-9fe1-ec9a2348820f None admin] RBAC: Authorizing `identity:get_user(user_id=489c773cda004ed793f4e3e9a81c23bf)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:19.700063 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e25fe86-d49d-405b-9fe1-ec9a2348820f None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:19.703370 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 94/186] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 31 00:06:19 2022] GET /identity/v3/users/489c773cda004ed793f4e3e9a81c23bf => generated 283 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:19.705286 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d246be6-c5a5-4c70-92cb-18d9539b0c71 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:19.705815 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d246be6-c5a5-4c70-92cb-18d9539b0c71 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:19.706337 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d246be6-c5a5-4c70-92cb-18d9539b0c71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:19.721468 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef82e86-d25b-42f8-a662-2da0eb1c1902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:19.722106 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef82e86-d25b-42f8-a662-2da0eb1c1902 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:19.722379 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef82e86-d25b-42f8-a662-2da0eb1c1902 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:19.722656 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef82e86-d25b-42f8-a662-2da0eb1c1902 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:19.733366 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-9d246be6-c5a5-4c70-92cb-18d9539b0c71 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:06:19.734578 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-9d246be6-c5a5-4c70-92cb-18d9539b0c71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:06:19.833989 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 95/187] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 00:06:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:06:19.835256 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0285d6-5538-4d86-a305-55a981e84c85 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:19.835375 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef82e86-d25b-42f8-a662-2da0eb1c1902 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:19.835603 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0285d6-5538-4d86-a305-55a981e84c85 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:19.835959 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0285d6-5538-4d86-a305-55a981e84c85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:19.837557 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef82e86-d25b-42f8-a662-2da0eb1c1902 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:19.862040 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-1b0285d6-5538-4d86-a305-55a981e84c85 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:06:19.863903 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-1b0285d6-5538-4d86-a305-55a981e84c85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:06:19.876878 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:19.898972 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:19.973371 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 96/188] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 00:06:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:06:19.973371 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0285d6-5538-4d86-a305-55a981e84c85 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:19.973624 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 93/189] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 31 00:06:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 00:06:19.973699 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef82e86-d25b-42f8-a662-2da0eb1c1902 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:20.096382 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef82e86-d25b-42f8-a662-2da0eb1c1902 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:20.102717 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0285d6-5538-4d86-a305-55a981e84c85 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:20.134041 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfdb6f5-1e73-4112-a27d-85b375605945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:20.134605 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfdb6f5-1e73-4112-a27d-85b375605945 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:20.134878 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfdb6f5-1e73-4112-a27d-85b375605945 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:20.135148 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfdb6f5-1e73-4112-a27d-85b375605945 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:20.141745 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c077e9-c989-4af8-bb92-c562d3e58de4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:20.142367 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c077e9-c989-4af8-bb92-c562d3e58de4 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:20.142643 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c077e9-c989-4af8-bb92-c562d3e58de4 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:20.142915 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c077e9-c989-4af8-bb92-c562d3e58de4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:20.147710 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfdb6f5-1e73-4112-a27d-85b375605945 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:06:20.153418 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-6dfdb6f5-1e73-4112-a27d-85b375605945 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 00:06:20.153418 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:20.153418 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:06:20.153418 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:06:20.153418 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:06:20.153418 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:06:20.153418 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:06:20.153418 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:06:20.153418 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:06:20.153418 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:06:20.153418 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:06:20.153418 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:06:20.153418 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:06:20.153418 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:06:20.153418 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:06:20.153418 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:06:20.154414 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:06:20.154414 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:06:20.154414 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:06:20.154414 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:06:20.154414 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:06:20.154414 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:06:20.154414 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:06:20.154414 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:06:20.154414 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:06:20.154414 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:06:20.154414 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:06:20.154414 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 31 00:06:20.154414 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:06:20.154414 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:06:20.154414 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:06:20.154414 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:06:20.155219 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:06:20.155219 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:06:20.155219 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:06:20.155219 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:06:20.155219 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:06:20.155219 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:06:20.155219 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:06:20.155219 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:06:20.155219 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:06:20.155219 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:06:20.155219 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 00:06:20.155219 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 31 00:06:20.155219 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 94/190] 10.222.0.47 () {56 vars in 1114 bytes} [Wed Aug 31 00:06:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:06:20.157688 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfdb6f5-1e73-4112-a27d-85b375605945 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:20.157817 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:20.176413 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:20.223571 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c077e9-c989-4af8-bb92-c562d3e58de4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:20.225218 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c077e9-c989-4af8-bb92-c562d3e58de4 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:20.280762 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfdb6f5-1e73-4112-a27d-85b375605945 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:20.329357 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c05e63-727b-4b14-b50a-26a6239525e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:20.329993 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c05e63-727b-4b14-b50a-26a6239525e6 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:20.330268 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c05e63-727b-4b14-b50a-26a6239525e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:20.330538 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c05e63-727b-4b14-b50a-26a6239525e6 None admin] PATH_INFO: `/v3/projects/24b0845707914a1f9ffa3665e80a3533` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:20.331101 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 97/191] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 31 00:06:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 00:06:20.331938 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c077e9-c989-4af8-bb92-c562d3e58de4 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:20.332241 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c05e63-727b-4b14-b50a-26a6239525e6 None admin] RBAC: Authorizing `identity:get_project(project_id=24b0845707914a1f9ffa3665e80a3533)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:20.333865 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c05e63-727b-4b14-b50a-26a6239525e6 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:20.336635 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 95/192] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 31 00:06:20 2022] GET /identity/v3/projects/24b0845707914a1f9ffa3665e80a3533 => generated 298 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:20.337449 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c05e63-727b-4b14-b50a-26a6239525e6 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:20.378061 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:20.423242 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:20.443936 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c077e9-c989-4af8-bb92-c562d3e58de4 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:20.451219 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c05e63-727b-4b14-b50a-26a6239525e6 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:20.482118 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac839dd-4531-49ac-949e-9e4d81fc4b5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:20.482757 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac839dd-4531-49ac-949e-9e4d81fc4b5f None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:20.483028 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac839dd-4531-49ac-949e-9e4d81fc4b5f None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:20.483301 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac839dd-4531-49ac-949e-9e4d81fc4b5f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:20.489435 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fe73ac-40fb-4ced-ade9-071c2244a5c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:20.490063 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fe73ac-40fb-4ced-ade9-071c2244a5c4 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:20.490336 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fe73ac-40fb-4ced-ade9-071c2244a5c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:20.490612 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fe73ac-40fb-4ced-ade9-071c2244a5c4 None admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:20.491290 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fe73ac-40fb-4ced-ade9-071c2244a5c4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:20.491588 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fe73ac-40fb-4ced-ade9-071c2244a5c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:20.493040 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fe73ac-40fb-4ced-ade9-071c2244a5c4 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:20.494663 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac839dd-4531-49ac-949e-9e4d81fc4b5f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:06:20.500326 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-4ac839dd-4531-49ac-949e-9e4d81fc4b5f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 00:06:20.500326 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:20.500326 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:06:20.500326 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:06:20.500326 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:06:20.500326 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:06:20.500326 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:06:20.500326 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:06:20.500326 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:06:20.500326 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:06:20.500326 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:06:20.500326 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:06:20.500326 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:06:20.500326 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:06:20.500326 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:06:20.500326 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:06:20.501848 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:06:20.501848 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:06:20.501848 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:06:20.501848 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:06:20.501848 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:06:20.501848 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:06:20.501848 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:06:20.501848 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:06:20.501848 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:06:20.501848 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:06:20.501848 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:06:20.501848 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Aug 31 00:06:20.501848 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:06:20.501848 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:06:20.501848 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:06:20.501848 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:06:20.511920 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:06:20.511920 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:06:20.511920 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:06:20.511920 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:06:20.511920 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:06:20.511920 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:06:20.511920 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:06:20.511920 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:06:20.511920 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:06:20.511920 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:06:20.511920 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 00:06:20.511920 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Aug 31 00:06:20.511920 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 98/193] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 31 00:06:20 2022] GET /identity/v3/roles/reader => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:06:20.511920 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac839dd-4531-49ac-949e-9e4d81fc4b5f None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:20.514219 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 96/194] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 31 00:06:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:20.514219 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fe73ac-40fb-4ced-ade9-071c2244a5c4 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:20.613013 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac839dd-4531-49ac-949e-9e4d81fc4b5f None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:20.614896 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:20.625745 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fe73ac-40fb-4ced-ade9-071c2244a5c4 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:20.651623 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754753db-66ff-4333-9a25-c6fed2993cc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:20.652301 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754753db-66ff-4333-9a25-c6fed2993cc9 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:20.652589 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754753db-66ff-4333-9a25-c6fed2993cc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:20.652866 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754753db-66ff-4333-9a25-c6fed2993cc9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:20.654013 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754753db-66ff-4333-9a25-c6fed2993cc9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:20.655500 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754753db-66ff-4333-9a25-c6fed2993cc9 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:20.657124 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 99/195] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 00:06:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:20.657982 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754753db-66ff-4333-9a25-c6fed2993cc9 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:20.665170 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5e1fa3-561b-4f7f-9ac4-1da9a1d36209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:20.665822 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5e1fa3-561b-4f7f-9ac4-1da9a1d36209 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:20.666096 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5e1fa3-561b-4f7f-9ac4-1da9a1d36209 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:20.666364 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5e1fa3-561b-4f7f-9ac4-1da9a1d36209 None admin] PATH_INFO: `/v3/projects/f605ca29af4949a5a9696ac63a2a2ffc` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:20.667496 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5e1fa3-561b-4f7f-9ac4-1da9a1d36209 None admin] RBAC: Authorizing `identity:get_project(project_id=f605ca29af4949a5a9696ac63a2a2ffc)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:20.669099 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5e1fa3-561b-4f7f-9ac4-1da9a1d36209 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:20.670765 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 97/196] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 31 00:06:20 2022] GET /identity/v3/projects/f605ca29af4949a5a9696ac63a2a2ffc => generated 302 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:20.671541 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5e1fa3-561b-4f7f-9ac4-1da9a1d36209 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:20.682854 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:20.773813 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754753db-66ff-4333-9a25-c6fed2993cc9 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:20.776084 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5e1fa3-561b-4f7f-9ac4-1da9a1d36209 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:20.812300 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efee35f-45b3-4501-87a0-1da83cf08ab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:20.812940 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efee35f-45b3-4501-87a0-1da83cf08ab8 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:20.813214 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efee35f-45b3-4501-87a0-1da83cf08ab8 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:20.813474 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efee35f-45b3-4501-87a0-1da83cf08ab8 None admin] PATH_INFO: `/v3/users/489c773cda004ed793f4e3e9a81c23bf` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:20.814643 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efee35f-45b3-4501-87a0-1da83cf08ab8 None admin] RBAC: Authorizing `identity:get_user(user_id=489c773cda004ed793f4e3e9a81c23bf)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:20.816119 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efee35f-45b3-4501-87a0-1da83cf08ab8 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:20.817750 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 98/197] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 31 00:06:20 2022] GET /identity/v3/users/489c773cda004ed793f4e3e9a81c23bf => generated 283 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:20.818529 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efee35f-45b3-4501-87a0-1da83cf08ab8 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:20.823870 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b3eb28-2679-4886-8bf2-13a1897e23fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:20.824551 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b3eb28-2679-4886-8bf2-13a1897e23fd None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:20.824827 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b3eb28-2679-4886-8bf2-13a1897e23fd None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:20.825102 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b3eb28-2679-4886-8bf2-13a1897e23fd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:20.825841 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b3eb28-2679-4886-8bf2-13a1897e23fd None admin] RBAC: Adding query filter params (role.id=12f6817f9aaa4e2bb477095a6bed5d0f, scope.project.id=24b0845707914a1f9ffa3665e80a3533, user.id=11b70534c08c4c45883d75f7a7aeed08) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:20.826144 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b3eb28-2679-4886-8bf2-13a1897e23fd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:20.827600 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b3eb28-2679-4886-8bf2-13a1897e23fd None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:20.833755 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 100/198] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 31 00:06:20 2022] GET /identity/v3/role_assignments?user.id=11b70534c08c4c45883d75f7a7aeed08&scope.project.id=24b0845707914a1f9ffa3665e80a3533&role.id=12f6817f9aaa4e2bb477095a6bed5d0f => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:20.834557 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b3eb28-2679-4886-8bf2-13a1897e23fd None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:20.876428 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:20.925626 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:20.968253 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efee35f-45b3-4501-87a0-1da83cf08ab8 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:20.987676 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b3eb28-2679-4886-8bf2-13a1897e23fd None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:21.025154 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bae2e98-f6d5-4cd0-b5a3-620e3a300517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:21.025798 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bae2e98-f6d5-4cd0-b5a3-620e3a300517 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:21.026076 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bae2e98-f6d5-4cd0-b5a3-620e3a300517 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:21.026348 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bae2e98-f6d5-4cd0-b5a3-620e3a300517 None admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:21.027040 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bae2e98-f6d5-4cd0-b5a3-620e3a300517 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:21.027340 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bae2e98-f6d5-4cd0-b5a3-620e3a300517 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:21.028974 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bae2e98-f6d5-4cd0-b5a3-620e3a300517 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:21.040873 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 99/199] 10.222.0.47 () {56 vars in 1101 bytes} [Wed Aug 31 00:06:20 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:21.041829 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bae2e98-f6d5-4cd0-b5a3-620e3a300517 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:21.049197 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fb5c3d-6e98-4e0d-a1bc-67f302db989e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:21.050242 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fb5c3d-6e98-4e0d-a1bc-67f302db989e None admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:21.050710 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fb5c3d-6e98-4e0d-a1bc-67f302db989e None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:21.051177 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fb5c3d-6e98-4e0d-a1bc-67f302db989e None admin] PATH_INFO: `/v3/users` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:21.053269 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fb5c3d-6e98-4e0d-a1bc-67f302db989e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:21.055795 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fb5c3d-6e98-4e0d-a1bc-67f302db989e None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:21.086782 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 101/200] 10.222.0.47 () {60 vars in 1132 bytes} [Wed Aug 31 00:06:20 2022] POST /identity/v3/users => generated 297 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:06:21.088300 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fb5c3d-6e98-4e0d-a1bc-67f302db989e None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:21.186740 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bae2e98-f6d5-4cd0-b5a3-620e3a300517 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:21.227002 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca160937-5452-4cc0-ac8e-3f5cce7cc1e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:21.227990 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca160937-5452-4cc0-ac8e-3f5cce7cc1e4 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:21.228499 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca160937-5452-4cc0-ac8e-3f5cce7cc1e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:21.229082 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca160937-5452-4cc0-ac8e-3f5cce7cc1e4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:21.230050 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca160937-5452-4cc0-ac8e-3f5cce7cc1e4 None admin] RBAC: Adding query filter params (role.id=12f6817f9aaa4e2bb477095a6bed5d0f, scope.project.id=f605ca29af4949a5a9696ac63a2a2ffc, user.id=489c773cda004ed793f4e3e9a81c23bf) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:21.231262 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca160937-5452-4cc0-ac8e-3f5cce7cc1e4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:21.233274 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca160937-5452-4cc0-ac8e-3f5cce7cc1e4 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:21.239857 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 100/201] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 31 00:06:21 2022] GET /identity/v3/role_assignments?user.id=489c773cda004ed793f4e3e9a81c23bf&scope.project.id=f605ca29af4949a5a9696ac63a2a2ffc&role.id=12f6817f9aaa4e2bb477095a6bed5d0f => generated 259 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:21.248614 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:21.250266 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca160937-5452-4cc0-ac8e-3f5cce7cc1e4 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:21.255917 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:21.273545 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fb5c3d-6e98-4e0d-a1bc-67f302db989e None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:21.337375 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769498fe-6cc2-4f72-9524-e23739c2f6d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:21.339302 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769498fe-6cc2-4f72-9524-e23739c2f6d7 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:21.339790 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769498fe-6cc2-4f72-9524-e23739c2f6d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:21.340828 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769498fe-6cc2-4f72-9524-e23739c2f6d7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:21.394053 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca160937-5452-4cc0-ac8e-3f5cce7cc1e4 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:21.437222 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769498fe-6cc2-4f72-9524-e23739c2f6d7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:21.438850 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769498fe-6cc2-4f72-9524-e23739c2f6d7 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:21.442384 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d17985-a669-433d-8c05-560a041ce09c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:21.443035 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d17985-a669-433d-8c05-560a041ce09c None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:21.443600 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d17985-a669-433d-8c05-560a041ce09c None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:21.443876 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d17985-a669-433d-8c05-560a041ce09c None admin] PATH_INFO: `/v3/users/81bab12f67734758a540fedd9d641156` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:21.445212 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d17985-a669-433d-8c05-560a041ce09c None admin] RBAC: Authorizing `identity:get_user(user_id=81bab12f67734758a540fedd9d641156)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:21.446676 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d17985-a669-433d-8c05-560a041ce09c None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:21.448498 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 101/202] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 31 00:06:21 2022] GET /identity/v3/users/81bab12f67734758a540fedd9d641156 => generated 289 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:21.455469 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d17985-a669-433d-8c05-560a041ce09c None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:21.569368 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:21.586684 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:21.605134 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 102/203] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 31 00:06:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 518 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 00:06:21.612498 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769498fe-6cc2-4f72-9524-e23739c2f6d7 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:21.615509 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d17985-a669-433d-8c05-560a041ce09c None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:21.682492 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d04b10-1853-4a52-a7ce-6927ccc1a1d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:21.684350 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d04b10-1853-4a52-a7ce-6927ccc1a1d7 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:21.685020 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d04b10-1853-4a52-a7ce-6927ccc1a1d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:21.685612 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d04b10-1853-4a52-a7ce-6927ccc1a1d7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:21.725675 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769498fe-6cc2-4f72-9524-e23739c2f6d7 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:21.766481 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963085e0-b57d-474d-aa7b-3f87b7442bb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:21.767570 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963085e0-b57d-474d-aa7b-3f87b7442bb6 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:21.767992 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963085e0-b57d-474d-aa7b-3f87b7442bb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:21.768468 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963085e0-b57d-474d-aa7b-3f87b7442bb6 None admin] PATH_INFO: `/v3/projects/f605ca29af4949a5a9696ac63a2a2ffc` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:21.769780 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963085e0-b57d-474d-aa7b-3f87b7442bb6 None admin] RBAC: Authorizing `identity:get_project(project_id=f605ca29af4949a5a9696ac63a2a2ffc)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:21.771506 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963085e0-b57d-474d-aa7b-3f87b7442bb6 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:21.773763 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 103/204] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 31 00:06:21 2022] GET /identity/v3/projects/f605ca29af4949a5a9696ac63a2a2ffc => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:06:21.785132 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963085e0-b57d-474d-aa7b-3f87b7442bb6 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:21.820372 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d04b10-1853-4a52-a7ce-6927ccc1a1d7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:21.821961 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d04b10-1853-4a52-a7ce-6927ccc1a1d7 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:21.886005 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:21.947057 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:21.977856 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963085e0-b57d-474d-aa7b-3f87b7442bb6 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:22.001159 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 102/205] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 31 00:06:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 546 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 31 00:06:22.007836 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d04b10-1853-4a52-a7ce-6927ccc1a1d7 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:22.047495 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ceab09-fd03-4c8c-9a99-8f43eff3a9ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:22.048605 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ceab09-fd03-4c8c-9a99-8f43eff3a9ca None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:22.049088 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ceab09-fd03-4c8c-9a99-8f43eff3a9ca None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:22.049582 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ceab09-fd03-4c8c-9a99-8f43eff3a9ca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:22.050528 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ceab09-fd03-4c8c-9a99-8f43eff3a9ca None admin] RBAC: Adding query filter params (role.id=89f25837440e4981bad54fe74d242232, scope.project.id=f605ca29af4949a5a9696ac63a2a2ffc, user.id=489c773cda004ed793f4e3e9a81c23bf) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:22.051040 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ceab09-fd03-4c8c-9a99-8f43eff3a9ca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:22.052742 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ceab09-fd03-4c8c-9a99-8f43eff3a9ca None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:22.059098 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 104/206] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 31 00:06:21 2022] GET /identity/v3/role_assignments?user.id=489c773cda004ed793f4e3e9a81c23bf&scope.project.id=f605ca29af4949a5a9696ac63a2a2ffc&role.id=89f25837440e4981bad54fe74d242232 => generated 259 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:06:22.234510 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d04b10-1853-4a52-a7ce-6927ccc1a1d7 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:22.281427 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c0c451-18a8-4b2d-b9f9-e888ee4f436b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:22.282073 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c0c451-18a8-4b2d-b9f9-e888ee4f436b None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:22.282347 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c0c451-18a8-4b2d-b9f9-e888ee4f436b None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:22.282610 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c0c451-18a8-4b2d-b9f9-e888ee4f436b None admin] PATH_INFO: `/v3/projects/24b0845707914a1f9ffa3665e80a3533` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:22.283757 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c0c451-18a8-4b2d-b9f9-e888ee4f436b None admin] RBAC: Authorizing `identity:get_project(project_id=24b0845707914a1f9ffa3665e80a3533)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:22.285547 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c0c451-18a8-4b2d-b9f9-e888ee4f436b None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:22.287190 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 103/207] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 31 00:06:22 2022] GET /identity/v3/projects/24b0845707914a1f9ffa3665e80a3533 => generated 298 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:22.294303 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ceab09-fd03-4c8c-9a99-8f43eff3a9ca None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:22.512808 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ceab09-fd03-4c8c-9a99-8f43eff3a9ca None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:22.563208 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:22.594116 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d99c0d5-e364-4850-808f-da14c85696aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:22.595142 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d99c0d5-e364-4850-808f-da14c85696aa None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:22.595621 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d99c0d5-e364-4850-808f-da14c85696aa None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:22.596096 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d99c0d5-e364-4850-808f-da14c85696aa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:22.597496 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d99c0d5-e364-4850-808f-da14c85696aa None admin] RBAC: Adding query filter params (role.id=4d8eb43f443c46d3aaaf3c515e374839, scope.project.id=24b0845707914a1f9ffa3665e80a3533, user.id=81bab12f67734758a540fedd9d641156) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:22.598035 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d99c0d5-e364-4850-808f-da14c85696aa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:22.600786 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d99c0d5-e364-4850-808f-da14c85696aa None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:22.616789 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 105/208] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 31 00:06:22 2022] GET /identity/v3/role_assignments?user.id=81bab12f67734758a540fedd9d641156&scope.project.id=24b0845707914a1f9ffa3665e80a3533&role.id=4d8eb43f443c46d3aaaf3c515e374839 => generated 608 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:24.227460 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab17f90-bb08-4f48-b793-b600f1b4886b None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:24.227975 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab17f90-bb08-4f48-b793-b600f1b4886b None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:24.228420 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab17f90-bb08-4f48-b793-b600f1b4886b None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:24.232187 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 104/209] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 00:06:24 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:06:24.241045 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8d98fd-84e7-4cac-b16d-6c16f64f159b None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:24.242414 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8d98fd-84e7-4cac-b16d-6c16f64f159b None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:24.243157 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8d98fd-84e7-4cac-b16d-6c16f64f159b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:24.274894 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-9d8d98fd-84e7-4cac-b16d-6c16f64f159b None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:06:24.277262 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-9d8d98fd-84e7-4cac-b16d-6c16f64f159b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:06:24.326780 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4393d8c2-ff43-472d-8361-0dbdafc1175d None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:24.327256 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4393d8c2-ff43-472d-8361-0dbdafc1175d None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:24.327696 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4393d8c2-ff43-472d-8361-0dbdafc1175d None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:24.335631 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 105/210] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 00:06:24 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:06:24.339072 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10bc3ec-f912-4723-ae1f-571ae8311383 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:24.339515 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10bc3ec-f912-4723-ae1f-571ae8311383 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:24.340966 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10bc3ec-f912-4723-ae1f-571ae8311383 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:24.368247 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-a10bc3ec-f912-4723-ae1f-571ae8311383 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:06:24.369460 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-a10bc3ec-f912-4723-ae1f-571ae8311383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:06:24.381560 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 106/211] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 00:06:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 00:06:24.382805 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6c1b67-9d4e-43a8-9060-a9901cf43d57 None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:24.383088 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6c1b67-9d4e-43a8-9060-a9901cf43d57 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:24.383420 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6c1b67-9d4e-43a8-9060-a9901cf43d57 None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:24.384915 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 107/212] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 00:06:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:06:24.391183 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd7a8e3-edab-44f5-a3ff-20d47ed90572 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:24.391474 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd7a8e3-edab-44f5-a3ff-20d47ed90572 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:24.391784 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd7a8e3-edab-44f5-a3ff-20d47ed90572 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:24.412489 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-1dd7a8e3-edab-44f5-a3ff-20d47ed90572 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:06:24.414044 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-1dd7a8e3-edab-44f5-a3ff-20d47ed90572 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:06:24.415919 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:24.477955 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 106/213] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 00:06:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 00:06:24.507090 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 108/214] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 00:06:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:06:24.618642 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dea0ff-9571-42af-b230-c9a68242a024 None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:24.618968 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dea0ff-9571-42af-b230-c9a68242a024 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:24.619192 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dea0ff-9571-42af-b230-c9a68242a024 None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:24.620595 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 107/215] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 00:06:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:06:24.626845 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfd9f7a-93fc-4ec3-a8f5-509f9b554da7 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:24.627131 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfd9f7a-93fc-4ec3-a8f5-509f9b554da7 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:24.627413 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfd9f7a-93fc-4ec3-a8f5-509f9b554da7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:24.646956 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-8dfd9f7a-93fc-4ec3-a8f5-509f9b554da7 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:06:24.648182 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-8dfd9f7a-93fc-4ec3-a8f5-509f9b554da7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:06:24.673192 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dea0ff-9571-42af-b230-c9a68242a024 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:24.703920 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:24.738600 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 109/216] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 00:06:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:06:24.753572 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfd9f7a-93fc-4ec3-a8f5-509f9b554da7 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:24.792293 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dea0ff-9571-42af-b230-c9a68242a024 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:24.829004 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd69551-95bd-4707-8340-a85e65145f02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:24.830038 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd69551-95bd-4707-8340-a85e65145f02 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:24.830253 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd69551-95bd-4707-8340-a85e65145f02 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:24.830528 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd69551-95bd-4707-8340-a85e65145f02 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:24.844209 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd69551-95bd-4707-8340-a85e65145f02 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:06:24.849250 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-0cd69551-95bd-4707-8340-a85e65145f02 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:06:24.849250 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:24.849250 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:06:24.849250 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:06:24.849250 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:06:24.849250 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:06:24.849250 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:06:24.849250 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:06:24.849250 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:06:24.849250 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:06:24.849250 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:06:24.849250 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:06:24.849250 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:06:24.849250 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:06:24.849250 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:06:24.849250 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:06:24.850177 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:06:24.850177 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:06:24.850177 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:06:24.850177 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:06:24.850177 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:06:24.850177 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:06:24.850177 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:06:24.850177 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:06:24.850177 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:06:24.850177 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:06:24.850177 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:06:24.850177 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 31 00:06:24.850177 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:06:24.850177 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:06:24.850177 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:06:24.850177 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:06:24.851004 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:06:24.851004 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:06:24.851004 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:06:24.851004 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:06:24.851004 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:06:24.851004 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:06:24.851004 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:06:24.851004 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:06:24.851004 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:06:24.851004 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:06:24.851004 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:06:24.851004 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 31 00:06:24.851004 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 108/217] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Aug 31 00:06:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:06:24.851673 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd69551-95bd-4707-8340-a85e65145f02 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:24.873943 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfd9f7a-93fc-4ec3-a8f5-509f9b554da7 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:24.885941 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:24.918806 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4863077-aeae-4e85-b290-3a19631b1557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:24.919480 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4863077-aeae-4e85-b290-3a19631b1557 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:24.919801 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4863077-aeae-4e85-b290-3a19631b1557 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:24.920077 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4863077-aeae-4e85-b290-3a19631b1557 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:24.921278 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4863077-aeae-4e85-b290-3a19631b1557 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:24.922791 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4863077-aeae-4e85-b290-3a19631b1557 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:24.924527 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 110/218] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 00:06:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:24.925389 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4863077-aeae-4e85-b290-3a19631b1557 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:24.969853 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd69551-95bd-4707-8340-a85e65145f02 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:24.977025 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:25.010798 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9055c32a-37c1-413f-8690-5ae922ac872d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:25.011465 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9055c32a-37c1-413f-8690-5ae922ac872d None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:25.011768 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9055c32a-37c1-413f-8690-5ae922ac872d None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:25.012039 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9055c32a-37c1-413f-8690-5ae922ac872d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:25.025299 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9055c32a-37c1-413f-8690-5ae922ac872d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:06:25.031253 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-9055c32a-37c1-413f-8690-5ae922ac872d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 00:06:25.031253 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:25.031253 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:06:25.031253 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:06:25.031253 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:06:25.031253 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:06:25.031253 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:06:25.031253 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:06:25.031253 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:06:25.031253 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:06:25.031253 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:06:25.031253 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:06:25.031253 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:06:25.031253 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:06:25.031253 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:06:25.031253 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:06:25.032417 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:06:25.032417 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:06:25.032417 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:06:25.032417 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:06:25.032417 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:06:25.032417 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:06:25.032417 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:06:25.032417 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:06:25.032417 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:06:25.032417 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:06:25.032417 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:06:25.032417 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 31 00:06:25.032417 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:06:25.032417 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:06:25.032417 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:06:25.032417 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:06:25.033529 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:06:25.033529 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:06:25.033529 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:06:25.033529 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:06:25.033529 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:06:25.033529 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:06:25.033529 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:06:25.033529 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:06:25.033529 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:06:25.033529 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:06:25.033529 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 00:06:25.033529 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 31 00:06:25.033529 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 109/219] 10.222.0.47 () {56 vars in 1114 bytes} [Wed Aug 31 00:06:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:06:25.033529 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9055c32a-37c1-413f-8690-5ae922ac872d None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:25.058124 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4863077-aeae-4e85-b290-3a19631b1557 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:25.094280 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7216fa-44e7-4a3e-a9fb-178264e83f32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:25.094900 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7216fa-44e7-4a3e-a9fb-178264e83f32 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:25.095182 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7216fa-44e7-4a3e-a9fb-178264e83f32 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:25.095456 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7216fa-44e7-4a3e-a9fb-178264e83f32 None admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:25.096130 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7216fa-44e7-4a3e-a9fb-178264e83f32 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:25.096548 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7216fa-44e7-4a3e-a9fb-178264e83f32 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:25.097944 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7216fa-44e7-4a3e-a9fb-178264e83f32 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:25.107297 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 111/220] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 31 00:06:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:25.108128 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7216fa-44e7-4a3e-a9fb-178264e83f32 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:25.133501 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:25.146543 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9055c32a-37c1-413f-8690-5ae922ac872d None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:25.190441 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60b944d-ef14-4279-994c-6cda04c2ce2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:25.191341 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60b944d-ef14-4279-994c-6cda04c2ce2d None admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:25.191670 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60b944d-ef14-4279-994c-6cda04c2ce2d None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:25.192033 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60b944d-ef14-4279-994c-6cda04c2ce2d None admin] PATH_INFO: `/v3/users` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:25.192735 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60b944d-ef14-4279-994c-6cda04c2ce2d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:25.194268 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60b944d-ef14-4279-994c-6cda04c2ce2d None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:25.217623 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 110/221] 10.222.0.47 () {60 vars in 1132 bytes} [Wed Aug 31 00:06:25 2022] POST /identity/v3/users => generated 297 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:06:25.218464 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60b944d-ef14-4279-994c-6cda04c2ce2d None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:25.238452 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7216fa-44e7-4a3e-a9fb-178264e83f32 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:25.247028 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:25.281111 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1614eeec-df60-4b3f-9979-422c35a019eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:25.281748 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1614eeec-df60-4b3f-9979-422c35a019eb None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:25.282033 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1614eeec-df60-4b3f-9979-422c35a019eb None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:25.282310 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1614eeec-df60-4b3f-9979-422c35a019eb None admin] PATH_INFO: `/v3/roles/member` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:25.295915 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1614eeec-df60-4b3f-9979-422c35a019eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:06:25.301381 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-1614eeec-df60-4b3f-9979-422c35a019eb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 00:06:25.301381 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:25.301381 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:06:25.301381 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:06:25.301381 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:06:25.301381 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:06:25.301381 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:06:25.301381 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:06:25.301381 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:06:25.301381 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:06:25.301381 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:06:25.301381 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:06:25.301381 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:06:25.301381 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:06:25.301381 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:06:25.301381 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:06:25.302358 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:06:25.302358 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:06:25.302358 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:06:25.302358 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:06:25.302358 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:06:25.302358 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:06:25.302358 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:06:25.302358 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:06:25.302358 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:06:25.302358 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:06:25.302358 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:06:25.302358 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Aug 31 00:06:25.302358 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:06:25.302358 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:06:25.302358 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:06:25.302358 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:06:25.303275 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:06:25.303275 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:06:25.303275 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:06:25.303275 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:06:25.303275 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:06:25.303275 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:06:25.303275 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:06:25.303275 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:06:25.303275 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:06:25.303275 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:06:25.303275 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 00:06:25.303275 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Aug 31 00:06:25.303275 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 112/222] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 31 00:06:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:06:25.304429 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1614eeec-df60-4b3f-9979-422c35a019eb None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:25.352695 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60b944d-ef14-4279-994c-6cda04c2ce2d None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:25.395367 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1212eb7f-6099-48cc-80d7-280163d1c04b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:25.396263 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1212eb7f-6099-48cc-80d7-280163d1c04b None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:25.397003 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1212eb7f-6099-48cc-80d7-280163d1c04b None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:25.397003 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1212eb7f-6099-48cc-80d7-280163d1c04b None admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:25.397517 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1212eb7f-6099-48cc-80d7-280163d1c04b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:25.397779 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1212eb7f-6099-48cc-80d7-280163d1c04b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:25.399755 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1212eb7f-6099-48cc-80d7-280163d1c04b None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:25.412337 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 111/223] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 31 00:06:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:25.413359 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1212eb7f-6099-48cc-80d7-280163d1c04b None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:25.433479 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:25.441151 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1614eeec-df60-4b3f-9979-422c35a019eb None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:25.486667 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8ddb8c-aab4-41ab-8607-d59b33645c27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:25.487779 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8ddb8c-aab4-41ab-8607-d59b33645c27 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:25.488295 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8ddb8c-aab4-41ab-8607-d59b33645c27 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:25.488737 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8ddb8c-aab4-41ab-8607-d59b33645c27 None admin] PATH_INFO: `/v3/users/489c773cda004ed793f4e3e9a81c23bf` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:25.491781 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8ddb8c-aab4-41ab-8607-d59b33645c27 None admin] RBAC: Authorizing `identity:get_user(user_id=489c773cda004ed793f4e3e9a81c23bf)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:25.494563 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8ddb8c-aab4-41ab-8607-d59b33645c27 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:25.496808 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 113/224] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 31 00:06:25 2022] GET /identity/v3/users/489c773cda004ed793f4e3e9a81c23bf => generated 283 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:25.497505 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8ddb8c-aab4-41ab-8607-d59b33645c27 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:25.552440 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:25.585181 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1212eb7f-6099-48cc-80d7-280163d1c04b None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:25.629056 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5935d34f-0f72-4ba8-bc1e-358c75bb8cdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:25.629753 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5935d34f-0f72-4ba8-bc1e-358c75bb8cdc None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:25.630354 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5935d34f-0f72-4ba8-bc1e-358c75bb8cdc None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:25.630700 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5935d34f-0f72-4ba8-bc1e-358c75bb8cdc None admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:25.631942 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5935d34f-0f72-4ba8-bc1e-358c75bb8cdc None admin] RBAC: Adding query filter params (name=member) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:25.632603 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5935d34f-0f72-4ba8-bc1e-358c75bb8cdc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:25.634893 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5935d34f-0f72-4ba8-bc1e-358c75bb8cdc None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:25.642376 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8ddb8c-aab4-41ab-8607-d59b33645c27 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:25.648783 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 112/225] 10.222.0.47 () {56 vars in 1101 bytes} [Wed Aug 31 00:06:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:25.650189 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5935d34f-0f72-4ba8-bc1e-358c75bb8cdc None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:25.682427 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b45bb54-89b8-414b-abcd-2e9c0097ccb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:25.683225 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b45bb54-89b8-414b-abcd-2e9c0097ccb3 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:25.684594 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b45bb54-89b8-414b-abcd-2e9c0097ccb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:25.685096 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b45bb54-89b8-414b-abcd-2e9c0097ccb3 None admin] PATH_INFO: `/v3/users/489c773cda004ed793f4e3e9a81c23bf` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:25.686853 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b45bb54-89b8-414b-abcd-2e9c0097ccb3 None admin] RBAC: Authorizing `identity:get_user(user_id=489c773cda004ed793f4e3e9a81c23bf)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:25.688480 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b45bb54-89b8-414b-abcd-2e9c0097ccb3 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:25.690514 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 114/226] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 31 00:06:25 2022] GET /identity/v3/users/489c773cda004ed793f4e3e9a81c23bf => generated 283 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:25.691468 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b45bb54-89b8-414b-abcd-2e9c0097ccb3 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:25.760288 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:25.800521 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5935d34f-0f72-4ba8-bc1e-358c75bb8cdc None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:25.821719 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b45bb54-89b8-414b-abcd-2e9c0097ccb3 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:25.823527 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:25.843387 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb66169-124c-4e28-bd9d-1059ada86483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:25.844584 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb66169-124c-4e28-bd9d-1059ada86483 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:25.845474 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb66169-124c-4e28-bd9d-1059ada86483 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:25.845959 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb66169-124c-4e28-bd9d-1059ada86483 None admin] PATH_INFO: `/v3/projects/f605ca29af4949a5a9696ac63a2a2ffc` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:25.847409 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb66169-124c-4e28-bd9d-1059ada86483 None admin] RBAC: Authorizing `identity:get_project(project_id=f605ca29af4949a5a9696ac63a2a2ffc)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:25.849836 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb66169-124c-4e28-bd9d-1059ada86483 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:25.852375 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 113/227] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 31 00:06:25 2022] GET /identity/v3/projects/f605ca29af4949a5a9696ac63a2a2ffc => generated 302 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:25.853476 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb66169-124c-4e28-bd9d-1059ada86483 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:25.879389 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c846ab-a2aa-495e-92b1-1c0401e09a5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:25.880429 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c846ab-a2aa-495e-92b1-1c0401e09a5d None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:25.880838 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c846ab-a2aa-495e-92b1-1c0401e09a5d None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:25.881202 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c846ab-a2aa-495e-92b1-1c0401e09a5d None admin] PATH_INFO: `/v3/users/4f267825f3fa463cbeca723e0f2d5fac` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:25.900267 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c846ab-a2aa-495e-92b1-1c0401e09a5d None admin] RBAC: Authorizing `identity:get_user(user_id=4f267825f3fa463cbeca723e0f2d5fac)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:25.901928 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c846ab-a2aa-495e-92b1-1c0401e09a5d None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:25.903895 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 115/228] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 31 00:06:25 2022] GET /identity/v3/users/4f267825f3fa463cbeca723e0f2d5fac => generated 297 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:25.904780 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c846ab-a2aa-495e-92b1-1c0401e09a5d None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:26.029481 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb66169-124c-4e28-bd9d-1059ada86483 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:26.059033 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c846ab-a2aa-495e-92b1-1c0401e09a5d None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:26.087496 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7e8cae-44cc-480b-bd1c-3f6c2945bf75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:26.088497 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7e8cae-44cc-480b-bd1c-3f6c2945bf75 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:26.088949 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7e8cae-44cc-480b-bd1c-3f6c2945bf75 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:26.090451 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7e8cae-44cc-480b-bd1c-3f6c2945bf75 None admin] PATH_INFO: `/v3/projects/f605ca29af4949a5a9696ac63a2a2ffc` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:26.092367 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7e8cae-44cc-480b-bd1c-3f6c2945bf75 None admin] RBAC: Authorizing `identity:get_project(project_id=f605ca29af4949a5a9696ac63a2a2ffc)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:26.094296 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7e8cae-44cc-480b-bd1c-3f6c2945bf75 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:26.097087 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 114/229] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 31 00:06:25 2022] GET /identity/v3/projects/f605ca29af4949a5a9696ac63a2a2ffc => generated 302 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:26.099367 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7e8cae-44cc-480b-bd1c-3f6c2945bf75 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:26.110465 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:26.117626 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b230049a-fd26-4064-943e-b9ddbf62dc14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:26.119966 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b230049a-fd26-4064-943e-b9ddbf62dc14 None admin] REQUEST_METHOD: `PUT` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:26.120698 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b230049a-fd26-4064-943e-b9ddbf62dc14 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:26.122948 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b230049a-fd26-4064-943e-b9ddbf62dc14 None admin] PATH_INFO: `/v3/projects/f605ca29af4949a5a9696ac63a2a2ffc/users/489c773cda004ed793f4e3e9a81c23bf/roles/12f6817f9aaa4e2bb477095a6bed5d0f` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:26.128087 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b230049a-fd26-4064-943e-b9ddbf62dc14 None admin] RBAC: Authorizing `identity:create_grant(project_id=f605ca29af4949a5a9696ac63a2a2ffc, user_id=489c773cda004ed793f4e3e9a81c23bf, role_id=12f6817f9aaa4e2bb477095a6bed5d0f)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:26.132006 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b230049a-fd26-4064-943e-b9ddbf62dc14 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:26.163965 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 116/230] 10.222.0.47 () {58 vars in 1439 bytes} [Wed Aug 31 00:06:25 2022] PUT /identity/v3/projects/f605ca29af4949a5a9696ac63a2a2ffc/users/489c773cda004ed793f4e3e9a81c23bf/roles/12f6817f9aaa4e2bb477095a6bed5d0f => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:06:26.166844 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b230049a-fd26-4064-943e-b9ddbf62dc14 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:26.205360 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:26.256298 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7e8cae-44cc-480b-bd1c-3f6c2945bf75 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:26.308075 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7db3890-e2f7-4afa-81f3-26d246aaf462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:26.310527 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7db3890-e2f7-4afa-81f3-26d246aaf462 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:26.310997 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7db3890-e2f7-4afa-81f3-26d246aaf462 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:26.311439 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7db3890-e2f7-4afa-81f3-26d246aaf462 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:26.325515 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b230049a-fd26-4064-943e-b9ddbf62dc14 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:26.383438 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea75877d-7659-4de3-9c05-18b2a913ef5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:26.384214 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea75877d-7659-4de3-9c05-18b2a913ef5c None admin] REQUEST_METHOD: `PUT` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:26.384647 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea75877d-7659-4de3-9c05-18b2a913ef5c None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:26.384911 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea75877d-7659-4de3-9c05-18b2a913ef5c None admin] PATH_INFO: `/v3/projects/f605ca29af4949a5a9696ac63a2a2ffc/users/489c773cda004ed793f4e3e9a81c23bf/roles/89f25837440e4981bad54fe74d242232` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:26.391024 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea75877d-7659-4de3-9c05-18b2a913ef5c None admin] RBAC: Authorizing `identity:create_grant(project_id=f605ca29af4949a5a9696ac63a2a2ffc, user_id=489c773cda004ed793f4e3e9a81c23bf, role_id=89f25837440e4981bad54fe74d242232)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:26.392817 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea75877d-7659-4de3-9c05-18b2a913ef5c None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:26.416048 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7db3890-e2f7-4afa-81f3-26d246aaf462 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:26.419769 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7db3890-e2f7-4afa-81f3-26d246aaf462 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:26.423959 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:26.430262 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 117/231] 10.222.0.47 () {58 vars in 1439 bytes} [Wed Aug 31 00:06:26 2022] PUT /identity/v3/projects/f605ca29af4949a5a9696ac63a2a2ffc/users/489c773cda004ed793f4e3e9a81c23bf/roles/89f25837440e4981bad54fe74d242232 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:06:26.575655 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 115/232] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 31 00:06:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 476 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 00:06:26.581192 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea75877d-7659-4de3-9c05-18b2a913ef5c None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:26.717338 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:26.740576 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea75877d-7659-4de3-9c05-18b2a913ef5c None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:26.779745 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dee4d9-e398-49c8-ba66-80f948a5a30f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:26.780427 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dee4d9-e398-49c8-ba66-80f948a5a30f None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:26.780705 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dee4d9-e398-49c8-ba66-80f948a5a30f None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:26.780980 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dee4d9-e398-49c8-ba66-80f948a5a30f None admin] PATH_INFO: `/v3/projects/f605ca29af4949a5a9696ac63a2a2ffc` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:26.782119 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15dee4d9-e398-49c8-ba66-80f948a5a30f None admin] RBAC: Authorizing `identity:get_project(project_id=f605ca29af4949a5a9696ac63a2a2ffc)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:26.783580 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15dee4d9-e398-49c8-ba66-80f948a5a30f None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:26.785942 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 118/233] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 31 00:06:26 2022] GET /identity/v3/projects/f605ca29af4949a5a9696ac63a2a2ffc => generated 302 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:26.791553 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7db3890-e2f7-4afa-81f3-26d246aaf462 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:26.960879 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7db3890-e2f7-4afa-81f3-26d246aaf462 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:26.963720 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:27.014840 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3d3fef-3442-468c-8231-0919efdc5aba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:27.015464 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3d3fef-3442-468c-8231-0919efdc5aba None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:27.015748 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3d3fef-3442-468c-8231-0919efdc5aba None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:27.016022 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3d3fef-3442-468c-8231-0919efdc5aba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:27.016794 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3d3fef-3442-468c-8231-0919efdc5aba None admin] RBAC: Adding query filter params (role.id=fdad79ffbcbb4fa380dc9cf7dd108618, scope.project.id=f605ca29af4949a5a9696ac63a2a2ffc, user.id=4f267825f3fa463cbeca723e0f2d5fac) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:27.017101 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3d3fef-3442-468c-8231-0919efdc5aba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:27.018642 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3d3fef-3442-468c-8231-0919efdc5aba None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:27.029752 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 116/234] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 31 00:06:26 2022] GET /identity/v3/role_assignments?user.id=4f267825f3fa463cbeca723e0f2d5fac&scope.project.id=f605ca29af4949a5a9696ac63a2a2ffc&role.id=fdad79ffbcbb4fa380dc9cf7dd108618 => generated 259 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:27.528556 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049ee9b5-73eb-412f-8d1d-c567bd5526e5 None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:27.529587 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049ee9b5-73eb-412f-8d1d-c567bd5526e5 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:27.530064 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049ee9b5-73eb-412f-8d1d-c567bd5526e5 None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:27.531648 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 119/235] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 00:06:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:06:27.537688 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993c8657-73d9-464d-be08-a3b04ae7fff3 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:27.538552 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993c8657-73d9-464d-be08-a3b04ae7fff3 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:27.539094 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993c8657-73d9-464d-be08-a3b04ae7fff3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:27.560772 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-993c8657-73d9-464d-be08-a3b04ae7fff3 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:06:27.562300 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-993c8657-73d9-464d-be08-a3b04ae7fff3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:06:27.641244 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 117/236] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 00:06:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Aug 31 00:06:27.777548 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e305bc2-a6b0-4a9b-9381-8e37f1e84800 None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:27.777868 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e305bc2-a6b0-4a9b-9381-8e37f1e84800 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:27.778108 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e305bc2-a6b0-4a9b-9381-8e37f1e84800 None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:27.779827 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 120/237] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 00:06:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:06:27.785458 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98feab8-b259-41bc-a68f-f2fd202e2e97 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:27.786003 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98feab8-b259-41bc-a68f-f2fd202e2e97 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:27.786466 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98feab8-b259-41bc-a68f-f2fd202e2e97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:27.810403 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-e98feab8-b259-41bc-a68f-f2fd202e2e97 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:06:27.812315 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-e98feab8-b259-41bc-a68f-f2fd202e2e97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:06:27.903194 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 118/238] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 00:06:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:06:27.997949 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e305bc2-a6b0-4a9b-9381-8e37f1e84800 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:28.136315 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e305bc2-a6b0-4a9b-9381-8e37f1e84800 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:28.188237 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d5e95c-083e-41c2-929c-36f3016e9a19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:28.188981 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d5e95c-083e-41c2-929c-36f3016e9a19 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:28.189288 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d5e95c-083e-41c2-929c-36f3016e9a19 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:28.189739 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d5e95c-083e-41c2-929c-36f3016e9a19 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:28.192981 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d5e95c-083e-41c2-929c-36f3016e9a19 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:28.194490 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d5e95c-083e-41c2-929c-36f3016e9a19 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:28.196528 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 121/239] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 00:06:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:28.206056 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98feab8-b259-41bc-a68f-f2fd202e2e97 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:28.272682 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:28.310088 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d5e95c-083e-41c2-929c-36f3016e9a19 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:28.356544 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:28.440725 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98feab8-b259-41bc-a68f-f2fd202e2e97 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:28.518568 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19c9b34-93e7-4643-9dd6-1b030cc73e64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:28.520137 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19c9b34-93e7-4643-9dd6-1b030cc73e64 None admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:28.522922 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19c9b34-93e7-4643-9dd6-1b030cc73e64 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:28.523743 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19c9b34-93e7-4643-9dd6-1b030cc73e64 None admin] PATH_INFO: `/v3/users` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:28.525609 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19c9b34-93e7-4643-9dd6-1b030cc73e64 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:28.530678 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19c9b34-93e7-4643-9dd6-1b030cc73e64 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:28.598036 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 119/240] 10.222.0.47 () {60 vars in 1132 bytes} [Wed Aug 31 00:06:28 2022] POST /identity/v3/users => generated 293 bytes in 393 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:06:28.604009 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d5e95c-083e-41c2-929c-36f3016e9a19 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:28.675642 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c47480-abe5-4a53-b491-6d0abaa5b819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:28.677275 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c47480-abe5-4a53-b491-6d0abaa5b819 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:28.678139 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c47480-abe5-4a53-b491-6d0abaa5b819 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:28.678901 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c47480-abe5-4a53-b491-6d0abaa5b819 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:28.700963 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c47480-abe5-4a53-b491-6d0abaa5b819 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:06:28.711829 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-52c47480-abe5-4a53-b491-6d0abaa5b819 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 00:06:28.711829 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:28.711829 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:06:28.711829 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:06:28.711829 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:06:28.711829 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:06:28.711829 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:06:28.711829 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:06:28.711829 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:06:28.711829 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:06:28.711829 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:06:28.711829 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:06:28.711829 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:06:28.711829 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:06:28.711829 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:06:28.711829 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:06:28.713598 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:06:28.713598 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:06:28.713598 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:06:28.713598 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:06:28.713598 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:06:28.713598 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:06:28.713598 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:06:28.713598 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:06:28.713598 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:06:28.713598 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:06:28.713598 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:06:28.713598 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Aug 31 00:06:28.713598 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:06:28.713598 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:06:28.713598 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:06:28.713598 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:06:28.715138 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:06:28.715138 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:06:28.715138 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:06:28.715138 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:06:28.715138 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:06:28.715138 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:06:28.715138 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:06:28.715138 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:06:28.715138 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:06:28.715138 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:06:28.715138 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 00:06:28.715138 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Aug 31 00:06:28.719906 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 122/241] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 31 00:06:28 2022] GET /identity/v3/roles/reader => generated 84 bytes in 410 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:06:28.730146 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19c9b34-93e7-4643-9dd6-1b030cc73e64 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:28.912001 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825915e2-a755-49ef-8e85-eecc18dbd307 None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:28.912675 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825915e2-a755-49ef-8e85-eecc18dbd307 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:28.913231 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825915e2-a755-49ef-8e85-eecc18dbd307 None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:28.916015 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 123/242] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 00:06:28 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:06:28.923499 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed99145b-3078-4086-b3c3-74e927e942e8 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:28.924054 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed99145b-3078-4086-b3c3-74e927e942e8 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:28.925757 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:28.927046 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed99145b-3078-4086-b3c3-74e927e942e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:28.959196 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19c9b34-93e7-4643-9dd6-1b030cc73e64 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:28.969812 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-ed99145b-3078-4086-b3c3-74e927e942e8 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:06:28.971867 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-ed99145b-3078-4086-b3c3-74e927e942e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:06:29.036406 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72362f82-d44a-495e-8c7d-fa5b9e8797aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:29.037621 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72362f82-d44a-495e-8c7d-fa5b9e8797aa None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:29.038378 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72362f82-d44a-495e-8c7d-fa5b9e8797aa None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:29.039090 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72362f82-d44a-495e-8c7d-fa5b9e8797aa None admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:29.041354 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72362f82-d44a-495e-8c7d-fa5b9e8797aa None admin] RBAC: Adding query filter params (name=reader) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:29.042020 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72362f82-d44a-495e-8c7d-fa5b9e8797aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:29.047187 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72362f82-d44a-495e-8c7d-fa5b9e8797aa None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:29.064419 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 120/243] 10.222.0.47 () {56 vars in 1101 bytes} [Wed Aug 31 00:06:28 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:29.068431 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e01b4d-c54c-4f20-a65c-edfced4e044c None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:29.068975 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e01b4d-c54c-4f20-a65c-edfced4e044c None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:29.069470 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e01b4d-c54c-4f20-a65c-edfced4e044c None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:29.071037 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 121/244] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 00:06:29 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:06:29.077366 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e01b4d-c54c-4f20-a65c-edfced4e044c None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:29.094147 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 124/245] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 00:06:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:06:29.095801 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bace9ae-4730-4646-8b99-3acf4e6ae44c None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:29.096140 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bace9ae-4730-4646-8b99-3acf4e6ae44c None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:29.097452 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bace9ae-4730-4646-8b99-3acf4e6ae44c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:29.117355 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:29.120447 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-3bace9ae-4730-4646-8b99-3acf4e6ae44c None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:06:29.122532 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-3bace9ae-4730-4646-8b99-3acf4e6ae44c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:06:29.250513 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 125/246] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 00:06:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:06:29.283822 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e01b4d-c54c-4f20-a65c-edfced4e044c None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:29.334265 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7108fa0e-ef37-4c36-a35c-065a07d19e11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:29.334932 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7108fa0e-ef37-4c36-a35c-065a07d19e11 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:29.335208 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7108fa0e-ef37-4c36-a35c-065a07d19e11 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:29.335497 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7108fa0e-ef37-4c36-a35c-065a07d19e11 None admin] PATH_INFO: `/v3/users/f9718aa0023f45e68f491dd9514bf876` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:29.360481 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7108fa0e-ef37-4c36-a35c-065a07d19e11 None admin] RBAC: Authorizing `identity:get_user(user_id=f9718aa0023f45e68f491dd9514bf876)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:29.362133 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7108fa0e-ef37-4c36-a35c-065a07d19e11 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:29.363898 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 122/247] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 31 00:06:29 2022] GET /identity/v3/users/f9718aa0023f45e68f491dd9514bf876 => generated 297 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:29.370262 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bace9ae-4730-4646-8b99-3acf4e6ae44c None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:29.495792 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7108fa0e-ef37-4c36-a35c-065a07d19e11 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:29.498479 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bace9ae-4730-4646-8b99-3acf4e6ae44c None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:29.506959 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:29.571355 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9786c51e-4c1d-4118-99c0-d056ffdd2513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:29.572010 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9786c51e-4c1d-4118-99c0-d056ffdd2513 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:29.572322 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9786c51e-4c1d-4118-99c0-d056ffdd2513 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:29.572599 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9786c51e-4c1d-4118-99c0-d056ffdd2513 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:29.581706 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:29.715863 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7108fa0e-ef37-4c36-a35c-065a07d19e11 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:29.744680 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9786c51e-4c1d-4118-99c0-d056ffdd2513 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:29.751424 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9786c51e-4c1d-4118-99c0-d056ffdd2513 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:29.775198 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce71701e-b439-4011-8401-dc6b8b047e5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:29.775756 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce71701e-b439-4011-8401-dc6b8b047e5d None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:29.776037 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce71701e-b439-4011-8401-dc6b8b047e5d None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:29.776341 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce71701e-b439-4011-8401-dc6b8b047e5d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:29.799694 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce71701e-b439-4011-8401-dc6b8b047e5d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:06:29.804745 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-ce71701e-b439-4011-8401-dc6b8b047e5d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:06:29.804745 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:29.804745 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:06:29.804745 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:06:29.804745 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:06:29.804745 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:06:29.804745 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:06:29.804745 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:06:29.804745 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:06:29.804745 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:06:29.804745 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:06:29.804745 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:06:29.804745 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:06:29.804745 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:06:29.804745 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:06:29.804745 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:06:29.806313 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:06:29.806313 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:06:29.806313 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:06:29.806313 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:06:29.806313 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:06:29.806313 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:06:29.806313 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:06:29.806313 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:06:29.806313 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:06:29.806313 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:06:29.806313 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:06:29.806313 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 31 00:06:29.806313 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:06:29.806313 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:06:29.806313 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:06:29.806313 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:06:29.807838 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:06:29.807838 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:06:29.807838 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:06:29.807838 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:06:29.807838 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:06:29.807838 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:06:29.807838 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:06:29.807838 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:06:29.807838 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:06:29.807838 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:06:29.807838 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:06:29.807838 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 31 00:06:29.807838 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 123/248] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Aug 31 00:06:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:06:29.820563 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce71701e-b439-4011-8401-dc6b8b047e5d None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:29.911544 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 126/249] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 31 00:06:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 542 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 00:06:29.912444 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9786c51e-4c1d-4118-99c0-d056ffdd2513 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:29.953065 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:30.016794 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:30.037874 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9786c51e-4c1d-4118-99c0-d056ffdd2513 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:30.070641 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce71701e-b439-4011-8401-dc6b8b047e5d None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:30.078891 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84c17b7-b888-43a1-b746-6693e5752e85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:30.079874 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84c17b7-b888-43a1-b746-6693e5752e85 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:30.080403 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84c17b7-b888-43a1-b746-6693e5752e85 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:30.080900 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84c17b7-b888-43a1-b746-6693e5752e85 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:30.094010 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84c17b7-b888-43a1-b746-6693e5752e85 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:06:30.099832 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-d84c17b7-b888-43a1-b746-6693e5752e85 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 00:06:30.099832 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:30.099832 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:06:30.099832 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:06:30.099832 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:06:30.099832 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:06:30.099832 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:06:30.099832 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:06:30.099832 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:06:30.099832 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:06:30.099832 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:06:30.099832 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:06:30.099832 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:06:30.099832 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:06:30.099832 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:06:30.099832 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:06:30.100799 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:06:30.100799 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:06:30.100799 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:06:30.100799 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:06:30.100799 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:06:30.100799 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:06:30.100799 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:06:30.100799 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:06:30.100799 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:06:30.100799 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:06:30.100799 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:06:30.100799 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Aug 31 00:06:30.100799 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:06:30.100799 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:06:30.100799 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:06:30.100799 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:06:30.101619 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:06:30.101619 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:06:30.101619 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:06:30.101619 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:06:30.101619 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:06:30.101619 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:06:30.101619 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:06:30.101619 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:06:30.101619 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:06:30.101619 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:06:30.101619 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 00:06:30.101619 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Aug 31 00:06:30.109518 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 127/250] 10.222.0.47 () {56 vars in 1114 bytes} [Wed Aug 31 00:06:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:06:30.109518 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84c17b7-b888-43a1-b746-6693e5752e85 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:30.113587 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93537730-813f-453d-b42c-822861945f79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:30.114523 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93537730-813f-453d-b42c-822861945f79 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:30.114801 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93537730-813f-453d-b42c-822861945f79 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:30.115069 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93537730-813f-453d-b42c-822861945f79 None admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:30.116398 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93537730-813f-453d-b42c-822861945f79 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:30.120592 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93537730-813f-453d-b42c-822861945f79 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:30.122581 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93537730-813f-453d-b42c-822861945f79 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:30.134289 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 124/251] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 31 00:06:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:30.138798 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2907f4-e2fb-4b35-b5be-abbee9a08c67 None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:30.138798 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2907f4-e2fb-4b35-b5be-abbee9a08c67 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:30.138798 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2907f4-e2fb-4b35-b5be-abbee9a08c67 None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:30.138798 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 125/252] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 00:06:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:06:30.138798 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2907f4-e2fb-4b35-b5be-abbee9a08c67 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:30.226667 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:30.235738 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84c17b7-b888-43a1-b746-6693e5752e85 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:30.265072 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2907f4-e2fb-4b35-b5be-abbee9a08c67 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:30.274169 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe8cc9f-26d5-4a2e-955b-7b08644b2ba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:30.275248 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe8cc9f-26d5-4a2e-955b-7b08644b2ba8 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:30.275735 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe8cc9f-26d5-4a2e-955b-7b08644b2ba8 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:30.276284 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe8cc9f-26d5-4a2e-955b-7b08644b2ba8 None admin] PATH_INFO: `/v3/projects/f605ca29af4949a5a9696ac63a2a2ffc` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:30.278284 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe8cc9f-26d5-4a2e-955b-7b08644b2ba8 None admin] RBAC: Authorizing `identity:get_project(project_id=f605ca29af4949a5a9696ac63a2a2ffc)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:30.280235 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe8cc9f-26d5-4a2e-955b-7b08644b2ba8 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:30.282601 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 128/253] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 31 00:06:30 2022] GET /identity/v3/projects/f605ca29af4949a5a9696ac63a2a2ffc => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:30.283682 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe8cc9f-26d5-4a2e-955b-7b08644b2ba8 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:30.295274 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:30.304586 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ad88a2-ae43-4147-b7c8-237456455bcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:30.305102 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ad88a2-ae43-4147-b7c8-237456455bcf None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:30.305384 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ad88a2-ae43-4147-b7c8-237456455bcf None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:30.305658 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ad88a2-ae43-4147-b7c8-237456455bcf None admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:30.306327 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ad88a2-ae43-4147-b7c8-237456455bcf None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:30.306635 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ad88a2-ae43-4147-b7c8-237456455bcf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:30.308049 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ad88a2-ae43-4147-b7c8-237456455bcf None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:30.322644 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 126/254] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 31 00:06:30 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:30.324229 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b815f1f8-9985-45da-aea0-bfac1584a1d0 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:30.324529 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b815f1f8-9985-45da-aea0-bfac1584a1d0 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:30.324802 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b815f1f8-9985-45da-aea0-bfac1584a1d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:30.344362 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-b815f1f8-9985-45da-aea0-bfac1584a1d0 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:06:30.345660 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-b815f1f8-9985-45da-aea0-bfac1584a1d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:06:30.406148 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe8cc9f-26d5-4a2e-955b-7b08644b2ba8 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:30.423495 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 127/255] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 00:06:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:06:30.424478 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b815f1f8-9985-45da-aea0-bfac1584a1d0 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:30.446790 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfd196e-7c71-473a-9488-3bf91ce7c006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:30.447841 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfd196e-7c71-473a-9488-3bf91ce7c006 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:30.448357 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfd196e-7c71-473a-9488-3bf91ce7c006 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:30.448835 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfd196e-7c71-473a-9488-3bf91ce7c006 None admin] PATH_INFO: `/v3/users/489c773cda004ed793f4e3e9a81c23bf` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:30.451163 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfd196e-7c71-473a-9488-3bf91ce7c006 None admin] RBAC: Authorizing `identity:get_user(user_id=489c773cda004ed793f4e3e9a81c23bf)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:30.452904 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfd196e-7c71-473a-9488-3bf91ce7c006 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:30.455132 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 129/256] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 31 00:06:30 2022] GET /identity/v3/users/489c773cda004ed793f4e3e9a81c23bf => generated 283 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:30.460584 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfd196e-7c71-473a-9488-3bf91ce7c006 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:30.496601 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:30.541113 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b815f1f8-9985-45da-aea0-bfac1584a1d0 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:30.568663 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:30.574764 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfd196e-7c71-473a-9488-3bf91ce7c006 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:30.583996 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4ced38-f0d8-480a-beee-1218d0daa754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:30.584708 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4ced38-f0d8-480a-beee-1218d0daa754 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:30.584990 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4ced38-f0d8-480a-beee-1218d0daa754 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:30.585332 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4ced38-f0d8-480a-beee-1218d0daa754 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:30.586479 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4ced38-f0d8-480a-beee-1218d0daa754 None admin] RBAC: Adding query filter params (role.id=4d8eb43f443c46d3aaaf3c515e374839, scope.project.id=f605ca29af4949a5a9696ac63a2a2ffc, user.id=f9718aa0023f45e68f491dd9514bf876) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:30.586591 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4ced38-f0d8-480a-beee-1218d0daa754 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:30.588244 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4ced38-f0d8-480a-beee-1218d0daa754 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:30.595872 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 128/257] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 31 00:06:30 2022] GET /identity/v3/role_assignments?user.id=f9718aa0023f45e68f491dd9514bf876&scope.project.id=f605ca29af4949a5a9696ac63a2a2ffc&role.id=4d8eb43f443c46d3aaaf3c515e374839 => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:30.596935 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4ced38-f0d8-480a-beee-1218d0daa754 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:30.617780 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74075365-b0dc-439b-b929-b3a082a6a026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:30.618842 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74075365-b0dc-439b-b929-b3a082a6a026 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:30.619327 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74075365-b0dc-439b-b929-b3a082a6a026 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:30.619833 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74075365-b0dc-439b-b929-b3a082a6a026 None admin] PATH_INFO: `/v3/users/489c773cda004ed793f4e3e9a81c23bf` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:30.621430 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74075365-b0dc-439b-b929-b3a082a6a026 None admin] RBAC: Authorizing `identity:get_user(user_id=489c773cda004ed793f4e3e9a81c23bf)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:30.623393 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74075365-b0dc-439b-b929-b3a082a6a026 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:30.625805 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 130/258] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 31 00:06:30 2022] GET /identity/v3/users/489c773cda004ed793f4e3e9a81c23bf => generated 283 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:30.638130 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74075365-b0dc-439b-b929-b3a082a6a026 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:30.799417 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4ced38-f0d8-480a-beee-1218d0daa754 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:30.843670 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a725f328-ab49-41e3-a7ef-22085a18bdad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:30.844682 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a725f328-ab49-41e3-a7ef-22085a18bdad None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:30.845262 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a725f328-ab49-41e3-a7ef-22085a18bdad None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:30.845738 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a725f328-ab49-41e3-a7ef-22085a18bdad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:30.872793 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:30.879531 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74075365-b0dc-439b-b929-b3a082a6a026 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:30.921476 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:30.929851 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35149cec-370e-4ad3-9fef-7560b5cdfb69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:30.930473 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35149cec-370e-4ad3-9fef-7560b5cdfb69 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:30.930788 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35149cec-370e-4ad3-9fef-7560b5cdfb69 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:30.931061 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35149cec-370e-4ad3-9fef-7560b5cdfb69 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:30.946875 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a725f328-ab49-41e3-a7ef-22085a18bdad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:30.950771 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a725f328-ab49-41e3-a7ef-22085a18bdad None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:31.038355 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35149cec-370e-4ad3-9fef-7560b5cdfb69 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:31.040130 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35149cec-370e-4ad3-9fef-7560b5cdfb69 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:31.111167 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 129/259] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 31 00:06:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 515 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 00:06:31.113057 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a725f328-ab49-41e3-a7ef-22085a18bdad None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:31.169217 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:31.175754 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 131/260] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 31 00:06:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 539 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 00:06:31.180981 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35149cec-370e-4ad3-9fef-7560b5cdfb69 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:31.273855 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:31.307095 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a725f328-ab49-41e3-a7ef-22085a18bdad None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:31.310510 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35149cec-370e-4ad3-9fef-7560b5cdfb69 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:31.349204 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9162e16d-0af5-4535-81e2-d83dec078c55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:31.350088 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9162e16d-0af5-4535-81e2-d83dec078c55 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:31.350625 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9162e16d-0af5-4535-81e2-d83dec078c55 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:31.351044 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9162e16d-0af5-4535-81e2-d83dec078c55 None admin] PATH_INFO: `/v3/projects/f605ca29af4949a5a9696ac63a2a2ffc` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:31.352449 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9162e16d-0af5-4535-81e2-d83dec078c55 None admin] RBAC: Authorizing `identity:get_project(project_id=f605ca29af4949a5a9696ac63a2a2ffc)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:31.354237 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9162e16d-0af5-4535-81e2-d83dec078c55 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:31.356538 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 132/261] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 31 00:06:31 2022] GET /identity/v3/projects/f605ca29af4949a5a9696ac63a2a2ffc => generated 302 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:31.357616 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9162e16d-0af5-4535-81e2-d83dec078c55 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:31.372761 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbf293f-786f-4ded-b1d1-6411ba4c16ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:31.374152 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbf293f-786f-4ded-b1d1-6411ba4c16ed None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:31.374528 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbf293f-786f-4ded-b1d1-6411ba4c16ed None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:31.375098 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbf293f-786f-4ded-b1d1-6411ba4c16ed None admin] PATH_INFO: `/v3/roles/member` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:31.394149 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbf293f-786f-4ded-b1d1-6411ba4c16ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:06:31.402022 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-7fbf293f-786f-4ded-b1d1-6411ba4c16ed None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 00:06:31.402022 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:31.402022 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:06:31.402022 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:06:31.402022 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:06:31.402022 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:06:31.402022 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:06:31.402022 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:06:31.402022 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:06:31.402022 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:06:31.402022 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:06:31.402022 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:06:31.402022 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:06:31.402022 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:06:31.402022 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:06:31.402022 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:06:31.403518 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:06:31.403518 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:06:31.403518 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:06:31.403518 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:06:31.403518 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:06:31.403518 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:06:31.403518 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:06:31.403518 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:06:31.403518 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:06:31.403518 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:06:31.403518 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:06:31.403518 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 31 00:06:31.403518 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:06:31.403518 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:06:31.403518 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:06:31.403518 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:06:31.404369 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:06:31.404369 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:06:31.404369 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:06:31.404369 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:06:31.404369 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:06:31.404369 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:06:31.404369 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:06:31.404369 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:06:31.404369 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:06:31.404369 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:06:31.404369 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 00:06:31.404369 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 31 00:06:31.411651 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 130/262] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 31 00:06:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:06:31.416289 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbf293f-786f-4ded-b1d1-6411ba4c16ed None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:31.451918 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:31.502256 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9162e16d-0af5-4535-81e2-d83dec078c55 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:31.544142 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45f4a3f-3343-4a34-bf96-9763ceb96bb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:31.545103 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45f4a3f-3343-4a34-bf96-9763ceb96bb6 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:31.545626 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45f4a3f-3343-4a34-bf96-9763ceb96bb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:31.546111 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45f4a3f-3343-4a34-bf96-9763ceb96bb6 None admin] PATH_INFO: `/v3/projects/f605ca29af4949a5a9696ac63a2a2ffc` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:31.547480 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45f4a3f-3343-4a34-bf96-9763ceb96bb6 None admin] RBAC: Authorizing `identity:get_project(project_id=f605ca29af4949a5a9696ac63a2a2ffc)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:31.547588 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbf293f-786f-4ded-b1d1-6411ba4c16ed None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:31.549288 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45f4a3f-3343-4a34-bf96-9763ceb96bb6 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:31.551263 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 133/263] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 31 00:06:31 2022] GET /identity/v3/projects/f605ca29af4949a5a9696ac63a2a2ffc => generated 302 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:31.552291 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45f4a3f-3343-4a34-bf96-9763ceb96bb6 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:31.595977 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2092d06f-5180-4ab2-ae6c-482e93c2188f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:31.595977 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2092d06f-5180-4ab2-ae6c-482e93c2188f None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:31.596416 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2092d06f-5180-4ab2-ae6c-482e93c2188f None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:31.596679 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2092d06f-5180-4ab2-ae6c-482e93c2188f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:31.597420 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2092d06f-5180-4ab2-ae6c-482e93c2188f None admin] RBAC: Adding query filter params (role.id=12f6817f9aaa4e2bb477095a6bed5d0f, scope.project.id=f605ca29af4949a5a9696ac63a2a2ffc, user.id=489c773cda004ed793f4e3e9a81c23bf) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:31.597730 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2092d06f-5180-4ab2-ae6c-482e93c2188f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:31.599259 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2092d06f-5180-4ab2-ae6c-482e93c2188f None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:31.606578 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 131/264] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 31 00:06:31 2022] GET /identity/v3/role_assignments?user.id=489c773cda004ed793f4e3e9a81c23bf&scope.project.id=f605ca29af4949a5a9696ac63a2a2ffc&role.id=12f6817f9aaa4e2bb477095a6bed5d0f => generated 608 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:31.607568 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2092d06f-5180-4ab2-ae6c-482e93c2188f None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:31.627475 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:31.699856 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45f4a3f-3343-4a34-bf96-9763ceb96bb6 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:31.763716 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39baf204-8f9b-46ee-b04d-feb174b20620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:31.765658 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39baf204-8f9b-46ee-b04d-feb174b20620 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:31.766162 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39baf204-8f9b-46ee-b04d-feb174b20620 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:31.766855 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39baf204-8f9b-46ee-b04d-feb174b20620 None admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:31.769255 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39baf204-8f9b-46ee-b04d-feb174b20620 None admin] RBAC: Adding query filter params (name=member) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:31.769833 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39baf204-8f9b-46ee-b04d-feb174b20620 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:31.772527 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39baf204-8f9b-46ee-b04d-feb174b20620 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:31.779698 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:31.795472 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 134/265] 10.222.0.47 () {56 vars in 1101 bytes} [Wed Aug 31 00:06:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:31.805292 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef968aa-f638-4243-a9a6-8c74b2de45b4 None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:31.805913 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef968aa-f638-4243-a9a6-8c74b2de45b4 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:31.806385 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef968aa-f638-4243-a9a6-8c74b2de45b4 None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:31.812999 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 135/266] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 00:06:31 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:06:31.820374 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0032a44e-2d8f-4856-b66f-303b912f3df4 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:31.821062 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0032a44e-2d8f-4856-b66f-303b912f3df4 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:31.821545 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0032a44e-2d8f-4856-b66f-303b912f3df4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:31.843260 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-0032a44e-2d8f-4856-b66f-303b912f3df4 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:06:31.845012 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-0032a44e-2d8f-4856-b66f-303b912f3df4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:06:31.868128 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2092d06f-5180-4ab2-ae6c-482e93c2188f None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:31.925662 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da39504-87a8-4f1e-ac2c-f628e23eb5ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:31.926293 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da39504-87a8-4f1e-ac2c-f628e23eb5ed None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:31.926552 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da39504-87a8-4f1e-ac2c-f628e23eb5ed None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:31.926755 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 136/267] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 00:06:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:06:31.927182 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da39504-87a8-4f1e-ac2c-f628e23eb5ed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:31.927585 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da39504-87a8-4f1e-ac2c-f628e23eb5ed None admin] RBAC: Adding query filter params (role.id=89f25837440e4981bad54fe74d242232, scope.project.id=f605ca29af4949a5a9696ac63a2a2ffc, user.id=489c773cda004ed793f4e3e9a81c23bf) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:31.927890 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da39504-87a8-4f1e-ac2c-f628e23eb5ed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:31.928706 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0032a44e-2d8f-4856-b66f-303b912f3df4 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:31.934375 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da39504-87a8-4f1e-ac2c-f628e23eb5ed None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:31.945027 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 132/268] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 31 00:06:31 2022] GET /identity/v3/role_assignments?user.id=489c773cda004ed793f4e3e9a81c23bf&scope.project.id=f605ca29af4949a5a9696ac63a2a2ffc&role.id=89f25837440e4981bad54fe74d242232 => generated 608 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:32.063831 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0032a44e-2d8f-4856-b66f-303b912f3df4 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:32.112638 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:32.115445 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c07161-b950-40bd-b83f-17d48f2840bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:32.116370 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c07161-b950-40bd-b83f-17d48f2840bb None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:32.116682 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c07161-b950-40bd-b83f-17d48f2840bb None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:32.116968 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c07161-b950-40bd-b83f-17d48f2840bb None admin] PATH_INFO: `/v3/users/4f267825f3fa463cbeca723e0f2d5fac` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:32.118552 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c07161-b950-40bd-b83f-17d48f2840bb None admin] RBAC: Authorizing `identity:get_user(user_id=4f267825f3fa463cbeca723e0f2d5fac)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:32.120399 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c07161-b950-40bd-b83f-17d48f2840bb None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:32.122529 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 137/269] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 31 00:06:31 2022] GET /identity/v3/users/4f267825f3fa463cbeca723e0f2d5fac => generated 297 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:32.128596 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da39504-87a8-4f1e-ac2c-f628e23eb5ed None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:32.231326 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:32.280294 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da39504-87a8-4f1e-ac2c-f628e23eb5ed None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:32.286252 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c07161-b950-40bd-b83f-17d48f2840bb None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:32.329007 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1eeb105-0c87-400c-97e1-0d85ba33671d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:32.329654 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eeb105-0c87-400c-97e1-0d85ba33671d None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:32.329935 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eeb105-0c87-400c-97e1-0d85ba33671d None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:32.330209 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eeb105-0c87-400c-97e1-0d85ba33671d None admin] PATH_INFO: `/v3/projects/f605ca29af4949a5a9696ac63a2a2ffc` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:32.333330 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1eeb105-0c87-400c-97e1-0d85ba33671d None admin] RBAC: Authorizing `identity:get_project(project_id=f605ca29af4949a5a9696ac63a2a2ffc)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:32.334847 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1eeb105-0c87-400c-97e1-0d85ba33671d None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:32.336579 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 133/270] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 31 00:06:32 2022] GET /identity/v3/projects/f605ca29af4949a5a9696ac63a2a2ffc => generated 302 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:32.342989 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021241d0-f040-458f-b593-32c40dacea52 None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:32.342989 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021241d0-f040-458f-b593-32c40dacea52 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:32.342989 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021241d0-f040-458f-b593-32c40dacea52 None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:32.342989 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 134/271] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 00:06:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:06:32.347734 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be831d5-cdae-4187-ae49-2e2e3d829bb6 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:32.347734 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be831d5-cdae-4187-ae49-2e2e3d829bb6 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:32.347734 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be831d5-cdae-4187-ae49-2e2e3d829bb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:32.367462 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-3be831d5-cdae-4187-ae49-2e2e3d829bb6 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:06:32.368733 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-3be831d5-cdae-4187-ae49-2e2e3d829bb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:06:32.430865 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c07161-b950-40bd-b83f-17d48f2840bb None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:32.445494 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 135/272] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 00:06:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 00:06:32.447111 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be831d5-cdae-4187-ae49-2e2e3d829bb6 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:32.488558 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a3aa69-5efc-462d-ad7c-a97d39a49647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:32.489732 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a3aa69-5efc-462d-ad7c-a97d39a49647 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:32.490152 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a3aa69-5efc-462d-ad7c-a97d39a49647 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:32.491168 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a3aa69-5efc-462d-ad7c-a97d39a49647 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:32.509070 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a3aa69-5efc-462d-ad7c-a97d39a49647 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:06:32.523180 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-44a3aa69-5efc-462d-ad7c-a97d39a49647 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 00:06:32.523180 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:32.523180 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:06:32.523180 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:06:32.523180 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:06:32.523180 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:06:32.523180 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:06:32.523180 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:06:32.523180 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:06:32.523180 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:06:32.523180 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:06:32.523180 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:06:32.523180 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:06:32.523180 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:06:32.523180 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:06:32.523180 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:06:32.525107 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:06:32.525107 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:06:32.525107 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:06:32.525107 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:06:32.525107 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:06:32.525107 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:06:32.525107 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:06:32.525107 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:06:32.525107 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:06:32.525107 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:06:32.525107 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:06:32.525107 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Aug 31 00:06:32.525107 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:06:32.525107 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:06:32.525107 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:06:32.525107 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:06:32.526815 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:06:32.526815 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:06:32.526815 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:06:32.526815 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:06:32.526815 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:06:32.526815 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:06:32.526815 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:06:32.526815 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:06:32.526815 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:06:32.526815 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:06:32.526815 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 00:06:32.526815 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Aug 31 00:06:32.536891 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 138/273] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 31 00:06:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:06:32.541190 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a3aa69-5efc-462d-ad7c-a97d39a49647 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:32.569862 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:32.611595 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:32.652286 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be831d5-cdae-4187-ae49-2e2e3d829bb6 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:32.664689 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a3aa69-5efc-462d-ad7c-a97d39a49647 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:32.705879 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3aeaabe-051a-431e-aaa8-cc742a53a36a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:32.706664 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aeaabe-051a-431e-aaa8-cc742a53a36a None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:32.707624 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aeaabe-051a-431e-aaa8-cc742a53a36a None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:32.707624 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aeaabe-051a-431e-aaa8-cc742a53a36a None admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:32.708216 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3aeaabe-051a-431e-aaa8-cc742a53a36a None admin] RBAC: Adding query filter params (name=member) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:32.708637 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3aeaabe-051a-431e-aaa8-cc742a53a36a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:32.710197 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3aeaabe-051a-431e-aaa8-cc742a53a36a None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:32.726051 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 139/274] 10.222.0.47 () {56 vars in 1101 bytes} [Wed Aug 31 00:06:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:32.727175 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3aeaabe-051a-431e-aaa8-cc742a53a36a None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:32.730923 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62015b76-b2e7-483e-b6dd-a46998189a17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:32.732675 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62015b76-b2e7-483e-b6dd-a46998189a17 None admin] REQUEST_METHOD: `PUT` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:32.733492 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62015b76-b2e7-483e-b6dd-a46998189a17 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:32.734184 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62015b76-b2e7-483e-b6dd-a46998189a17 None admin] PATH_INFO: `/v3/projects/f605ca29af4949a5a9696ac63a2a2ffc/users/4f267825f3fa463cbeca723e0f2d5fac/roles/fdad79ffbcbb4fa380dc9cf7dd108618` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:32.738339 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62015b76-b2e7-483e-b6dd-a46998189a17 None admin] RBAC: Authorizing `identity:create_grant(project_id=f605ca29af4949a5a9696ac63a2a2ffc, user_id=4f267825f3fa463cbeca723e0f2d5fac, role_id=fdad79ffbcbb4fa380dc9cf7dd108618)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:32.741862 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62015b76-b2e7-483e-b6dd-a46998189a17 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:32.769896 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 136/275] 10.222.0.47 () {58 vars in 1439 bytes} [Wed Aug 31 00:06:32 2022] PUT /identity/v3/projects/f605ca29af4949a5a9696ac63a2a2ffc/users/4f267825f3fa463cbeca723e0f2d5fac/roles/fdad79ffbcbb4fa380dc9cf7dd108618 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:06:32.778854 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62015b76-b2e7-483e-b6dd-a46998189a17 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:32.852217 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3aeaabe-051a-431e-aaa8-cc742a53a36a None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:32.882188 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:32.894134 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0fee13-a7fe-4743-91ce-55aa444a1202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:32.894973 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0fee13-a7fe-4743-91ce-55aa444a1202 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:32.895365 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0fee13-a7fe-4743-91ce-55aa444a1202 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:32.895751 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0fee13-a7fe-4743-91ce-55aa444a1202 None admin] PATH_INFO: `/v3/users/f91d83d28d1e4c8e87b40f04a5cc041e` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:32.912445 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0fee13-a7fe-4743-91ce-55aa444a1202 None admin] RBAC: Authorizing `identity:get_user(user_id=f91d83d28d1e4c8e87b40f04a5cc041e)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:32.914191 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0fee13-a7fe-4743-91ce-55aa444a1202 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:32.916269 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 140/276] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 31 00:06:32 2022] GET /identity/v3/users/f91d83d28d1e4c8e87b40f04a5cc041e => generated 293 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:32.923197 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0fee13-a7fe-4743-91ce-55aa444a1202 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:33.015103 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62015b76-b2e7-483e-b6dd-a46998189a17 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:33.056294 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:33.074329 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7429bdc3-413d-4fb4-843c-55b22960ecd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:33.076322 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7429bdc3-413d-4fb4-843c-55b22960ecd6 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:33.076602 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7429bdc3-413d-4fb4-843c-55b22960ecd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:33.076940 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7429bdc3-413d-4fb4-843c-55b22960ecd6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:33.078488 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7429bdc3-413d-4fb4-843c-55b22960ecd6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:33.080873 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7429bdc3-413d-4fb4-843c-55b22960ecd6 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:33.082928 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 137/277] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 00:06:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:33.088588 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0fee13-a7fe-4743-91ce-55aa444a1202 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:33.089104 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7429bdc3-413d-4fb4-843c-55b22960ecd6 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:33.131112 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c90372-8d69-46fa-9bd3-5479550aaf6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:33.132205 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c90372-8d69-46fa-9bd3-5479550aaf6a None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:33.132754 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c90372-8d69-46fa-9bd3-5479550aaf6a None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:33.133281 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c90372-8d69-46fa-9bd3-5479550aaf6a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:33.134271 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c90372-8d69-46fa-9bd3-5479550aaf6a None admin] RBAC: Adding query filter params (role.id=fdad79ffbcbb4fa380dc9cf7dd108618, user.id=f91d83d28d1e4c8e87b40f04a5cc041e, scope.system=all) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:33.134803 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c90372-8d69-46fa-9bd3-5479550aaf6a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:33.137930 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c90372-8d69-46fa-9bd3-5479550aaf6a None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:33.145188 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 141/278] 10.222.0.47 () {56 vars in 1308 bytes} [Wed Aug 31 00:06:32 2022] GET /identity/v3/role_assignments?user.id=f91d83d28d1e4c8e87b40f04a5cc041e&scope.system=all&role.id=fdad79ffbcbb4fa380dc9cf7dd108618 => generated 226 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:06:33.219317 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7429bdc3-413d-4fb4-843c-55b22960ecd6 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:33.263269 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6258d6c1-731a-477c-8437-e7b96f14f936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:33.263908 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6258d6c1-731a-477c-8437-e7b96f14f936 None admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:33.264742 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6258d6c1-731a-477c-8437-e7b96f14f936 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:33.265034 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6258d6c1-731a-477c-8437-e7b96f14f936 None admin] PATH_INFO: `/v3/users` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:33.265782 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6258d6c1-731a-477c-8437-e7b96f14f936 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:33.267281 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6258d6c1-731a-477c-8437-e7b96f14f936 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:33.309752 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 138/279] 10.222.0.47 () {60 vars in 1132 bytes} [Wed Aug 31 00:06:33 2022] POST /identity/v3/users => generated 293 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:06:33.438981 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3331a6e1-ab66-4807-a324-9a46c305ba5d None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:33.439715 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3331a6e1-ab66-4807-a324-9a46c305ba5d None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:33.440255 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3331a6e1-ab66-4807-a324-9a46c305ba5d None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:33.442314 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 142/280] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 00:06:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:06:33.448173 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539b25e1-22f5-498e-aeba-dadfb67a3891 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:33.448521 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539b25e1-22f5-498e-aeba-dadfb67a3891 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:33.448790 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539b25e1-22f5-498e-aeba-dadfb67a3891 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:33.469077 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-539b25e1-22f5-498e-aeba-dadfb67a3891 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:06:33.470298 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-539b25e1-22f5-498e-aeba-dadfb67a3891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:06:33.548185 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:33.581063 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 139/281] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 00:06:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:06:34.109159 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3331a6e1-ab66-4807-a324-9a46c305ba5d None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:34.168226 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:34.258351 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3331a6e1-ab66-4807-a324-9a46c305ba5d None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:34.299862 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a944cf9-3232-4bf9-b0c0-45f20f1796fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:34.300776 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a944cf9-3232-4bf9-b0c0-45f20f1796fd None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:34.301223 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a944cf9-3232-4bf9-b0c0-45f20f1796fd None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:34.301643 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a944cf9-3232-4bf9-b0c0-45f20f1796fd None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:34.317575 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a944cf9-3232-4bf9-b0c0-45f20f1796fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:06:34.323200 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-1a944cf9-3232-4bf9-b0c0-45f20f1796fd None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 00:06:34.323200 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:34.323200 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:06:34.323200 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:06:34.323200 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:06:34.323200 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:06:34.323200 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:06:34.323200 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:06:34.323200 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:06:34.323200 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:06:34.323200 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:06:34.323200 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:06:34.323200 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:06:34.323200 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:06:34.323200 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:06:34.323200 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:06:34.324277 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:06:34.324277 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:06:34.324277 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:06:34.324277 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:06:34.324277 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:06:34.324277 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:06:34.324277 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:06:34.324277 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:06:34.324277 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:06:34.324277 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:06:34.324277 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:06:34.324277 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Aug 31 00:06:34.324277 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:06:34.324277 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:06:34.324277 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:06:34.324277 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:06:34.325887 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:06:34.325887 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:06:34.325887 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:06:34.325887 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:06:34.325887 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:06:34.325887 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:06:34.325887 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:06:34.325887 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:06:34.325887 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:06:34.325887 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:06:34.325887 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 00:06:34.325887 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Aug 31 00:06:34.332254 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 143/282] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 31 00:06:34 2022] GET /identity/v3/roles/reader => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:06:34.338012 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539b25e1-22f5-498e-aeba-dadfb67a3891 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:34.544827 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539b25e1-22f5-498e-aeba-dadfb67a3891 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:34.612422 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e44d725-6e67-4c27-a568-fd160ac62472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:34.613459 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e44d725-6e67-4c27-a568-fd160ac62472 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:34.613935 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e44d725-6e67-4c27-a568-fd160ac62472 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:34.614406 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e44d725-6e67-4c27-a568-fd160ac62472 None admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:34.615766 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e44d725-6e67-4c27-a568-fd160ac62472 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:34.616330 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e44d725-6e67-4c27-a568-fd160ac62472 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:34.618959 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e44d725-6e67-4c27-a568-fd160ac62472 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:34.644137 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 140/283] 10.222.0.47 () {56 vars in 1101 bytes} [Wed Aug 31 00:06:34 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:34.649810 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a944cf9-3232-4bf9-b0c0-45f20f1796fd None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:34.782747 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:34.791208 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a944cf9-3232-4bf9-b0c0-45f20f1796fd None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:34.844685 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b05a7b-1d4a-4ef3-b81a-41fd503b132c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:34.845239 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b05a7b-1d4a-4ef3-b81a-41fd503b132c None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:34.845606 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b05a7b-1d4a-4ef3-b81a-41fd503b132c None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:34.845865 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b05a7b-1d4a-4ef3-b81a-41fd503b132c None admin] PATH_INFO: `/v3/users/f9718aa0023f45e68f491dd9514bf876` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:34.846973 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b05a7b-1d4a-4ef3-b81a-41fd503b132c None admin] RBAC: Authorizing `identity:get_user(user_id=f9718aa0023f45e68f491dd9514bf876)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:34.848466 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b05a7b-1d4a-4ef3-b81a-41fd503b132c None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:34.850430 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 144/284] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 31 00:06:34 2022] GET /identity/v3/users/f9718aa0023f45e68f491dd9514bf876 => generated 297 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:34.857282 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e44d725-6e67-4c27-a568-fd160ac62472 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:34.986480 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:35.083841 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e44d725-6e67-4c27-a568-fd160ac62472 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:35.136124 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acee9aa-7288-4320-a424-542a08ab030e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:35.137543 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acee9aa-7288-4320-a424-542a08ab030e None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:35.137919 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acee9aa-7288-4320-a424-542a08ab030e None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:35.138242 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acee9aa-7288-4320-a424-542a08ab030e None admin] PATH_INFO: `/v3/projects/f605ca29af4949a5a9696ac63a2a2ffc` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:35.139532 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acee9aa-7288-4320-a424-542a08ab030e None admin] RBAC: Authorizing `identity:get_project(project_id=f605ca29af4949a5a9696ac63a2a2ffc)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:35.141065 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acee9aa-7288-4320-a424-542a08ab030e None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:35.143099 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 141/285] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 31 00:06:34 2022] GET /identity/v3/projects/f605ca29af4949a5a9696ac63a2a2ffc => generated 302 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:35.148654 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b05a7b-1d4a-4ef3-b81a-41fd503b132c None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:35.251028 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5625427d-7166-4ad5-84dd-dba9adeb4932 None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:35.251415 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5625427d-7166-4ad5-84dd-dba9adeb4932 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:35.251609 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5625427d-7166-4ad5-84dd-dba9adeb4932 None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:35.253370 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 142/286] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 00:06:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:06:35.269173 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df976f96-54db-4093-9c76-4dbf54d0ca2b None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:35.269532 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df976f96-54db-4093-9c76-4dbf54d0ca2b None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:35.269710 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df976f96-54db-4093-9c76-4dbf54d0ca2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:35.302322 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b05a7b-1d4a-4ef3-b81a-41fd503b132c None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:35.308082 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-df976f96-54db-4093-9c76-4dbf54d0ca2b None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:06:35.309736 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-df976f96-54db-4093-9c76-4dbf54d0ca2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:06:35.361976 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe41820-9171-489b-847b-172ce4829b86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:35.362666 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe41820-9171-489b-847b-172ce4829b86 None admin] REQUEST_METHOD: `PUT` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:35.362947 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe41820-9171-489b-847b-172ce4829b86 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:35.363226 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe41820-9171-489b-847b-172ce4829b86 None admin] PATH_INFO: `/v3/projects/f605ca29af4949a5a9696ac63a2a2ffc/users/f9718aa0023f45e68f491dd9514bf876/roles/4d8eb43f443c46d3aaaf3c515e374839` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:35.365228 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe41820-9171-489b-847b-172ce4829b86 None admin] RBAC: Authorizing `identity:create_grant(project_id=f605ca29af4949a5a9696ac63a2a2ffc, user_id=f9718aa0023f45e68f491dd9514bf876, role_id=4d8eb43f443c46d3aaaf3c515e374839)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:35.366702 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe41820-9171-489b-847b-172ce4829b86 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:35.390157 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 145/287] 10.222.0.47 () {58 vars in 1439 bytes} [Wed Aug 31 00:06:35 2022] PUT /identity/v3/projects/f605ca29af4949a5a9696ac63a2a2ffc/users/f9718aa0023f45e68f491dd9514bf876/roles/4d8eb43f443c46d3aaaf3c515e374839 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:06:35.427730 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 143/288] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 00:06:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:06:35.824595 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe41820-9171-489b-847b-172ce4829b86 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:35.862271 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:35.963938 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65d6227-5bbd-428a-9289-eefde5561b32 None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:35.963938 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65d6227-5bbd-428a-9289-eefde5561b32 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:35.963938 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65d6227-5bbd-428a-9289-eefde5561b32 None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:35.964746 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 144/289] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 00:06:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:06:35.971249 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a160159d-b80c-4d05-98c8-24d581f8ce71 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:35.971844 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a160159d-b80c-4d05-98c8-24d581f8ce71 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:35.972383 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a160159d-b80c-4d05-98c8-24d581f8ce71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:35.978472 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe41820-9171-489b-847b-172ce4829b86 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:35.997816 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-a160159d-b80c-4d05-98c8-24d581f8ce71 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:06:35.999368 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-a160159d-b80c-4d05-98c8-24d581f8ce71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:06:36.036042 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa47f10-4184-4178-a2b7-44d41ba40f07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:36.037467 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa47f10-4184-4178-a2b7-44d41ba40f07 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:36.037766 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa47f10-4184-4178-a2b7-44d41ba40f07 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:36.038026 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa47f10-4184-4178-a2b7-44d41ba40f07 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:36.052632 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:36.055159 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa47f10-4184-4178-a2b7-44d41ba40f07 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:06:36.062113 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-efa47f10-4184-4178-a2b7-44d41ba40f07 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 00:06:36.062113 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:36.062113 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:06:36.062113 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:06:36.062113 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:06:36.062113 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:06:36.062113 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:06:36.062113 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:06:36.062113 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:06:36.062113 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:06:36.062113 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:06:36.062113 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:06:36.062113 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:06:36.062113 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:06:36.062113 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:06:36.062113 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:06:36.063151 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:06:36.063151 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:06:36.063151 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:06:36.063151 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:06:36.063151 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:06:36.063151 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:06:36.063151 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:06:36.063151 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:06:36.063151 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:06:36.063151 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:06:36.063151 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:06:36.063151 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Aug 31 00:06:36.063151 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:06:36.063151 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:06:36.063151 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:06:36.063151 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:06:36.063947 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:06:36.063947 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:06:36.063947 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:06:36.063947 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:06:36.063947 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:06:36.063947 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:06:36.063947 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:06:36.063947 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:06:36.063947 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:06:36.063947 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:06:36.063947 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 00:06:36.063947 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Aug 31 00:06:36.072323 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 146/290] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 31 00:06:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:06:36.075799 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f150063-7912-481e-8478-89a64f8219b5 None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:36.076576 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f150063-7912-481e-8478-89a64f8219b5 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:36.077081 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f150063-7912-481e-8478-89a64f8219b5 None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:36.079972 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 147/291] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 00:06:36 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:06:36.081440 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f150063-7912-481e-8478-89a64f8219b5 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:36.113764 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 145/292] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 00:06:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 00:06:36.115756 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b83d10-7a17-4421-acc3-b46c00645491 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:36.116243 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b83d10-7a17-4421-acc3-b46c00645491 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:36.116835 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b83d10-7a17-4421-acc3-b46c00645491 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:36.142334 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-78b83d10-7a17-4421-acc3-b46c00645491 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:06:36.143945 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-78b83d10-7a17-4421-acc3-b46c00645491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:06:36.198863 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:36.226341 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f150063-7912-481e-8478-89a64f8219b5 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:36.242574 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 146/293] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 00:06:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:06:36.244391 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35463f73-ba32-4cf2-bc9c-a5bd32c6341b None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:36.244862 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35463f73-ba32-4cf2-bc9c-a5bd32c6341b None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:36.245431 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35463f73-ba32-4cf2-bc9c-a5bd32c6341b None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:36.252000 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 147/294] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 00:06:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:06:36.253938 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3004eb-f467-424e-a059-75f31f33df58 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:36.254225 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3004eb-f467-424e-a059-75f31f33df58 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:36.254547 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3004eb-f467-424e-a059-75f31f33df58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:36.276645 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-3f3004eb-f467-424e-a059-75f31f33df58 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:06:36.278537 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-3f3004eb-f467-424e-a059-75f31f33df58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:06:36.283728 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca217080-8803-424d-bfd8-120a93995c0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:36.285023 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca217080-8803-424d-bfd8-120a93995c0d None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:36.285517 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca217080-8803-424d-bfd8-120a93995c0d None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:36.285972 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca217080-8803-424d-bfd8-120a93995c0d None admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:36.286858 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca217080-8803-424d-bfd8-120a93995c0d None admin] RBAC: Adding query filter params (name=member) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:36.288006 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca217080-8803-424d-bfd8-120a93995c0d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:36.290180 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca217080-8803-424d-bfd8-120a93995c0d None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:36.303296 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 148/295] 10.222.0.47 () {56 vars in 1101 bytes} [Wed Aug 31 00:06:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:36.309748 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca217080-8803-424d-bfd8-120a93995c0d None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:36.404434 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 148/296] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 00:06:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:06:36.446741 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3004eb-f467-424e-a059-75f31f33df58 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:36.464538 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca217080-8803-424d-bfd8-120a93995c0d None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:36.507545 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0e1673-bcb6-47a4-8a20-1e7dcbaa3d2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:36.510224 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0e1673-bcb6-47a4-8a20-1e7dcbaa3d2a None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:36.510511 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0e1673-bcb6-47a4-8a20-1e7dcbaa3d2a None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:36.510788 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0e1673-bcb6-47a4-8a20-1e7dcbaa3d2a None admin] PATH_INFO: `/v3/users/4f267825f3fa463cbeca723e0f2d5fac` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:36.512398 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:36.516424 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0e1673-bcb6-47a4-8a20-1e7dcbaa3d2a None admin] RBAC: Authorizing `identity:get_user(user_id=4f267825f3fa463cbeca723e0f2d5fac)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:36.523939 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0e1673-bcb6-47a4-8a20-1e7dcbaa3d2a None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:36.526012 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 149/297] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 31 00:06:36 2022] GET /identity/v3/users/4f267825f3fa463cbeca723e0f2d5fac => generated 297 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:06:36.532894 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0e1673-bcb6-47a4-8a20-1e7dcbaa3d2a None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:36.565892 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:36.641744 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3004eb-f467-424e-a059-75f31f33df58 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:36.678324 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7803b1-3d63-47d1-8d17-6b58e21e0b71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:36.678948 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7803b1-3d63-47d1-8d17-6b58e21e0b71 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:36.679227 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7803b1-3d63-47d1-8d17-6b58e21e0b71 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:36.679501 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7803b1-3d63-47d1-8d17-6b58e21e0b71 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:36.686178 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0e1673-bcb6-47a4-8a20-1e7dcbaa3d2a None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:36.691441 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7803b1-3d63-47d1-8d17-6b58e21e0b71 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:06:36.696437 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-2a7803b1-3d63-47d1-8d17-6b58e21e0b71 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 00:06:36.696437 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:36.696437 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:06:36.696437 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:06:36.696437 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:06:36.696437 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:06:36.696437 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:06:36.696437 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:06:36.696437 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:06:36.696437 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:06:36.696437 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:06:36.696437 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:06:36.696437 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:06:36.696437 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:06:36.696437 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:06:36.696437 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:06:36.697506 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:06:36.697506 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:06:36.697506 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:06:36.697506 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:06:36.697506 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:06:36.697506 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:06:36.697506 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:06:36.697506 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:06:36.697506 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:06:36.697506 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:06:36.697506 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:06:36.697506 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 31 00:06:36.697506 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:06:36.697506 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:06:36.697506 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:06:36.697506 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:06:36.698649 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:06:36.698649 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:06:36.698649 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:06:36.698649 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:06:36.698649 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:06:36.698649 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:06:36.698649 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:06:36.698649 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:06:36.698649 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:06:36.698649 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:06:36.698649 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 00:06:36.698649 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 31 00:06:36.698649 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 149/298] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 31 00:06:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:06:36.699524 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7803b1-3d63-47d1-8d17-6b58e21e0b71 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:36.729044 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3520aa-09ca-45ec-a47c-16f7ad0da726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:36.729660 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3520aa-09ca-45ec-a47c-16f7ad0da726 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:36.729945 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3520aa-09ca-45ec-a47c-16f7ad0da726 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:36.730216 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3520aa-09ca-45ec-a47c-16f7ad0da726 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:36.803942 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:36.809229 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3520aa-09ca-45ec-a47c-16f7ad0da726 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:36.811352 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3520aa-09ca-45ec-a47c-16f7ad0da726 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:36.813697 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7803b1-3d63-47d1-8d17-6b58e21e0b71 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:36.831563 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:36.858246 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee07d90-56a1-48c0-b1d5-8a4bde452ef8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:36.859042 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee07d90-56a1-48c0-b1d5-8a4bde452ef8 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:36.859413 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee07d90-56a1-48c0-b1d5-8a4bde452ef8 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:36.859781 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee07d90-56a1-48c0-b1d5-8a4bde452ef8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:36.871361 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee07d90-56a1-48c0-b1d5-8a4bde452ef8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:06:36.876621 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-eee07d90-56a1-48c0-b1d5-8a4bde452ef8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 00:06:36.876621 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:36.876621 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:06:36.876621 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:06:36.876621 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:06:36.876621 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:06:36.876621 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:06:36.876621 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:06:36.876621 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:06:36.876621 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:06:36.876621 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:06:36.876621 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:06:36.876621 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:06:36.876621 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:06:36.876621 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:06:36.876621 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:06:36.877715 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:06:36.877715 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:06:36.877715 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:06:36.877715 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:06:36.877715 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:06:36.877715 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:06:36.877715 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:06:36.877715 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:06:36.877715 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:06:36.877715 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:06:36.877715 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:06:36.877715 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 31 00:06:36.877715 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:06:36.877715 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:06:36.877715 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:06:36.877715 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:06:36.878779 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:06:36.878779 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:06:36.878779 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:06:36.878779 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:06:36.878779 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:06:36.878779 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:06:36.878779 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:06:36.878779 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:06:36.878779 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:06:36.878779 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:06:36.878779 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 00:06:36.878779 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 31 00:06:36.878779 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 150/299] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 31 00:06:36 2022] GET /identity/v3/roles/reader => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:06:36.883235 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee07d90-56a1-48c0-b1d5-8a4bde452ef8 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:36.927291 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 150/300] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 31 00:06:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 00:06:36.928015 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3520aa-09ca-45ec-a47c-16f7ad0da726 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:37.001374 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee07d90-56a1-48c0-b1d5-8a4bde452ef8 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:37.040386 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7265531-fc6e-4db0-962e-444897104e1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:37.041386 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7265531-fc6e-4db0-962e-444897104e1f None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:37.041881 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7265531-fc6e-4db0-962e-444897104e1f None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:37.042250 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7265531-fc6e-4db0-962e-444897104e1f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:37.044240 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7265531-fc6e-4db0-962e-444897104e1f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:37.045240 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3520aa-09ca-45ec-a47c-16f7ad0da726 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:37.045947 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7265531-fc6e-4db0-962e-444897104e1f None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:37.047814 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 151/301] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 00:06:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:37.048914 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7265531-fc6e-4db0-962e-444897104e1f None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:37.069391 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:37.071990 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:37.088944 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e608a0-41ec-4c9d-9607-a04aa9feec3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:37.089553 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e608a0-41ec-4c9d-9607-a04aa9feec3a None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:37.090501 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e608a0-41ec-4c9d-9607-a04aa9feec3a None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:37.090731 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e608a0-41ec-4c9d-9607-a04aa9feec3a None admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:37.091512 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e608a0-41ec-4c9d-9607-a04aa9feec3a None admin] RBAC: Adding query filter params (name=member) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:37.091807 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e608a0-41ec-4c9d-9607-a04aa9feec3a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:37.093236 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e608a0-41ec-4c9d-9607-a04aa9feec3a None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:37.114411 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 151/302] 10.222.0.47 () {56 vars in 1101 bytes} [Wed Aug 31 00:06:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:37.114411 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e608a0-41ec-4c9d-9607-a04aa9feec3a None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:37.166239 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7265531-fc6e-4db0-962e-444897104e1f None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:37.206106 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5a2950-c863-41a4-800b-e5b78fdf736c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:37.206867 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5a2950-c863-41a4-800b-e5b78fdf736c None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:37.207140 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5a2950-c863-41a4-800b-e5b78fdf736c None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:37.207414 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5a2950-c863-41a4-800b-e5b78fdf736c None admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:37.208223 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5a2950-c863-41a4-800b-e5b78fdf736c None admin] RBAC: Adding query filter params (name=reader) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:37.208533 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5a2950-c863-41a4-800b-e5b78fdf736c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:37.210045 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5a2950-c863-41a4-800b-e5b78fdf736c None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:37.217013 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e608a0-41ec-4c9d-9607-a04aa9feec3a None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:37.220015 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 152/303] 10.222.0.47 () {56 vars in 1101 bytes} [Wed Aug 31 00:06:37 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:37.224958 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5a2950-c863-41a4-800b-e5b78fdf736c None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:37.256664 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a7e2d6-b910-4a53-8f6d-6070f40d8534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:37.257325 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a7e2d6-b910-4a53-8f6d-6070f40d8534 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:37.257597 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a7e2d6-b910-4a53-8f6d-6070f40d8534 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:37.257870 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a7e2d6-b910-4a53-8f6d-6070f40d8534 None admin] PATH_INFO: `/v3/projects/f605ca29af4949a5a9696ac63a2a2ffc` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:37.258990 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a7e2d6-b910-4a53-8f6d-6070f40d8534 None admin] RBAC: Authorizing `identity:get_project(project_id=f605ca29af4949a5a9696ac63a2a2ffc)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:37.260478 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a7e2d6-b910-4a53-8f6d-6070f40d8534 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:37.262373 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 152/304] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 31 00:06:37 2022] GET /identity/v3/projects/f605ca29af4949a5a9696ac63a2a2ffc => generated 302 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:37.263095 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a7e2d6-b910-4a53-8f6d-6070f40d8534 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:37.319627 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:37.331936 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:37.352598 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5a2950-c863-41a4-800b-e5b78fdf736c None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:37.377128 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a7e2d6-b910-4a53-8f6d-6070f40d8534 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:37.389370 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6908e8cd-90db-45b5-ab95-19f91d5f0a3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:37.389985 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6908e8cd-90db-45b5-ab95-19f91d5f0a3c None admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:37.390261 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6908e8cd-90db-45b5-ab95-19f91d5f0a3c None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:37.390535 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6908e8cd-90db-45b5-ab95-19f91d5f0a3c None admin] PATH_INFO: `/v3/groups` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:37.391157 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6908e8cd-90db-45b5-ab95-19f91d5f0a3c None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:37.392642 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6908e8cd-90db-45b5-ab95-19f91d5f0a3c None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:37.410154 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 153/305] 10.222.0.47 () {60 vars in 1134 bytes} [Wed Aug 31 00:06:37 2022] POST /identity/v3/groups => generated 229 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:06:37.410864 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6908e8cd-90db-45b5-ab95-19f91d5f0a3c None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:37.425256 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f84f65d-d24c-4596-854b-76f2d7d69c6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:37.426257 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f84f65d-d24c-4596-854b-76f2d7d69c6c None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:37.427222 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f84f65d-d24c-4596-854b-76f2d7d69c6c None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:37.428095 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f84f65d-d24c-4596-854b-76f2d7d69c6c None admin] PATH_INFO: `/v3/users/f91d83d28d1e4c8e87b40f04a5cc041e` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:37.429958 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f84f65d-d24c-4596-854b-76f2d7d69c6c None admin] RBAC: Authorizing `identity:get_user(user_id=f91d83d28d1e4c8e87b40f04a5cc041e)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:37.432723 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f84f65d-d24c-4596-854b-76f2d7d69c6c None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:37.436981 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 153/306] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 31 00:06:37 2022] GET /identity/v3/users/f91d83d28d1e4c8e87b40f04a5cc041e => generated 293 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:37.438110 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f84f65d-d24c-4596-854b-76f2d7d69c6c None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:37.556425 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6908e8cd-90db-45b5-ab95-19f91d5f0a3c None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:37.604667 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a46de6-a5fc-4680-9034-0fd03ab8363e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:37.605161 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f84f65d-d24c-4596-854b-76f2d7d69c6c None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:37.606394 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a46de6-a5fc-4680-9034-0fd03ab8363e None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:37.606750 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a46de6-a5fc-4680-9034-0fd03ab8363e None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:37.607070 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a46de6-a5fc-4680-9034-0fd03ab8363e None admin] PATH_INFO: `/v3/users/a04ba9aad72e4a41946956a94bdcb988` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:37.625715 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:37.627557 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:37.630403 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a46de6-a5fc-4680-9034-0fd03ab8363e None admin] RBAC: Authorizing `identity:get_user(user_id=a04ba9aad72e4a41946956a94bdcb988)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:37.632027 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a46de6-a5fc-4680-9034-0fd03ab8363e None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:37.635328 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 154/307] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 31 00:06:37 2022] GET /identity/v3/users/a04ba9aad72e4a41946956a94bdcb988 => generated 293 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:37.641874 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a46de6-a5fc-4680-9034-0fd03ab8363e None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:37.649390 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead92a42-6dc7-4256-9718-8085eaf579b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:37.650201 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead92a42-6dc7-4256-9718-8085eaf579b3 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:37.650573 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead92a42-6dc7-4256-9718-8085eaf579b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:37.650942 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead92a42-6dc7-4256-9718-8085eaf579b3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:37.651832 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead92a42-6dc7-4256-9718-8085eaf579b3 None admin] RBAC: Adding query filter params (role.id=fdad79ffbcbb4fa380dc9cf7dd108618, scope.project.id=f605ca29af4949a5a9696ac63a2a2ffc, user.id=4f267825f3fa463cbeca723e0f2d5fac) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:37.652799 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead92a42-6dc7-4256-9718-8085eaf579b3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:37.654392 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead92a42-6dc7-4256-9718-8085eaf579b3 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:37.661741 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 154/308] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 31 00:06:37 2022] GET /identity/v3/role_assignments?user.id=4f267825f3fa463cbeca723e0f2d5fac&scope.project.id=f605ca29af4949a5a9696ac63a2a2ffc&role.id=fdad79ffbcbb4fa380dc9cf7dd108618 => generated 608 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:37.662766 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead92a42-6dc7-4256-9718-8085eaf579b3 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:37.784571 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a46de6-a5fc-4680-9034-0fd03ab8363e None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:37.828003 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c037ddbe-ca17-4858-8661-89145f4f932d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:37.828950 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c037ddbe-ca17-4858-8661-89145f4f932d None admin] REQUEST_METHOD: `PUT` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:37.829362 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c037ddbe-ca17-4858-8661-89145f4f932d None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:37.829760 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c037ddbe-ca17-4858-8661-89145f4f932d None admin] PATH_INFO: `/v3/system/users/f91d83d28d1e4c8e87b40f04a5cc041e/roles/fdad79ffbcbb4fa380dc9cf7dd108618` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:37.831441 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c037ddbe-ca17-4858-8661-89145f4f932d None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=f91d83d28d1e4c8e87b40f04a5cc041e, role_id=fdad79ffbcbb4fa380dc9cf7dd108618)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:37.833049 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c037ddbe-ca17-4858-8661-89145f4f932d None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:37.846300 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 155/309] 10.222.0.47 () {58 vars in 1334 bytes} [Wed Aug 31 00:06:37 2022] PUT /identity/v3/system/users/f91d83d28d1e4c8e87b40f04a5cc041e/roles/fdad79ffbcbb4fa380dc9cf7dd108618 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:06:37.866255 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda64984-a554-46eb-b50e-f6d6a0f6172f None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:37.866785 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda64984-a554-46eb-b50e-f6d6a0f6172f None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:37.867203 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda64984-a554-46eb-b50e-f6d6a0f6172f None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:37.868809 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 156/310] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 00:06:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 00:06:37.875087 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14cbb60-13ca-4d1d-a9c2-4ce7e4572c07 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:37.875606 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14cbb60-13ca-4d1d-a9c2-4ce7e4572c07 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:37.876025 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14cbb60-13ca-4d1d-a9c2-4ce7e4572c07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:37.879108 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead92a42-6dc7-4256-9718-8085eaf579b3 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:37.896129 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-f14cbb60-13ca-4d1d-a9c2-4ce7e4572c07 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:06:37.897651 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-f14cbb60-13ca-4d1d-a9c2-4ce7e4572c07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:06:37.920962 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea98848-bd25-4781-b426-1af79392db79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:37.921590 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea98848-bd25-4781-b426-1af79392db79 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:37.921865 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea98848-bd25-4781-b426-1af79392db79 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:37.922141 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea98848-bd25-4781-b426-1af79392db79 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:37.922883 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea98848-bd25-4781-b426-1af79392db79 None admin] RBAC: Adding query filter params (role.id=4d8eb43f443c46d3aaaf3c515e374839, user.id=a04ba9aad72e4a41946956a94bdcb988, scope.system=all) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:37.923369 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea98848-bd25-4781-b426-1af79392db79 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:37.924765 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea98848-bd25-4781-b426-1af79392db79 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:37.930869 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 155/311] 10.222.0.47 () {56 vars in 1308 bytes} [Wed Aug 31 00:06:37 2022] GET /identity/v3/role_assignments?user.id=a04ba9aad72e4a41946956a94bdcb988&scope.system=all&role.id=4d8eb43f443c46d3aaaf3c515e374839 => generated 226 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:37.990700 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:38.013677 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 157/312] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 00:06:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 00:06:38.298507 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea98848-bd25-4781-b426-1af79392db79 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:38.349238 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:38.409793 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea98848-bd25-4781-b426-1af79392db79 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:38.446138 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34273aba-b6b0-464a-9ef1-10edae00b67f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:38.446782 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34273aba-b6b0-464a-9ef1-10edae00b67f None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:38.447062 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34273aba-b6b0-464a-9ef1-10edae00b67f None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:38.447338 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34273aba-b6b0-464a-9ef1-10edae00b67f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:38.458432 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34273aba-b6b0-464a-9ef1-10edae00b67f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:06:38.463959 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-34273aba-b6b0-464a-9ef1-10edae00b67f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 00:06:38.463959 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:38.463959 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:06:38.463959 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:06:38.463959 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:06:38.463959 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:06:38.463959 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:06:38.463959 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:06:38.463959 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:06:38.463959 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:06:38.463959 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:06:38.463959 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:06:38.463959 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:06:38.463959 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:06:38.463959 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:06:38.463959 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:06:38.465585 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:06:38.465585 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:06:38.465585 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:06:38.465585 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:06:38.465585 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:06:38.465585 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:06:38.465585 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:06:38.465585 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:06:38.465585 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:06:38.465585 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:06:38.465585 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:06:38.465585 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Aug 31 00:06:38.465585 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:06:38.465585 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:06:38.465585 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:06:38.465585 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:06:38.466891 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:06:38.466891 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:06:38.466891 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:06:38.466891 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:06:38.466891 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:06:38.466891 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:06:38.466891 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:06:38.466891 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:06:38.466891 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:06:38.466891 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:06:38.466891 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 00:06:38.466891 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Aug 31 00:06:38.466891 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 156/313] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 31 00:06:38 2022] GET /identity/v3/roles/reader => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:06:38.471961 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14cbb60-13ca-4d1d-a9c2-4ce7e4572c07 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:38.586289 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14cbb60-13ca-4d1d-a9c2-4ce7e4572c07 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:38.625885 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a860cd4-162a-4f3b-9c77-8e3fd051ef8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:38.626870 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a860cd4-162a-4f3b-9c77-8e3fd051ef8f None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:38.627370 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a860cd4-162a-4f3b-9c77-8e3fd051ef8f None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:38.627835 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a860cd4-162a-4f3b-9c77-8e3fd051ef8f None admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:38.628742 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a860cd4-162a-4f3b-9c77-8e3fd051ef8f None admin] RBAC: Adding query filter params (name=reader) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:38.629266 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a860cd4-162a-4f3b-9c77-8e3fd051ef8f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:38.630969 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a860cd4-162a-4f3b-9c77-8e3fd051ef8f None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:38.640997 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 158/314] 10.222.0.47 () {56 vars in 1101 bytes} [Wed Aug 31 00:06:38 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:38.646324 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34273aba-b6b0-464a-9ef1-10edae00b67f None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:38.759691 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34273aba-b6b0-464a-9ef1-10edae00b67f None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:38.762815 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:38.796947 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804a5ecd-0c60-45cf-88ae-4dbbf7b8099e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:38.797597 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804a5ecd-0c60-45cf-88ae-4dbbf7b8099e None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:38.797879 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804a5ecd-0c60-45cf-88ae-4dbbf7b8099e None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:38.798154 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804a5ecd-0c60-45cf-88ae-4dbbf7b8099e None admin] PATH_INFO: `/v3/users/f9718aa0023f45e68f491dd9514bf876` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:38.799293 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804a5ecd-0c60-45cf-88ae-4dbbf7b8099e None admin] RBAC: Authorizing `identity:get_user(user_id=f9718aa0023f45e68f491dd9514bf876)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:38.800790 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804a5ecd-0c60-45cf-88ae-4dbbf7b8099e None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:38.802621 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 157/315] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 31 00:06:38 2022] GET /identity/v3/users/f9718aa0023f45e68f491dd9514bf876 => generated 297 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:38.808092 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a860cd4-162a-4f3b-9c77-8e3fd051ef8f None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:38.878613 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:38.928619 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a860cd4-162a-4f3b-9c77-8e3fd051ef8f None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:38.966961 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422f84f6-cd56-4f6a-92d1-127e77a68903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:38.967591 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422f84f6-cd56-4f6a-92d1-127e77a68903 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:38.967875 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422f84f6-cd56-4f6a-92d1-127e77a68903 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:38.968184 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422f84f6-cd56-4f6a-92d1-127e77a68903 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:39.047923 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422f84f6-cd56-4f6a-92d1-127e77a68903 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:39.049748 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422f84f6-cd56-4f6a-92d1-127e77a68903 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:39.114386 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:39.171355 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 159/316] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 31 00:06:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 00:06:39.177467 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804a5ecd-0c60-45cf-88ae-4dbbf7b8099e None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:39.297681 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804a5ecd-0c60-45cf-88ae-4dbbf7b8099e None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:39.334216 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39397563-8659-46eb-9777-716dcbe407cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:39.335596 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39397563-8659-46eb-9777-716dcbe407cc None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:39.336061 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39397563-8659-46eb-9777-716dcbe407cc None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:39.336547 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39397563-8659-46eb-9777-716dcbe407cc None admin] PATH_INFO: `/v3/projects/f605ca29af4949a5a9696ac63a2a2ffc` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:39.337929 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39397563-8659-46eb-9777-716dcbe407cc None admin] RBAC: Authorizing `identity:get_project(project_id=f605ca29af4949a5a9696ac63a2a2ffc)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:39.339545 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39397563-8659-46eb-9777-716dcbe407cc None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:39.341727 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 158/317] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 31 00:06:39 2022] GET /identity/v3/projects/f605ca29af4949a5a9696ac63a2a2ffc => generated 302 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:06:39.347944 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422f84f6-cd56-4f6a-92d1-127e77a68903 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:39.461498 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422f84f6-cd56-4f6a-92d1-127e77a68903 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:39.501474 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea1e4e6-5152-4a30-a7f1-f8d75253e705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:39.502096 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea1e4e6-5152-4a30-a7f1-f8d75253e705 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:39.502375 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea1e4e6-5152-4a30-a7f1-f8d75253e705 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:39.502645 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea1e4e6-5152-4a30-a7f1-f8d75253e705 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:39.503376 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea1e4e6-5152-4a30-a7f1-f8d75253e705 None admin] RBAC: Adding query filter params (role.id=4d8eb43f443c46d3aaaf3c515e374839, scope.project.id=f605ca29af4949a5a9696ac63a2a2ffc, user.id=f9718aa0023f45e68f491dd9514bf876) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:39.503682 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea1e4e6-5152-4a30-a7f1-f8d75253e705 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:39.507045 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea1e4e6-5152-4a30-a7f1-f8d75253e705 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:39.516592 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 160/318] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 31 00:06:39 2022] GET /identity/v3/role_assignments?user.id=f9718aa0023f45e68f491dd9514bf876&scope.project.id=f605ca29af4949a5a9696ac63a2a2ffc&role.id=4d8eb43f443c46d3aaaf3c515e374839 => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:39.646130 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4a89ac-2e1c-4b7f-a4ca-8362d343e0e0 None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:39.646408 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4a89ac-2e1c-4b7f-a4ca-8362d343e0e0 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:39.646683 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4a89ac-2e1c-4b7f-a4ca-8362d343e0e0 None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:39.648366 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 159/319] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 00:06:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:06:39.654649 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ec417e-bdc1-47f1-a0a0-54e7ab5398bf None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:39.655164 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ec417e-bdc1-47f1-a0a0-54e7ab5398bf None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:39.655251 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ec417e-bdc1-47f1-a0a0-54e7ab5398bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:39.674634 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-d4ec417e-bdc1-47f1-a0a0-54e7ab5398bf None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:06:39.675901 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-d4ec417e-bdc1-47f1-a0a0-54e7ab5398bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:06:39.691968 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:39.752463 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 161/320] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 00:06:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:06:39.982345 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fa4600-87ae-4786-8386-cb0923a4ab75 None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:39.982626 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fa4600-87ae-4786-8386-cb0923a4ab75 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:39.982906 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fa4600-87ae-4786-8386-cb0923a4ab75 None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:39.984543 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 160/321] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 00:06:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 00:06:39.989958 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaefd54-a4b2-468a-ade3-1e3371727ae1 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:39.990248 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaefd54-a4b2-468a-ade3-1e3371727ae1 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:39.990522 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaefd54-a4b2-468a-ade3-1e3371727ae1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:40.009948 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-4aaefd54-a4b2-468a-ade3-1e3371727ae1 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:06:40.011070 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-4aaefd54-a4b2-468a-ade3-1e3371727ae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:06:40.025136 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fa4600-87ae-4786-8386-cb0923a4ab75 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:40.072670 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:40.096363 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 162/322] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 00:06:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:06:40.143641 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fa4600-87ae-4786-8386-cb0923a4ab75 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:40.181114 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b21b090-9c27-4d0c-a61b-4053e8908fd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:40.181998 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b21b090-9c27-4d0c-a61b-4053e8908fd1 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:40.182436 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b21b090-9c27-4d0c-a61b-4053e8908fd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:40.182845 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b21b090-9c27-4d0c-a61b-4053e8908fd1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:40.184756 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b21b090-9c27-4d0c-a61b-4053e8908fd1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:40.186623 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b21b090-9c27-4d0c-a61b-4053e8908fd1 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:40.188694 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 161/323] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 00:06:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:06:40.194197 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaefd54-a4b2-468a-ade3-1e3371727ae1 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:40.223008 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19526b4f-a020-4f33-a4b0-943a23fcb98d None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:40.223355 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19526b4f-a020-4f33-a4b0-943a23fcb98d None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:40.223809 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19526b4f-a020-4f33-a4b0-943a23fcb98d None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:40.225235 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 162/324] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 00:06:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 00:06:40.231510 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8b3154-1dd7-4fc8-a96f-e5c35ff68bed None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:40.231999 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8b3154-1dd7-4fc8-a96f-e5c35ff68bed None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:40.232310 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8b3154-1dd7-4fc8-a96f-e5c35ff68bed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:40.251263 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-5a8b3154-1dd7-4fc8-a96f-e5c35ff68bed None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:06:40.252543 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-5a8b3154-1dd7-4fc8-a96f-e5c35ff68bed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:06:40.293283 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:40.322681 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaefd54-a4b2-468a-ade3-1e3371727ae1 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:40.346137 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 163/325] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 00:06:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:06:40.370014 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8b3154-1dd7-4fc8-a96f-e5c35ff68bed None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:40.371775 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8842028c-67ca-4253-81a2-c03adcd80adf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:40.372569 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8842028c-67ca-4253-81a2-c03adcd80adf None admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:40.372955 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8842028c-67ca-4253-81a2-c03adcd80adf None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:40.373307 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8842028c-67ca-4253-81a2-c03adcd80adf None admin] PATH_INFO: `/v3/groups` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:40.374112 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8842028c-67ca-4253-81a2-c03adcd80adf None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:40.376580 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8842028c-67ca-4253-81a2-c03adcd80adf None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:40.408189 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 163/326] 10.222.0.47 () {60 vars in 1134 bytes} [Wed Aug 31 00:06:40 2022] POST /identity/v3/groups => generated 226 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:06:40.435642 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:40.520189 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8b3154-1dd7-4fc8-a96f-e5c35ff68bed None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:40.560754 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac88ded9-ae89-4cdc-8834-616b7639fc6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:40.561326 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac88ded9-ae89-4cdc-8834-616b7639fc6f None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:40.561634 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac88ded9-ae89-4cdc-8834-616b7639fc6f None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:40.561908 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac88ded9-ae89-4cdc-8834-616b7639fc6f None admin] PATH_INFO: `/v3/roles/member` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:40.573122 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac88ded9-ae89-4cdc-8834-616b7639fc6f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:06:40.578740 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-ac88ded9-ae89-4cdc-8834-616b7639fc6f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 00:06:40.578740 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:40.578740 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:06:40.578740 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:06:40.578740 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:06:40.578740 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:06:40.578740 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:06:40.578740 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:06:40.578740 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:06:40.578740 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:06:40.578740 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:06:40.578740 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:06:40.578740 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:06:40.578740 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:06:40.578740 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:06:40.578740 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:06:40.579621 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:06:40.579621 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:06:40.579621 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:06:40.579621 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:06:40.579621 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:06:40.579621 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:06:40.579621 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:06:40.579621 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:06:40.579621 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:06:40.579621 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:06:40.579621 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:06:40.579621 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Aug 31 00:06:40.579621 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:06:40.579621 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:06:40.579621 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:06:40.579621 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:06:40.580489 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:06:40.580489 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:06:40.580489 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:06:40.580489 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:06:40.580489 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:06:40.580489 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:06:40.580489 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:06:40.580489 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:06:40.580489 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:06:40.580489 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:06:40.580489 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 00:06:40.580489 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Aug 31 00:06:40.580489 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 164/327] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 31 00:06:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:06:40.585694 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8842028c-67ca-4253-81a2-c03adcd80adf None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:40.626414 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac88ded9-ae89-4cdc-8834-616b7639fc6f None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:40.755345 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8842028c-67ca-4253-81a2-c03adcd80adf None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:40.782554 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:40.792322 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac88ded9-ae89-4cdc-8834-616b7639fc6f None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:40.811410 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3394982d-9a09-4acb-aa45-f706dc118b17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:40.811951 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3394982d-9a09-4acb-aa45-f706dc118b17 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:40.812259 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3394982d-9a09-4acb-aa45-f706dc118b17 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:40.812527 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3394982d-9a09-4acb-aa45-f706dc118b17 None admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:40.813200 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3394982d-9a09-4acb-aa45-f706dc118b17 None admin] RBAC: Adding query filter params (name=member) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:40.813732 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3394982d-9a09-4acb-aa45-f706dc118b17 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:40.814899 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3394982d-9a09-4acb-aa45-f706dc118b17 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:40.826730 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 164/328] 10.222.0.47 () {56 vars in 1101 bytes} [Wed Aug 31 00:06:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:40.833141 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3394982d-9a09-4acb-aa45-f706dc118b17 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:40.836881 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:40.857252 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdfa370-9c14-4ad5-a1f6-0311a9aed8d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:40.858829 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdfa370-9c14-4ad5-a1f6-0311a9aed8d0 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:40.859569 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdfa370-9c14-4ad5-a1f6-0311a9aed8d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:40.860066 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdfa370-9c14-4ad5-a1f6-0311a9aed8d0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:40.874243 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdfa370-9c14-4ad5-a1f6-0311a9aed8d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:06:40.880198 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-6bdfa370-9c14-4ad5-a1f6-0311a9aed8d0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 00:06:40.880198 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:40.880198 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:06:40.880198 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:06:40.880198 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:06:40.880198 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:06:40.880198 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:06:40.880198 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:06:40.880198 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:06:40.880198 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:06:40.880198 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:06:40.880198 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:06:40.880198 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:06:40.880198 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:06:40.880198 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:06:40.880198 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:06:40.881194 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:06:40.881194 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:06:40.881194 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:06:40.881194 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:06:40.881194 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:06:40.881194 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:06:40.881194 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:06:40.881194 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:06:40.881194 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:06:40.881194 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:06:40.881194 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:06:40.881194 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Aug 31 00:06:40.881194 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:06:40.881194 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:06:40.881194 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:06:40.881194 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:06:40.882024 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:06:40.882024 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:06:40.882024 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:06:40.882024 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:06:40.882024 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:06:40.882024 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:06:40.882024 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:06:40.882024 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:06:40.882024 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:06:40.882024 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:06:40.882024 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 00:06:40.882024 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Aug 31 00:06:40.883317 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 165/329] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 31 00:06:40 2022] GET /identity/v3/roles/reader => generated 84 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:06:40.891977 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdfa370-9c14-4ad5-a1f6-0311a9aed8d0 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:41.012931 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3394982d-9a09-4acb-aa45-f706dc118b17 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:41.062063 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e785bba4-c67a-4e52-8365-104f6580241c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:41.062937 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e785bba4-c67a-4e52-8365-104f6580241c None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:41.062937 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e785bba4-c67a-4e52-8365-104f6580241c None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:41.063136 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e785bba4-c67a-4e52-8365-104f6580241c None admin] PATH_INFO: `/v3/users/f91d83d28d1e4c8e87b40f04a5cc041e` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:41.064353 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e785bba4-c67a-4e52-8365-104f6580241c None admin] RBAC: Authorizing `identity:get_user(user_id=f91d83d28d1e4c8e87b40f04a5cc041e)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:41.065822 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e785bba4-c67a-4e52-8365-104f6580241c None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:41.066560 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdfa370-9c14-4ad5-a1f6-0311a9aed8d0 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:41.067683 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 165/330] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 31 00:06:40 2022] GET /identity/v3/users/f91d83d28d1e4c8e87b40f04a5cc041e => generated 293 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:41.073534 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e785bba4-c67a-4e52-8365-104f6580241c None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:41.110679 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081ecb59-ede0-4dc3-a7e9-986f1f6e1991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:41.111702 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081ecb59-ede0-4dc3-a7e9-986f1f6e1991 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:41.112224 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081ecb59-ede0-4dc3-a7e9-986f1f6e1991 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:41.112724 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081ecb59-ede0-4dc3-a7e9-986f1f6e1991 None admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:41.113693 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081ecb59-ede0-4dc3-a7e9-986f1f6e1991 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:41.114250 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081ecb59-ede0-4dc3-a7e9-986f1f6e1991 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:41.116892 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081ecb59-ede0-4dc3-a7e9-986f1f6e1991 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:41.128699 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 166/331] 10.222.0.47 () {56 vars in 1101 bytes} [Wed Aug 31 00:06:40 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:41.144483 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081ecb59-ede0-4dc3-a7e9-986f1f6e1991 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:41.181706 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:41.187904 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:41.222983 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e785bba4-c67a-4e52-8365-104f6580241c None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:41.260756 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7f4cb5-bdf0-47a2-b169-979956057f4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:41.262596 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7f4cb5-bdf0-47a2-b169-979956057f4c None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:41.262596 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7f4cb5-bdf0-47a2-b169-979956057f4c None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:41.262799 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7f4cb5-bdf0-47a2-b169-979956057f4c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:41.263406 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7f4cb5-bdf0-47a2-b169-979956057f4c None admin] RBAC: Adding query filter params (role.id=fdad79ffbcbb4fa380dc9cf7dd108618, user.id=f91d83d28d1e4c8e87b40f04a5cc041e, scope.system=all) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:41.263775 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7f4cb5-bdf0-47a2-b169-979956057f4c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:41.265299 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7f4cb5-bdf0-47a2-b169-979956057f4c None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:41.279506 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 166/332] 10.222.0.47 () {56 vars in 1308 bytes} [Wed Aug 31 00:06:41 2022] GET /identity/v3/role_assignments?user.id=f91d83d28d1e4c8e87b40f04a5cc041e&scope.system=all&role.id=fdad79ffbcbb4fa380dc9cf7dd108618 => generated 510 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:06:41.287860 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081ecb59-ede0-4dc3-a7e9-986f1f6e1991 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:41.345460 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5955b906-6354-478c-8221-50e4084dc0f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:41.346492 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5955b906-6354-478c-8221-50e4084dc0f4 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:41.347087 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5955b906-6354-478c-8221-50e4084dc0f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:41.347465 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5955b906-6354-478c-8221-50e4084dc0f4 None admin] PATH_INFO: `/v3/users/a04ba9aad72e4a41946956a94bdcb988` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:41.350227 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5955b906-6354-478c-8221-50e4084dc0f4 None admin] RBAC: Authorizing `identity:get_user(user_id=a04ba9aad72e4a41946956a94bdcb988)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:41.353236 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5955b906-6354-478c-8221-50e4084dc0f4 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:41.357762 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 167/333] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 31 00:06:41 2022] GET /identity/v3/users/a04ba9aad72e4a41946956a94bdcb988 => generated 293 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:41.367690 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7f4cb5-bdf0-47a2-b169-979956057f4c None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:41.563441 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7f4cb5-bdf0-47a2-b169-979956057f4c None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:41.601376 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:41.614617 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb5464c-2c56-444b-be5e-1e5a43bbc0ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:41.615298 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb5464c-2c56-444b-be5e-1e5a43bbc0ad None admin] REQUEST_METHOD: `PUT` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:41.615578 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb5464c-2c56-444b-be5e-1e5a43bbc0ad None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:41.615856 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb5464c-2c56-444b-be5e-1e5a43bbc0ad None admin] PATH_INFO: `/v3/system/users/a04ba9aad72e4a41946956a94bdcb988/roles/4d8eb43f443c46d3aaaf3c515e374839` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:41.617388 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb5464c-2c56-444b-be5e-1e5a43bbc0ad None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=a04ba9aad72e4a41946956a94bdcb988, role_id=4d8eb43f443c46d3aaaf3c515e374839)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:41.618792 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb5464c-2c56-444b-be5e-1e5a43bbc0ad None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:41.632699 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 167/334] 10.222.0.47 () {58 vars in 1334 bytes} [Wed Aug 31 00:06:41 2022] PUT /identity/v3/system/users/a04ba9aad72e4a41946956a94bdcb988/roles/4d8eb43f443c46d3aaaf3c515e374839 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:06:42.750398 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d78226-426f-450a-9ab0-39b13e410bff None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:42.750961 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d78226-426f-450a-9ab0-39b13e410bff None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:42.751373 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d78226-426f-450a-9ab0-39b13e410bff None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:42.754263 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 168/335] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 00:06:42 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:06:42.760771 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e29db4-11f5-4009-9408-32045d165485 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:42.761287 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e29db4-11f5-4009-9408-32045d165485 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:42.762210 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e29db4-11f5-4009-9408-32045d165485 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:42.799982 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-02e29db4-11f5-4009-9408-32045d165485 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:06:42.802054 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-02e29db4-11f5-4009-9408-32045d165485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:06:42.966302 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 168/336] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 00:06:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:06:43.382652 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d78226-426f-450a-9ab0-39b13e410bff None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:43.552040 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:43.575534 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d78226-426f-450a-9ab0-39b13e410bff None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:43.626950 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1258ce4e-c4d2-42f2-b6cb-7b46ad88054d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:43.627605 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1258ce4e-c4d2-42f2-b6cb-7b46ad88054d None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:43.627883 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1258ce4e-c4d2-42f2-b6cb-7b46ad88054d None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:43.628341 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1258ce4e-c4d2-42f2-b6cb-7b46ad88054d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:43.641624 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1258ce4e-c4d2-42f2-b6cb-7b46ad88054d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:06:43.647268 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-1258ce4e-c4d2-42f2-b6cb-7b46ad88054d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 00:06:43.647268 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:43.647268 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:06:43.647268 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:06:43.647268 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:06:43.647268 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:06:43.647268 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:06:43.647268 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:06:43.647268 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:06:43.647268 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:06:43.647268 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:06:43.647268 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:06:43.647268 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:06:43.647268 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:06:43.647268 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:06:43.647268 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:06:43.648396 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:06:43.648396 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:06:43.648396 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:06:43.648396 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:06:43.648396 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:06:43.648396 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:06:43.648396 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:06:43.648396 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:06:43.648396 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:06:43.648396 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:06:43.648396 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:06:43.648396 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Aug 31 00:06:43.648396 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:06:43.648396 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:06:43.648396 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:06:43.648396 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:06:43.649401 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:06:43.649401 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:06:43.649401 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:06:43.649401 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:06:43.649401 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:06:43.649401 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:06:43.649401 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:06:43.649401 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:06:43.649401 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:06:43.649401 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:06:43.649401 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 00:06:43.649401 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Aug 31 00:06:43.653639 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 169/337] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 31 00:06:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:06:43.658542 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e29db4-11f5-4009-9408-32045d165485 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:43.812527 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e29db4-11f5-4009-9408-32045d165485 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:43.846258 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:43.870488 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15b850d-1c82-4027-8f09-2562bc7ed620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:43.871596 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15b850d-1c82-4027-8f09-2562bc7ed620 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:43.872102 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15b850d-1c82-4027-8f09-2562bc7ed620 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:43.872627 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15b850d-1c82-4027-8f09-2562bc7ed620 None admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:43.873900 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15b850d-1c82-4027-8f09-2562bc7ed620 None admin] RBAC: Adding query filter params (name=member) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:43.874457 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15b850d-1c82-4027-8f09-2562bc7ed620 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:43.877261 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15b850d-1c82-4027-8f09-2562bc7ed620 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:43.900601 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 169/338] 10.222.0.47 () {56 vars in 1101 bytes} [Wed Aug 31 00:06:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:43.906459 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1258ce4e-c4d2-42f2-b6cb-7b46ad88054d None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:44.071647 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1258ce4e-c4d2-42f2-b6cb-7b46ad88054d None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:44.120690 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b889998-4c84-4289-a6e5-807519d47b63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:44.121669 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b889998-4c84-4289-a6e5-807519d47b63 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:44.121953 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b889998-4c84-4289-a6e5-807519d47b63 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:44.122352 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b889998-4c84-4289-a6e5-807519d47b63 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:44.153262 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:44.213877 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b889998-4c84-4289-a6e5-807519d47b63 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:44.216728 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b889998-4c84-4289-a6e5-807519d47b63 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:44.350225 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 170/339] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 31 00:06:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 00:06:44.357022 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15b850d-1c82-4027-8f09-2562bc7ed620 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:44.491764 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcda1e6-e45d-4aca-82be-dd7ce725b18a None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:44.492184 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcda1e6-e45d-4aca-82be-dd7ce725b18a None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:44.492664 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcda1e6-e45d-4aca-82be-dd7ce725b18a None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:44.498445 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 171/340] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 00:06:44 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:06:44.507511 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5014a5-8f0d-4e73-a1a1-f6c95342f13f None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:44.507966 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5014a5-8f0d-4e73-a1a1-f6c95342f13f None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:44.508501 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5014a5-8f0d-4e73-a1a1-f6c95342f13f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:44.540041 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15b850d-1c82-4027-8f09-2562bc7ed620 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:44.562840 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-4a5014a5-8f0d-4e73-a1a1-f6c95342f13f None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:06:44.565003 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-4a5014a5-8f0d-4e73-a1a1-f6c95342f13f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:06:44.621679 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a418715c-4682-4804-b9dc-b8254bb44b51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:44.622819 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a418715c-4682-4804-b9dc-b8254bb44b51 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:44.623335 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a418715c-4682-4804-b9dc-b8254bb44b51 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:44.623816 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a418715c-4682-4804-b9dc-b8254bb44b51 None admin] PATH_INFO: `/v3/projects/24b0845707914a1f9ffa3665e80a3533` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:44.625417 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a418715c-4682-4804-b9dc-b8254bb44b51 None admin] RBAC: Authorizing `identity:get_project(project_id=24b0845707914a1f9ffa3665e80a3533)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:44.627228 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a418715c-4682-4804-b9dc-b8254bb44b51 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:44.629659 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 170/341] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 31 00:06:44 2022] GET /identity/v3/projects/24b0845707914a1f9ffa3665e80a3533 => generated 298 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:44.635381 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a418715c-4682-4804-b9dc-b8254bb44b51 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:44.687331 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:44.749849 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:44.760272 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 172/342] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 00:06:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:06:44.794678 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143920c0-ab0f-4ee6-9109-83271f85ea4e None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:44.794991 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143920c0-ab0f-4ee6-9109-83271f85ea4e None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:44.795231 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143920c0-ab0f-4ee6-9109-83271f85ea4e None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:44.796675 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 173/343] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 00:06:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 00:06:44.803943 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5041fb4e-c4b1-4d2d-b63a-90f9a1e4c22c None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:44.804272 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5041fb4e-c4b1-4d2d-b63a-90f9a1e4c22c None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:44.804544 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5041fb4e-c4b1-4d2d-b63a-90f9a1e4c22c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:44.837072 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-5041fb4e-c4b1-4d2d-b63a-90f9a1e4c22c None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:06:44.838275 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-5041fb4e-c4b1-4d2d-b63a-90f9a1e4c22c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:06:44.862475 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a418715c-4682-4804-b9dc-b8254bb44b51 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:44.927307 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f36899a-0162-4dfb-a654-8940990b50e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:44.927962 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f36899a-0162-4dfb-a654-8940990b50e0 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:44.928279 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f36899a-0162-4dfb-a654-8940990b50e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:44.928553 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f36899a-0162-4dfb-a654-8940990b50e0 None admin] PATH_INFO: `/v3/groups/29c1333f63bd4988954525f39dfa8922` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:44.947458 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f36899a-0162-4dfb-a654-8940990b50e0 None admin] RBAC: Authorizing `identity:get_group(group_id=29c1333f63bd4988954525f39dfa8922)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:44.949566 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f36899a-0162-4dfb-a654-8940990b50e0 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:44.951954 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 171/344] 10.222.0.47 () {56 vars in 1180 bytes} [Wed Aug 31 00:06:44 2022] GET /identity/v3/groups/29c1333f63bd4988954525f39dfa8922 => generated 226 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:06:44.977255 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f36899a-0162-4dfb-a654-8940990b50e0 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:45.026883 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 174/345] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 00:06:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:06:45.208742 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5041fb4e-c4b1-4d2d-b63a-90f9a1e4c22c None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:45.213473 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f36899a-0162-4dfb-a654-8940990b50e0 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:45.243815 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:45.282595 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea07007-c8e0-4c80-8440-303d5fdb7cd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:45.283140 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea07007-c8e0-4c80-8440-303d5fdb7cd1 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:45.283420 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea07007-c8e0-4c80-8440-303d5fdb7cd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:45.283694 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea07007-c8e0-4c80-8440-303d5fdb7cd1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:45.284727 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea07007-c8e0-4c80-8440-303d5fdb7cd1 None admin] RBAC: Adding query filter params (group.id=29c1333f63bd4988954525f39dfa8922, role.id=fdad79ffbcbb4fa380dc9cf7dd108618, scope.project.id=24b0845707914a1f9ffa3665e80a3533) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:45.285036 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea07007-c8e0-4c80-8440-303d5fdb7cd1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:45.286548 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea07007-c8e0-4c80-8440-303d5fdb7cd1 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:45.297095 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 172/346] 10.222.0.47 () {56 vars in 1376 bytes} [Wed Aug 31 00:06:44 2022] GET /identity/v3/role_assignments?group.id=29c1333f63bd4988954525f39dfa8922&scope.project.id=24b0845707914a1f9ffa3665e80a3533&role.id=fdad79ffbcbb4fa380dc9cf7dd108618 => generated 260 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:45.405788 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5041fb4e-c4b1-4d2d-b63a-90f9a1e4c22c None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:45.417153 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:45.450523 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1841f1d3-6bf2-43b2-9b0e-13b39f2adf38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:45.451283 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1841f1d3-6bf2-43b2-9b0e-13b39f2adf38 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:45.451564 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1841f1d3-6bf2-43b2-9b0e-13b39f2adf38 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:45.451840 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1841f1d3-6bf2-43b2-9b0e-13b39f2adf38 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:45.467887 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1841f1d3-6bf2-43b2-9b0e-13b39f2adf38 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:06:45.473228 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-1841f1d3-6bf2-43b2-9b0e-13b39f2adf38 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 00:06:45.473228 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:45.473228 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:06:45.473228 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:06:45.473228 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:06:45.473228 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:06:45.473228 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:06:45.473228 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:06:45.473228 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:06:45.473228 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:06:45.473228 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:06:45.473228 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:06:45.473228 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:06:45.473228 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:06:45.473228 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:06:45.473228 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:06:45.474426 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:06:45.474426 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:06:45.474426 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:06:45.474426 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:06:45.474426 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:06:45.474426 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:06:45.474426 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:06:45.474426 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:06:45.474426 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:06:45.474426 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:06:45.474426 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:06:45.474426 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Aug 31 00:06:45.474426 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:06:45.474426 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:06:45.474426 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:06:45.474426 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:06:45.475588 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:06:45.475588 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:06:45.475588 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:06:45.475588 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:06:45.475588 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:06:45.475588 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:06:45.475588 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:06:45.475588 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:06:45.475588 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:06:45.475588 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:06:45.475588 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 00:06:45.475588 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Aug 31 00:06:45.475588 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 175/347] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 31 00:06:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:06:45.483649 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea07007-c8e0-4c80-8440-303d5fdb7cd1 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:45.492348 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600ca743-3c12-4695-b825-ede6dd722cee None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:45.492766 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600ca743-3c12-4695-b825-ede6dd722cee None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:45.493017 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600ca743-3c12-4695-b825-ede6dd722cee None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:45.494981 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 176/348] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 00:06:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:06:45.503356 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de4968e-b036-46a5-9ca7-38d5cbbdb47d None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:45.503740 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de4968e-b036-46a5-9ca7-38d5cbbdb47d None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:45.504099 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de4968e-b036-46a5-9ca7-38d5cbbdb47d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:45.540042 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-2de4968e-b036-46a5-9ca7-38d5cbbdb47d None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:06:45.541201 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-2de4968e-b036-46a5-9ca7-38d5cbbdb47d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:06:45.688786 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 177/349] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 00:06:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 00:06:45.694082 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de4968e-b036-46a5-9ca7-38d5cbbdb47d None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:45.755587 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea07007-c8e0-4c80-8440-303d5fdb7cd1 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:45.859470 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5202ea3b-8796-4413-8c32-b8748896596e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:45.861017 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5202ea3b-8796-4413-8c32-b8748896596e None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:45.861701 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5202ea3b-8796-4413-8c32-b8748896596e None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:45.862353 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5202ea3b-8796-4413-8c32-b8748896596e None admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:45.863768 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5202ea3b-8796-4413-8c32-b8748896596e None admin] RBAC: Adding query filter params (name=member) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:45.865274 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5202ea3b-8796-4413-8c32-b8748896596e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:45.868225 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5202ea3b-8796-4413-8c32-b8748896596e None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:45.891023 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 173/350] 10.222.0.47 () {56 vars in 1101 bytes} [Wed Aug 31 00:06:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 409 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:45.892881 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb3deb9-027e-4da5-8a39-e0ee83c0104a None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:45.893463 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb3deb9-027e-4da5-8a39-e0ee83c0104a None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:45.894063 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb3deb9-027e-4da5-8a39-e0ee83c0104a None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:45.896128 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 174/351] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 00:06:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:06:45.899806 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb3deb9-027e-4da5-8a39-e0ee83c0104a None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:45.901303 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:45.912540 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de4968e-b036-46a5-9ca7-38d5cbbdb47d None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:45.978196 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ffbecc-9dde-47bd-b27a-426dca19f4cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:45.979103 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ffbecc-9dde-47bd-b27a-426dca19f4cd None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:45.979531 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ffbecc-9dde-47bd-b27a-426dca19f4cd None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:45.979971 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ffbecc-9dde-47bd-b27a-426dca19f4cd None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:45.989548 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:46.007977 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ffbecc-9dde-47bd-b27a-426dca19f4cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:06:46.014192 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-37ffbecc-9dde-47bd-b27a-426dca19f4cd None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 00:06:46.014192 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:46.014192 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:06:46.014192 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:06:46.014192 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:06:46.014192 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:06:46.014192 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:06:46.014192 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:06:46.014192 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:06:46.014192 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:06:46.014192 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:06:46.014192 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:06:46.014192 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:06:46.014192 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:06:46.014192 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:06:46.014192 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:06:46.015199 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:06:46.015199 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:06:46.015199 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:06:46.015199 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:06:46.015199 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:06:46.015199 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:06:46.015199 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:06:46.015199 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:06:46.015199 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:06:46.015199 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:06:46.015199 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:06:46.015199 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Aug 31 00:06:46.015199 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:06:46.015199 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:06:46.015199 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:06:46.015199 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:06:46.016032 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:06:46.016032 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:06:46.016032 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:06:46.016032 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:06:46.016032 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:06:46.016032 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:06:46.016032 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:06:46.016032 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:06:46.016032 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:06:46.016032 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:06:46.016032 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 00:06:46.016032 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Aug 31 00:06:46.017282 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 178/352] 10.222.0.47 () {56 vars in 1114 bytes} [Wed Aug 31 00:06:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:06:46.017821 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857c692a-0a27-488b-bddb-0ece8bf56228 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:46.018115 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857c692a-0a27-488b-bddb-0ece8bf56228 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:46.018399 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857c692a-0a27-488b-bddb-0ece8bf56228 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:46.044520 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-857c692a-0a27-488b-bddb-0ece8bf56228 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:06:46.046626 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-857c692a-0a27-488b-bddb-0ece8bf56228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:06:46.082238 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb3deb9-027e-4da5-8a39-e0ee83c0104a None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:46.129442 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3feb1aa-6a41-4def-8d91-fbe79e39cc06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:46.130664 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3feb1aa-6a41-4def-8d91-fbe79e39cc06 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:46.131569 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3feb1aa-6a41-4def-8d91-fbe79e39cc06 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:46.132324 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3feb1aa-6a41-4def-8d91-fbe79e39cc06 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:46.139550 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 179/353] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 00:06:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:06:46.139550 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a1fee4-b2b1-4abf-a5ba-81405b66eff6 None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:46.139550 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a1fee4-b2b1-4abf-a5ba-81405b66eff6 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:46.139550 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a1fee4-b2b1-4abf-a5ba-81405b66eff6 None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:46.140124 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 180/354] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 00:06:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:06:46.141748 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a1fee4-b2b1-4abf-a5ba-81405b66eff6 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:46.244796 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3feb1aa-6a41-4def-8d91-fbe79e39cc06 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:46.247890 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3feb1aa-6a41-4def-8d91-fbe79e39cc06 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:46.302160 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:46.316129 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:46.322556 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a1fee4-b2b1-4abf-a5ba-81405b66eff6 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:46.371687 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6bdc58-a241-4ab8-8198-c3f3dd4ae04f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:46.372840 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6bdc58-a241-4ab8-8198-c3f3dd4ae04f None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:46.373328 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6bdc58-a241-4ab8-8198-c3f3dd4ae04f None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:46.373956 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6bdc58-a241-4ab8-8198-c3f3dd4ae04f None admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:46.374792 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6bdc58-a241-4ab8-8198-c3f3dd4ae04f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:46.375669 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6bdc58-a241-4ab8-8198-c3f3dd4ae04f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:46.377256 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6bdc58-a241-4ab8-8198-c3f3dd4ae04f None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:46.390492 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 181/355] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 31 00:06:46 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:46.392036 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6bdc58-a241-4ab8-8198-c3f3dd4ae04f None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:46.394185 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 175/356] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 31 00:06:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 495 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 00:06:46.395321 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcb3378-ab76-414a-a517-5e8c584d092a None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:46.395605 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcb3378-ab76-414a-a517-5e8c584d092a None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:46.395877 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcb3378-ab76-414a-a517-5e8c584d092a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:46.424251 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-1fcb3378-ab76-414a-a517-5e8c584d092a None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:06:46.425527 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-1fcb3378-ab76-414a-a517-5e8c584d092a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:06:46.509519 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 176/357] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 00:06:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:06:46.510420 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcb3378-ab76-414a-a517-5e8c584d092a None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:46.535436 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6bdc58-a241-4ab8-8198-c3f3dd4ae04f None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:46.583228 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044f353b-973b-43b9-862f-61a3ae37e463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:46.584237 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044f353b-973b-43b9-862f-61a3ae37e463 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:46.584747 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044f353b-973b-43b9-862f-61a3ae37e463 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:46.585678 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044f353b-973b-43b9-862f-61a3ae37e463 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:46.599130 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:46.603018 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044f353b-973b-43b9-862f-61a3ae37e463 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:06:46.611863 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-044f353b-973b-43b9-862f-61a3ae37e463 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 00:06:46.611863 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:46.611863 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:06:46.611863 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:06:46.611863 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:06:46.611863 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:06:46.611863 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:06:46.611863 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:06:46.611863 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:06:46.611863 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:06:46.611863 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:06:46.611863 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:06:46.611863 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:06:46.611863 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:06:46.611863 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:06:46.611863 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:06:46.612891 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:06:46.612891 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:06:46.612891 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:06:46.612891 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:06:46.612891 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:06:46.612891 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:06:46.612891 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:06:46.612891 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:06:46.612891 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:06:46.612891 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:06:46.612891 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:06:46.612891 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Aug 31 00:06:46.612891 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:06:46.612891 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:06:46.612891 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:06:46.612891 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:06:46.613722 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:06:46.613722 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:06:46.613722 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:06:46.613722 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:06:46.613722 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:06:46.613722 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:06:46.613722 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:06:46.613722 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:06:46.613722 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:06:46.613722 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:06:46.613722 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 00:06:46.613722 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Aug 31 00:06:46.616980 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 182/358] 10.222.0.47 () {56 vars in 1114 bytes} [Wed Aug 31 00:06:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:06:46.618149 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044f353b-973b-43b9-862f-61a3ae37e463 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:46.644662 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:46.645289 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcb3378-ab76-414a-a517-5e8c584d092a None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:46.698347 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c71e36b-07ce-477b-b263-3e7d5c4f96d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:46.699934 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c71e36b-07ce-477b-b263-3e7d5c4f96d4 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:46.700450 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c71e36b-07ce-477b-b263-3e7d5c4f96d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:46.700916 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c71e36b-07ce-477b-b263-3e7d5c4f96d4 None admin] PATH_INFO: `/v3/projects/f605ca29af4949a5a9696ac63a2a2ffc` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:46.702805 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c71e36b-07ce-477b-b263-3e7d5c4f96d4 None admin] RBAC: Authorizing `identity:get_project(project_id=f605ca29af4949a5a9696ac63a2a2ffc)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:46.704842 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c71e36b-07ce-477b-b263-3e7d5c4f96d4 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:46.707611 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 177/359] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 31 00:06:46 2022] GET /identity/v3/projects/f605ca29af4949a5a9696ac63a2a2ffc => generated 302 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:46.708719 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c71e36b-07ce-477b-b263-3e7d5c4f96d4 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:46.777382 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044f353b-973b-43b9-862f-61a3ae37e463 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:46.828128 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc236ed-006f-4a0b-87ca-f335598784a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:46.829174 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc236ed-006f-4a0b-87ca-f335598784a6 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:46.829694 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc236ed-006f-4a0b-87ca-f335598784a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:46.830164 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc236ed-006f-4a0b-87ca-f335598784a6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:46.853170 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c71e36b-07ce-477b-b263-3e7d5c4f96d4 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:46.897205 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc7611c-6048-4a6c-952c-47eb1be48b34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:46.897948 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc7611c-6048-4a6c-952c-47eb1be48b34 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:46.898160 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc7611c-6048-4a6c-952c-47eb1be48b34 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:46.898438 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc7611c-6048-4a6c-952c-47eb1be48b34 None admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:46.899161 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc7611c-6048-4a6c-952c-47eb1be48b34 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:46.899570 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc7611c-6048-4a6c-952c-47eb1be48b34 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:46.903128 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc7611c-6048-4a6c-952c-47eb1be48b34 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:46.913622 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 178/360] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 31 00:06:46 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:46.921128 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc7611c-6048-4a6c-952c-47eb1be48b34 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:46.924437 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:46.929171 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc236ed-006f-4a0b-87ca-f335598784a6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:46.931025 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc236ed-006f-4a0b-87ca-f335598784a6 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:46.956272 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:47.059620 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 183/361] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 31 00:06:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 00:06:47.060912 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc236ed-006f-4a0b-87ca-f335598784a6 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:47.063765 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc7611c-6048-4a6c-952c-47eb1be48b34 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:47.113033 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d25a0d8-dc80-4a71-97a9-2f506ce99d34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:47.113542 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d25a0d8-dc80-4a71-97a9-2f506ce99d34 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:47.114329 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d25a0d8-dc80-4a71-97a9-2f506ce99d34 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:47.114615 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d25a0d8-dc80-4a71-97a9-2f506ce99d34 None admin] PATH_INFO: `/v3/groups/29c1333f63bd4988954525f39dfa8922` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:47.115817 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d25a0d8-dc80-4a71-97a9-2f506ce99d34 None admin] RBAC: Authorizing `identity:get_group(group_id=29c1333f63bd4988954525f39dfa8922)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:47.117347 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d25a0d8-dc80-4a71-97a9-2f506ce99d34 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:47.119301 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 179/362] 10.222.0.47 () {56 vars in 1180 bytes} [Wed Aug 31 00:06:46 2022] GET /identity/v3/groups/29c1333f63bd4988954525f39dfa8922 => generated 226 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:47.120111 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d25a0d8-dc80-4a71-97a9-2f506ce99d34 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:47.217359 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc236ed-006f-4a0b-87ca-f335598784a6 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:47.236223 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:47.237182 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:47.277478 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e64ed7-fac0-410c-b097-7f86c29af628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:47.277478 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e64ed7-fac0-410c-b097-7f86c29af628 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:47.277478 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e64ed7-fac0-410c-b097-7f86c29af628 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:47.278227 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e64ed7-fac0-410c-b097-7f86c29af628 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:47.290230 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d25a0d8-dc80-4a71-97a9-2f506ce99d34 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:47.290510 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e64ed7-fac0-410c-b097-7f86c29af628 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:06:47.300298 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-b3e64ed7-fac0-410c-b097-7f86c29af628 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 00:06:47.300298 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:47.300298 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:06:47.300298 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:06:47.300298 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:06:47.300298 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:06:47.300298 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:06:47.300298 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:06:47.300298 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:06:47.300298 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:06:47.300298 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:06:47.300298 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:06:47.300298 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:06:47.300298 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:06:47.300298 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:06:47.300298 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:06:47.301528 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:06:47.301528 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:06:47.301528 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:06:47.301528 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:06:47.301528 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:06:47.301528 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:06:47.301528 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:06:47.301528 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:06:47.301528 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:06:47.301528 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:06:47.301528 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:06:47.301528 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Aug 31 00:06:47.301528 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:06:47.301528 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:06:47.301528 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:06:47.301528 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:06:47.302380 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:06:47.302380 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:06:47.302380 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:06:47.302380 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:06:47.302380 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:06:47.302380 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:06:47.302380 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:06:47.302380 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:06:47.302380 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:06:47.302380 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:06:47.302380 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 00:06:47.302380 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Aug 31 00:06:47.302380 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 184/363] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 31 00:06:47 2022] GET /identity/v3/roles/reader => generated 84 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:06:47.305460 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e64ed7-fac0-410c-b097-7f86c29af628 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:47.350472 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58254292-c0f9-4fab-8a7a-a863c3938125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:47.351156 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58254292-c0f9-4fab-8a7a-a863c3938125 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:47.351387 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58254292-c0f9-4fab-8a7a-a863c3938125 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:47.351660 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58254292-c0f9-4fab-8a7a-a863c3938125 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:47.451229 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e64ed7-fac0-410c-b097-7f86c29af628 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:47.452464 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58254292-c0f9-4fab-8a7a-a863c3938125 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:47.455130 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58254292-c0f9-4fab-8a7a-a863c3938125 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:47.499425 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32295b9-b98d-49b5-9b75-64cc0dd3ef39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:47.499958 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32295b9-b98d-49b5-9b75-64cc0dd3ef39 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:47.500129 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32295b9-b98d-49b5-9b75-64cc0dd3ef39 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:47.500520 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32295b9-b98d-49b5-9b75-64cc0dd3ef39 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:47.517133 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32295b9-b98d-49b5-9b75-64cc0dd3ef39 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:06:47.522180 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-b32295b9-b98d-49b5-9b75-64cc0dd3ef39 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:06:47.522180 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:47.522180 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:06:47.522180 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:06:47.522180 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:06:47.522180 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:06:47.522180 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:06:47.522180 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:06:47.522180 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:06:47.522180 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:06:47.522180 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:06:47.522180 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:06:47.522180 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:06:47.522180 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:06:47.522180 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:06:47.522180 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:06:47.523101 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:06:47.523101 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:06:47.523101 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:06:47.523101 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:06:47.523101 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:06:47.523101 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:06:47.523101 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:06:47.523101 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:06:47.523101 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:06:47.523101 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:06:47.523101 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:06:47.523101 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Aug 31 00:06:47.523101 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:06:47.523101 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:06:47.523101 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:06:47.523101 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:06:47.523910 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:06:47.523910 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:06:47.523910 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:06:47.523910 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:06:47.523910 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:06:47.523910 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:06:47.523910 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:06:47.523910 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:06:47.523910 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:06:47.523910 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:06:47.523910 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:06:47.523910 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Aug 31 00:06:47.523910 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 185/364] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Aug 31 00:06:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:06:47.524632 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32295b9-b98d-49b5-9b75-64cc0dd3ef39 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:47.557992 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:47.568587 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:47.602961 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 180/365] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 31 00:06:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 483 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 00:06:47.603619 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58254292-c0f9-4fab-8a7a-a863c3938125 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:47.675188 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32295b9-b98d-49b5-9b75-64cc0dd3ef39 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:47.731211 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0972931-978a-4740-a58b-42a86f27482b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:47.732307 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0972931-978a-4740-a58b-42a86f27482b None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:47.733126 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0972931-978a-4740-a58b-42a86f27482b None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:47.733935 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0972931-978a-4740-a58b-42a86f27482b None admin] PATH_INFO: `/v3/projects/24b0845707914a1f9ffa3665e80a3533` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:47.735478 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0972931-978a-4740-a58b-42a86f27482b None admin] RBAC: Authorizing `identity:get_project(project_id=24b0845707914a1f9ffa3665e80a3533)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:47.739798 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0972931-978a-4740-a58b-42a86f27482b None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:47.739798 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 186/366] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 31 00:06:47 2022] GET /identity/v3/projects/24b0845707914a1f9ffa3665e80a3533 => generated 298 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:47.739798 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0972931-978a-4740-a58b-42a86f27482b None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:47.765114 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58254292-c0f9-4fab-8a7a-a863c3938125 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:47.817367 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a70eaca-76d7-456b-aac6-a94b87211244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:47.818008 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a70eaca-76d7-456b-aac6-a94b87211244 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:47.818293 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a70eaca-76d7-456b-aac6-a94b87211244 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:47.818572 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a70eaca-76d7-456b-aac6-a94b87211244 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:47.819630 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a70eaca-76d7-456b-aac6-a94b87211244 None admin] RBAC: Adding query filter params (group.id=29c1333f63bd4988954525f39dfa8922, role.id=fdad79ffbcbb4fa380dc9cf7dd108618, scope.project.id=f605ca29af4949a5a9696ac63a2a2ffc) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:47.819948 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a70eaca-76d7-456b-aac6-a94b87211244 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:47.821821 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a70eaca-76d7-456b-aac6-a94b87211244 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:47.831913 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 181/367] 10.222.0.47 () {56 vars in 1376 bytes} [Wed Aug 31 00:06:47 2022] GET /identity/v3/role_assignments?group.id=29c1333f63bd4988954525f39dfa8922&scope.project.id=f605ca29af4949a5a9696ac63a2a2ffc&role.id=fdad79ffbcbb4fa380dc9cf7dd108618 => generated 260 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:47.832774 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a70eaca-76d7-456b-aac6-a94b87211244 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:47.885812 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:47.891395 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:47.895797 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0972931-978a-4740-a58b-42a86f27482b None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:47.952929 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb5fd57-095d-41f6-840b-d0351f0f0f0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:47.954713 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb5fd57-095d-41f6-840b-d0351f0f0f0b None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:47.954713 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb5fd57-095d-41f6-840b-d0351f0f0f0b None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:47.954713 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb5fd57-095d-41f6-840b-d0351f0f0f0b None admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:47.955628 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb5fd57-095d-41f6-840b-d0351f0f0f0b None admin] RBAC: Adding query filter params (name=reader) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:47.955976 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb5fd57-095d-41f6-840b-d0351f0f0f0b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:47.958827 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb5fd57-095d-41f6-840b-d0351f0f0f0b None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:47.977423 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 187/368] 10.222.0.47 () {56 vars in 1101 bytes} [Wed Aug 31 00:06:47 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:47.978354 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb5fd57-095d-41f6-840b-d0351f0f0f0b None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:47.999556 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a70eaca-76d7-456b-aac6-a94b87211244 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:48.053654 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8baf3ff-3ce4-4354-959f-9c469a679141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:48.054217 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8baf3ff-3ce4-4354-959f-9c469a679141 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:48.054502 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8baf3ff-3ce4-4354-959f-9c469a679141 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:48.054774 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8baf3ff-3ce4-4354-959f-9c469a679141 None admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:48.055473 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8baf3ff-3ce4-4354-959f-9c469a679141 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:48.055776 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8baf3ff-3ce4-4354-959f-9c469a679141 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:48.057302 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8baf3ff-3ce4-4354-959f-9c469a679141 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:48.069160 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 182/369] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 31 00:06:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:48.070263 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8baf3ff-3ce4-4354-959f-9c469a679141 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:48.131470 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb5fd57-095d-41f6-840b-d0351f0f0f0b None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:48.186934 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9ca85b-fa08-4ccf-846c-00d40185d91d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:48.187735 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9ca85b-fa08-4ccf-846c-00d40185d91d None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:48.188171 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9ca85b-fa08-4ccf-846c-00d40185d91d None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:48.188468 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9ca85b-fa08-4ccf-846c-00d40185d91d None admin] PATH_INFO: `/v3/projects/f605ca29af4949a5a9696ac63a2a2ffc` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:48.189798 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9ca85b-fa08-4ccf-846c-00d40185d91d None admin] RBAC: Authorizing `identity:get_project(project_id=f605ca29af4949a5a9696ac63a2a2ffc)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:48.191438 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9ca85b-fa08-4ccf-846c-00d40185d91d None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:48.193577 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 188/370] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 31 00:06:47 2022] GET /identity/v3/projects/f605ca29af4949a5a9696ac63a2a2ffc => generated 302 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:48.193744 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9ca85b-fa08-4ccf-846c-00d40185d91d None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:48.207544 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:48.218322 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8baf3ff-3ce4-4354-959f-9c469a679141 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:48.239739 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:48.267134 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd8f8e4-fd1d-476f-ad40-e0dd8de53df8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:48.267808 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd8f8e4-fd1d-476f-ad40-e0dd8de53df8 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:48.268195 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd8f8e4-fd1d-476f-ad40-e0dd8de53df8 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:48.268469 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd8f8e4-fd1d-476f-ad40-e0dd8de53df8 None admin] PATH_INFO: `/v3/groups/29c1333f63bd4988954525f39dfa8922` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:48.269762 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd8f8e4-fd1d-476f-ad40-e0dd8de53df8 None admin] RBAC: Authorizing `identity:get_group(group_id=29c1333f63bd4988954525f39dfa8922)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:48.271251 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd8f8e4-fd1d-476f-ad40-e0dd8de53df8 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:48.273281 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 183/371] 10.222.0.47 () {56 vars in 1180 bytes} [Wed Aug 31 00:06:48 2022] GET /identity/v3/groups/29c1333f63bd4988954525f39dfa8922 => generated 226 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:48.274382 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f3b559-8cde-4a05-93d0-abfc5281dff9 None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:48.274661 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f3b559-8cde-4a05-93d0-abfc5281dff9 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:48.274936 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f3b559-8cde-4a05-93d0-abfc5281dff9 None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:48.281837 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 184/372] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 00:06:48 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:06:48.282823 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f3b559-8cde-4a05-93d0-abfc5281dff9 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:48.354300 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9ca85b-fa08-4ccf-846c-00d40185d91d None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:48.408129 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf17efc9-03a2-4e67-a4eb-b4ff6fb205cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:48.408857 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf17efc9-03a2-4e67-a4eb-b4ff6fb205cb None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:48.409141 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf17efc9-03a2-4e67-a4eb-b4ff6fb205cb None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:48.409681 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf17efc9-03a2-4e67-a4eb-b4ff6fb205cb None admin] PATH_INFO: `/v3/users/a04ba9aad72e4a41946956a94bdcb988` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:48.410858 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf17efc9-03a2-4e67-a4eb-b4ff6fb205cb None admin] RBAC: Authorizing `identity:get_user(user_id=a04ba9aad72e4a41946956a94bdcb988)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:48.412868 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf17efc9-03a2-4e67-a4eb-b4ff6fb205cb None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:48.414188 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 189/373] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 31 00:06:48 2022] GET /identity/v3/users/a04ba9aad72e4a41946956a94bdcb988 => generated 293 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:48.414854 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf17efc9-03a2-4e67-a4eb-b4ff6fb205cb None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:48.443535 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f3b559-8cde-4a05-93d0-abfc5281dff9 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:48.498668 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20115ce2-3489-481c-8a05-65ff023184d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:48.499614 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20115ce2-3489-481c-8a05-65ff023184d5 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:48.500051 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20115ce2-3489-481c-8a05-65ff023184d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:48.500562 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20115ce2-3489-481c-8a05-65ff023184d5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:48.553016 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:48.553291 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:48.562982 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf17efc9-03a2-4e67-a4eb-b4ff6fb205cb None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:48.600481 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20115ce2-3489-481c-8a05-65ff023184d5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:48.601959 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20115ce2-3489-481c-8a05-65ff023184d5 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:48.609531 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b30ac76-c263-430a-bdbf-020719bd2546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:48.610090 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b30ac76-c263-430a-bdbf-020719bd2546 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:48.610371 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b30ac76-c263-430a-bdbf-020719bd2546 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:48.610646 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b30ac76-c263-430a-bdbf-020719bd2546 None admin] PATH_INFO: `/v3/groups/29c1333f63bd4988954525f39dfa8922` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:48.611766 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b30ac76-c263-430a-bdbf-020719bd2546 None admin] RBAC: Authorizing `identity:get_group(group_id=29c1333f63bd4988954525f39dfa8922)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:48.613281 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b30ac76-c263-430a-bdbf-020719bd2546 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:48.619924 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 190/374] 10.222.0.47 () {56 vars in 1180 bytes} [Wed Aug 31 00:06:48 2022] GET /identity/v3/groups/29c1333f63bd4988954525f39dfa8922 => generated 226 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:48.620515 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b30ac76-c263-430a-bdbf-020719bd2546 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:48.727034 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 185/375] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 31 00:06:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 00:06:48.728349 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7262e0c6-6ae6-4205-af18-ba8520e31f65 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:48.728636 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7262e0c6-6ae6-4205-af18-ba8520e31f65 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:48.728905 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7262e0c6-6ae6-4205-af18-ba8520e31f65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:48.748478 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b30ac76-c263-430a-bdbf-020719bd2546 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:48.750468 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-7262e0c6-6ae6-4205-af18-ba8520e31f65 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:06:48.751682 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-7262e0c6-6ae6-4205-af18-ba8520e31f65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:06:48.785920 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642006f7-4ae0-4bcc-833c-2b6b7a5ba72a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:48.786817 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642006f7-4ae0-4bcc-833c-2b6b7a5ba72a None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:48.787096 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642006f7-4ae0-4bcc-833c-2b6b7a5ba72a None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:48.787388 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642006f7-4ae0-4bcc-833c-2b6b7a5ba72a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:48.788107 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642006f7-4ae0-4bcc-833c-2b6b7a5ba72a None admin] RBAC: Adding query filter params (group.id=29c1333f63bd4988954525f39dfa8922, role.id=89f25837440e4981bad54fe74d242232, scope.project.id=24b0845707914a1f9ffa3665e80a3533) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:48.788449 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642006f7-4ae0-4bcc-833c-2b6b7a5ba72a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:48.789945 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642006f7-4ae0-4bcc-833c-2b6b7a5ba72a None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:48.796689 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 191/376] 10.222.0.47 () {56 vars in 1376 bytes} [Wed Aug 31 00:06:48 2022] GET /identity/v3/role_assignments?group.id=29c1333f63bd4988954525f39dfa8922&scope.project.id=24b0845707914a1f9ffa3665e80a3533&role.id=89f25837440e4981bad54fe74d242232 => generated 260 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:48.797637 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642006f7-4ae0-4bcc-833c-2b6b7a5ba72a None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:48.840531 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:48.842674 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:48.858299 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 186/377] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 00:06:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:06:48.860622 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7262e0c6-6ae6-4205-af18-ba8520e31f65 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:49.014784 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642006f7-4ae0-4bcc-833c-2b6b7a5ba72a None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:49.068210 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7262e0c6-6ae6-4205-af18-ba8520e31f65 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:49.073059 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7ea76a-3f7c-47df-8284-df76ff58698c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:49.073681 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7ea76a-3f7c-47df-8284-df76ff58698c None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:49.074191 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7ea76a-3f7c-47df-8284-df76ff58698c None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:49.075262 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7ea76a-3f7c-47df-8284-df76ff58698c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:49.076015 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7ea76a-3f7c-47df-8284-df76ff58698c None admin] RBAC: Adding query filter params (role.id=4d8eb43f443c46d3aaaf3c515e374839, user.id=a04ba9aad72e4a41946956a94bdcb988, scope.system=all) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:49.076353 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7ea76a-3f7c-47df-8284-df76ff58698c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:49.077851 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7ea76a-3f7c-47df-8284-df76ff58698c None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:49.120640 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 192/378] 10.222.0.47 () {56 vars in 1308 bytes} [Wed Aug 31 00:06:48 2022] GET /identity/v3/role_assignments?user.id=a04ba9aad72e4a41946956a94bdcb988&scope.system=all&role.id=4d8eb43f443c46d3aaaf3c515e374839 => generated 510 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:49.122079 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7ea76a-3f7c-47df-8284-df76ff58698c None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:49.161532 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca62d69-d385-4c31-b557-513d082f322f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:49.163249 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca62d69-d385-4c31-b557-513d082f322f None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:49.163753 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca62d69-d385-4c31-b557-513d082f322f None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:49.164336 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca62d69-d385-4c31-b557-513d082f322f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:49.165909 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca62d69-d385-4c31-b557-513d082f322f None admin] RBAC: Adding query filter params (group.id=29c1333f63bd4988954525f39dfa8922, role.id=89f25837440e4981bad54fe74d242232, scope.project.id=f605ca29af4949a5a9696ac63a2a2ffc) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:49.166531 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca62d69-d385-4c31-b557-513d082f322f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:49.170403 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca62d69-d385-4c31-b557-513d082f322f None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:49.178448 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 187/379] 10.222.0.47 () {56 vars in 1376 bytes} [Wed Aug 31 00:06:48 2022] GET /identity/v3/role_assignments?group.id=29c1333f63bd4988954525f39dfa8922&scope.project.id=f605ca29af4949a5a9696ac63a2a2ffc&role.id=89f25837440e4981bad54fe74d242232 => generated 260 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:49.179548 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca62d69-d385-4c31-b557-513d082f322f None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:49.323250 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:49.347289 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:49.374701 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7ea76a-3f7c-47df-8284-df76ff58698c None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:49.432536 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca62d69-d385-4c31-b557-513d082f322f None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:49.468239 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b00534d-07c0-4ebe-9cf0-f50ab32ee230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:49.468979 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b00534d-07c0-4ebe-9cf0-f50ab32ee230 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:49.469261 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b00534d-07c0-4ebe-9cf0-f50ab32ee230 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:49.469540 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b00534d-07c0-4ebe-9cf0-f50ab32ee230 None admin] PATH_INFO: `/v3/projects/549d5b0e486743c994271a9e51f4023c` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:49.471978 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b00534d-07c0-4ebe-9cf0-f50ab32ee230 None admin] RBAC: Authorizing `identity:get_project(project_id=549d5b0e486743c994271a9e51f4023c)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:49.473514 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b00534d-07c0-4ebe-9cf0-f50ab32ee230 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:49.475318 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 193/380] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 31 00:06:49 2022] GET /identity/v3/projects/549d5b0e486743c994271a9e51f4023c => generated 344 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:49.483834 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b00534d-07c0-4ebe-9cf0-f50ab32ee230 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:49.512255 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acffa862-80d6-420b-9a37-b037a8565808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:49.513032 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acffa862-80d6-420b-9a37-b037a8565808 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:49.513317 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acffa862-80d6-420b-9a37-b037a8565808 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:49.513593 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acffa862-80d6-420b-9a37-b037a8565808 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:49.539406 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acffa862-80d6-420b-9a37-b037a8565808 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:06:49.548477 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-acffa862-80d6-420b-9a37-b037a8565808 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 00:06:49.548477 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:49.548477 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:06:49.548477 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:06:49.548477 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:06:49.548477 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:06:49.548477 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:06:49.548477 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:06:49.548477 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:06:49.548477 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:06:49.548477 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:06:49.548477 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:06:49.548477 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:06:49.548477 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:06:49.548477 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:06:49.548477 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:06:49.549469 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:06:49.549469 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:06:49.549469 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:06:49.549469 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:06:49.549469 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:06:49.549469 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:06:49.549469 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:06:49.549469 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:06:49.549469 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:06:49.549469 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:06:49.549469 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:06:49.549469 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 31 00:06:49.549469 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:06:49.549469 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:06:49.549469 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:06:49.549469 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:06:49.550282 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:06:49.550282 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:06:49.550282 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:06:49.550282 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:06:49.550282 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:06:49.550282 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:06:49.550282 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:06:49.550282 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:06:49.550282 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:06:49.550282 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:06:49.550282 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 00:06:49.550282 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 31 00:06:49.550282 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 188/381] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 31 00:06:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 371 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:06:49.556251 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acffa862-80d6-420b-9a37-b037a8565808 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:49.742103 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b00534d-07c0-4ebe-9cf0-f50ab32ee230 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:49.839216 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acffa862-80d6-420b-9a37-b037a8565808 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:49.858271 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f323ce-e1e5-442e-a455-1d3f9eb25ede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:49.858928 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f323ce-e1e5-442e-a455-1d3f9eb25ede None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:49.859210 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f323ce-e1e5-442e-a455-1d3f9eb25ede None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:49.859488 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f323ce-e1e5-442e-a455-1d3f9eb25ede None admin] PATH_INFO: `/v3/groups/8bb9f103d76341e38c252bbb57150e81` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:49.870040 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f323ce-e1e5-442e-a455-1d3f9eb25ede None admin] RBAC: Authorizing `identity:get_group(group_id=8bb9f103d76341e38c252bbb57150e81)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:49.872403 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f323ce-e1e5-442e-a455-1d3f9eb25ede None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:49.874460 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 194/382] 10.222.0.47 () {56 vars in 1180 bytes} [Wed Aug 31 00:06:49 2022] GET /identity/v3/groups/8bb9f103d76341e38c252bbb57150e81 => generated 229 bytes in 391 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:49.880434 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:49.881517 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f323ce-e1e5-442e-a455-1d3f9eb25ede None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:49.924458 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdda52b5-0ac9-45dd-913b-70b35a41193e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:49.929850 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdda52b5-0ac9-45dd-913b-70b35a41193e None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:49.930548 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdda52b5-0ac9-45dd-913b-70b35a41193e None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:49.931205 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdda52b5-0ac9-45dd-913b-70b35a41193e None admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:49.932654 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdda52b5-0ac9-45dd-913b-70b35a41193e None admin] RBAC: Adding query filter params (name=member) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:49.933393 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdda52b5-0ac9-45dd-913b-70b35a41193e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:49.933889 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:49.940945 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdda52b5-0ac9-45dd-913b-70b35a41193e None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:49.976687 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 189/383] 10.222.0.47 () {56 vars in 1101 bytes} [Wed Aug 31 00:06:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 421 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:49.983833 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdda52b5-0ac9-45dd-913b-70b35a41193e None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:50.163515 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f323ce-e1e5-442e-a455-1d3f9eb25ede None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:50.244964 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc55ee7a-51af-4979-be5f-6cb9f9ecd114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:50.247711 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc55ee7a-51af-4979-be5f-6cb9f9ecd114 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:50.247711 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc55ee7a-51af-4979-be5f-6cb9f9ecd114 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:50.247711 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc55ee7a-51af-4979-be5f-6cb9f9ecd114 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:50.247711 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc55ee7a-51af-4979-be5f-6cb9f9ecd114 None admin] RBAC: Adding query filter params (group.id=8bb9f103d76341e38c252bbb57150e81, role.id=12f6817f9aaa4e2bb477095a6bed5d0f, scope.project.id=549d5b0e486743c994271a9e51f4023c) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:50.250031 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc55ee7a-51af-4979-be5f-6cb9f9ecd114 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:50.252789 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc55ee7a-51af-4979-be5f-6cb9f9ecd114 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:50.272357 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 195/384] 10.222.0.47 () {56 vars in 1376 bytes} [Wed Aug 31 00:06:49 2022] GET /identity/v3/role_assignments?group.id=8bb9f103d76341e38c252bbb57150e81&scope.project.id=549d5b0e486743c994271a9e51f4023c&role.id=12f6817f9aaa4e2bb477095a6bed5d0f => generated 260 bytes in 387 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:50.273412 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdda52b5-0ac9-45dd-913b-70b35a41193e None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:50.273953 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0721f1c-ba53-487a-a6eb-c950efd4a61e None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:50.274145 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0721f1c-ba53-487a-a6eb-c950efd4a61e None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:50.274420 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0721f1c-ba53-487a-a6eb-c950efd4a61e None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:50.278688 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 196/385] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 00:06:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:06:50.297761 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a19214-feeb-4175-bb89-9c717e42b4b5 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:50.298094 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a19214-feeb-4175-bb89-9c717e42b4b5 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:50.298306 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a19214-feeb-4175-bb89-9c717e42b4b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:50.349290 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-a1a19214-feeb-4175-bb89-9c717e42b4b5 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:06:50.350503 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-a1a19214-feeb-4175-bb89-9c717e42b4b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:06:50.365097 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebad0436-3180-49e5-a7dd-0b34ca1eab40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:50.365759 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebad0436-3180-49e5-a7dd-0b34ca1eab40 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:50.366036 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebad0436-3180-49e5-a7dd-0b34ca1eab40 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:50.366311 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebad0436-3180-49e5-a7dd-0b34ca1eab40 None admin] PATH_INFO: `/v3/groups/29c1333f63bd4988954525f39dfa8922` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:50.367581 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebad0436-3180-49e5-a7dd-0b34ca1eab40 None admin] RBAC: Authorizing `identity:get_group(group_id=29c1333f63bd4988954525f39dfa8922)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:50.369116 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebad0436-3180-49e5-a7dd-0b34ca1eab40 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:50.371324 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 190/386] 10.222.0.47 () {56 vars in 1180 bytes} [Wed Aug 31 00:06:49 2022] GET /identity/v3/groups/29c1333f63bd4988954525f39dfa8922 => generated 226 bytes in 389 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:50.378385 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebad0436-3180-49e5-a7dd-0b34ca1eab40 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:50.464478 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 197/387] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 00:06:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:06:50.497350 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:50.578308 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebad0436-3180-49e5-a7dd-0b34ca1eab40 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:50.618264 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac231937-6325-45c9-bd6a-883229a4142c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:50.619259 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac231937-6325-45c9-bd6a-883229a4142c None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:50.619758 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac231937-6325-45c9-bd6a-883229a4142c None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:50.620270 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac231937-6325-45c9-bd6a-883229a4142c None admin] PATH_INFO: `/v3/projects/24b0845707914a1f9ffa3665e80a3533` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:50.622788 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac231937-6325-45c9-bd6a-883229a4142c None admin] RBAC: Authorizing `identity:get_project(project_id=24b0845707914a1f9ffa3665e80a3533)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:50.624488 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac231937-6325-45c9-bd6a-883229a4142c None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:50.626388 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 191/388] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 31 00:06:50 2022] GET /identity/v3/projects/24b0845707914a1f9ffa3665e80a3533 => generated 298 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:06:50.632443 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a19214-feeb-4175-bb89-9c717e42b4b5 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:50.650598 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:50.787408 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a19214-feeb-4175-bb89-9c717e42b4b5 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:50.833202 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110c8ede-e69c-4831-a1e1-67b92db10ad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:50.834238 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110c8ede-e69c-4831-a1e1-67b92db10ad8 None admin] REQUEST_METHOD: `PUT` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:50.834730 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110c8ede-e69c-4831-a1e1-67b92db10ad8 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:50.835227 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110c8ede-e69c-4831-a1e1-67b92db10ad8 None admin] PATH_INFO: `/v3/projects/24b0845707914a1f9ffa3665e80a3533/groups/29c1333f63bd4988954525f39dfa8922/roles/fdad79ffbcbb4fa380dc9cf7dd108618` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:50.839404 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110c8ede-e69c-4831-a1e1-67b92db10ad8 None admin] RBAC: Authorizing `identity:create_grant(project_id=24b0845707914a1f9ffa3665e80a3533, group_id=29c1333f63bd4988954525f39dfa8922, role_id=fdad79ffbcbb4fa380dc9cf7dd108618)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:50.841840 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110c8ede-e69c-4831-a1e1-67b92db10ad8 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:50.862743 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 198/389] 10.222.0.47 () {58 vars in 1442 bytes} [Wed Aug 31 00:06:50 2022] PUT /identity/v3/projects/24b0845707914a1f9ffa3665e80a3533/groups/29c1333f63bd4988954525f39dfa8922/roles/fdad79ffbcbb4fa380dc9cf7dd108618 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:06:51.019928 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac231937-6325-45c9-bd6a-883229a4142c None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:51.191326 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac231937-6325-45c9-bd6a-883229a4142c None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:51.211213 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a709c864-4954-478a-85a3-8bee4ab20ee7 None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:51.211552 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a709c864-4954-478a-85a3-8bee4ab20ee7 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:51.212001 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a709c864-4954-478a-85a3-8bee4ab20ee7 None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:51.213717 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 199/390] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 00:06:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:06:51.222160 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d2f75a-b29f-444b-8117-1fb178246a23 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:51.222449 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d2f75a-b29f-444b-8117-1fb178246a23 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:51.222886 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d2f75a-b29f-444b-8117-1fb178246a23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:51.234180 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:51.251153 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-f5d2f75a-b29f-444b-8117-1fb178246a23 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:06:51.253123 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-f5d2f75a-b29f-444b-8117-1fb178246a23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:06:51.264617 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30c48cb-ac90-4b0e-957b-d18ca6a13afa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:51.265099 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30c48cb-ac90-4b0e-957b-d18ca6a13afa None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:51.265666 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30c48cb-ac90-4b0e-957b-d18ca6a13afa None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:51.266236 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30c48cb-ac90-4b0e-957b-d18ca6a13afa None admin] PATH_INFO: `/v3/roles/member` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:51.282739 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30c48cb-ac90-4b0e-957b-d18ca6a13afa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:06:51.288913 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-d30c48cb-ac90-4b0e-957b-d18ca6a13afa None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 00:06:51.288913 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:51.288913 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:06:51.288913 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:06:51.288913 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:06:51.288913 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:06:51.288913 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:06:51.288913 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:06:51.288913 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:06:51.288913 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:06:51.288913 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:06:51.288913 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:06:51.288913 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:06:51.288913 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:06:51.288913 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:06:51.288913 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:06:51.289878 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:06:51.289878 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:06:51.289878 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:06:51.289878 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:06:51.289878 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:06:51.289878 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:06:51.289878 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:06:51.289878 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:06:51.289878 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:06:51.289878 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:06:51.289878 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:06:51.289878 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 31 00:06:51.289878 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:06:51.289878 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:06:51.289878 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:06:51.289878 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:06:51.290996 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:06:51.290996 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:06:51.290996 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:06:51.290996 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:06:51.290996 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:06:51.290996 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:06:51.290996 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:06:51.290996 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:06:51.290996 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:06:51.290996 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:06:51.290996 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 00:06:51.290996 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 31 00:06:51.290996 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 192/391] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 31 00:06:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:06:51.297442 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30c48cb-ac90-4b0e-957b-d18ca6a13afa None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:51.381646 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 200/392] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 00:06:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 00:06:51.468630 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30c48cb-ac90-4b0e-957b-d18ca6a13afa None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:51.529936 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3bc391-75ac-4a28-ac38-6174b7226c5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:51.530902 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3bc391-75ac-4a28-ac38-6174b7226c5d None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:51.531363 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3bc391-75ac-4a28-ac38-6174b7226c5d None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:51.531830 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3bc391-75ac-4a28-ac38-6174b7226c5d None admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:51.532988 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3bc391-75ac-4a28-ac38-6174b7226c5d None admin] RBAC: Adding query filter params (name=member) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:51.533702 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3bc391-75ac-4a28-ac38-6174b7226c5d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:51.536603 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3bc391-75ac-4a28-ac38-6174b7226c5d None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:51.549929 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 193/393] 10.222.0.47 () {56 vars in 1101 bytes} [Wed Aug 31 00:06:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:51.556522 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d2f75a-b29f-444b-8117-1fb178246a23 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:51.561033 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:51.693919 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d2f75a-b29f-444b-8117-1fb178246a23 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:51.739791 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dad54e1-29d9-4640-9898-fc4b8268b5a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:51.740755 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dad54e1-29d9-4640-9898-fc4b8268b5a4 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:51.741244 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dad54e1-29d9-4640-9898-fc4b8268b5a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:51.741691 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dad54e1-29d9-4640-9898-fc4b8268b5a4 None admin] PATH_INFO: `/v3/groups/29c1333f63bd4988954525f39dfa8922` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:51.742991 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dad54e1-29d9-4640-9898-fc4b8268b5a4 None admin] RBAC: Authorizing `identity:get_group(group_id=29c1333f63bd4988954525f39dfa8922)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:51.744648 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dad54e1-29d9-4640-9898-fc4b8268b5a4 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:51.747623 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 201/394] 10.222.0.47 () {56 vars in 1180 bytes} [Wed Aug 31 00:06:51 2022] GET /identity/v3/groups/29c1333f63bd4988954525f39dfa8922 => generated 226 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:51.753249 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3bc391-75ac-4a28-ac38-6174b7226c5d None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:51.770404 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dad54e1-29d9-4640-9898-fc4b8268b5a4 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:51.801376 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:51.872536 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3bc391-75ac-4a28-ac38-6174b7226c5d None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:51.876546 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:51.916258 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e80b1a-8d27-4040-ba66-cfb58af2f338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:51.917005 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e80b1a-8d27-4040-ba66-cfb58af2f338 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:51.917563 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e80b1a-8d27-4040-ba66-cfb58af2f338 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:51.918264 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e80b1a-8d27-4040-ba66-cfb58af2f338 None admin] PATH_INFO: `/v3/projects/f605ca29af4949a5a9696ac63a2a2ffc` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:51.920123 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e80b1a-8d27-4040-ba66-cfb58af2f338 None admin] RBAC: Authorizing `identity:get_project(project_id=f605ca29af4949a5a9696ac63a2a2ffc)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:51.921472 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dad54e1-29d9-4640-9898-fc4b8268b5a4 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:51.921810 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e80b1a-8d27-4040-ba66-cfb58af2f338 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:51.923958 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 194/395] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 31 00:06:51 2022] GET /identity/v3/projects/f605ca29af4949a5a9696ac63a2a2ffc => generated 302 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:51.925338 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e667afc-f393-4b34-9414-d9b355ff9237 None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:51.925725 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e667afc-f393-4b34-9414-d9b355ff9237 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:51.926091 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e667afc-f393-4b34-9414-d9b355ff9237 None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:51.927718 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 195/396] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 00:06:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:06:51.934198 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ae5c03-5e87-4599-85a1-4dd7ef4db3e4 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:51.934354 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ae5c03-5e87-4599-85a1-4dd7ef4db3e4 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:51.934622 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ae5c03-5e87-4599-85a1-4dd7ef4db3e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:51.953424 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-c1ae5c03-5e87-4599-85a1-4dd7ef4db3e4 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:06:51.954612 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-c1ae5c03-5e87-4599-85a1-4dd7ef4db3e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:06:51.965496 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ac6806-34a8-41a6-8e02-c0f3f07822ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:51.966504 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ac6806-34a8-41a6-8e02-c0f3f07822ac None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:51.967360 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ac6806-34a8-41a6-8e02-c0f3f07822ac None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:51.967790 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ac6806-34a8-41a6-8e02-c0f3f07822ac None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:51.983602 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ac6806-34a8-41a6-8e02-c0f3f07822ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:06:51.990438 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-f7ac6806-34a8-41a6-8e02-c0f3f07822ac None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 00:06:51.990438 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:51.990438 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:06:51.990438 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:06:51.990438 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:06:51.990438 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:06:51.990438 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:06:51.990438 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:06:51.990438 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:06:51.990438 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:06:51.990438 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:06:51.990438 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:06:51.990438 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:06:51.990438 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:06:51.990438 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:06:51.990438 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:06:51.991446 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:06:51.991446 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:06:51.991446 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:06:51.991446 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:06:51.991446 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:06:51.991446 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:06:51.991446 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:06:51.991446 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:06:51.991446 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:06:51.991446 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:06:51.991446 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:06:51.991446 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Aug 31 00:06:51.991446 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:06:51.991446 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:06:51.991446 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:06:51.991446 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:06:51.992292 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:06:51.992292 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:06:51.992292 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:06:51.992292 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:06:51.992292 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:06:51.992292 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:06:51.992292 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:06:51.992292 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:06:51.992292 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:06:51.992292 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:06:51.992292 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 00:06:51.992292 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Aug 31 00:06:51.992292 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 202/397] 10.222.0.47 () {56 vars in 1114 bytes} [Wed Aug 31 00:06:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:06:51.992292 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ac6806-34a8-41a6-8e02-c0f3f07822ac None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:52.052788 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 196/398] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 00:06:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 00:06:52.054144 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ae5c03-5e87-4599-85a1-4dd7ef4db3e4 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:52.093775 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:52.176388 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ae5c03-5e87-4599-85a1-4dd7ef4db3e4 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:52.202529 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ac6806-34a8-41a6-8e02-c0f3f07822ac None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:52.227146 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8491661b-9b5d-4003-9857-f913ac063659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:52.228139 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8491661b-9b5d-4003-9857-f913ac063659 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:52.228647 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8491661b-9b5d-4003-9857-f913ac063659 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:52.229785 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8491661b-9b5d-4003-9857-f913ac063659 None admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:52.230810 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8491661b-9b5d-4003-9857-f913ac063659 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:52.231635 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8491661b-9b5d-4003-9857-f913ac063659 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:52.233683 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8491661b-9b5d-4003-9857-f913ac063659 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:52.243836 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:52.250252 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 197/399] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 31 00:06:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:52.255375 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e736c690-6047-4d54-9999-4427b9faadaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:52.255375 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e736c690-6047-4d54-9999-4427b9faadaa None admin] REQUEST_METHOD: `PUT` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:52.255375 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e736c690-6047-4d54-9999-4427b9faadaa None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:52.255375 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e736c690-6047-4d54-9999-4427b9faadaa None admin] PATH_INFO: `/v3/projects/f605ca29af4949a5a9696ac63a2a2ffc/groups/29c1333f63bd4988954525f39dfa8922/roles/fdad79ffbcbb4fa380dc9cf7dd108618` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:52.256785 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e736c690-6047-4d54-9999-4427b9faadaa None admin] RBAC: Authorizing `identity:create_grant(project_id=f605ca29af4949a5a9696ac63a2a2ffc, group_id=29c1333f63bd4988954525f39dfa8922, role_id=fdad79ffbcbb4fa380dc9cf7dd108618)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:52.257312 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8491661b-9b5d-4003-9857-f913ac063659 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:52.258277 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e736c690-6047-4d54-9999-4427b9faadaa None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:52.276252 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 203/400] 10.222.0.47 () {58 vars in 1442 bytes} [Wed Aug 31 00:06:51 2022] PUT /identity/v3/projects/f605ca29af4949a5a9696ac63a2a2ffc/groups/29c1333f63bd4988954525f39dfa8922/roles/fdad79ffbcbb4fa380dc9cf7dd108618 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:06:52.387498 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e736c690-6047-4d54-9999-4427b9faadaa None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:52.397786 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:52.414165 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8491661b-9b5d-4003-9857-f913ac063659 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:52.485381 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fceccce-a395-4994-85e6-259752258b62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:52.486465 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fceccce-a395-4994-85e6-259752258b62 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:52.486943 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fceccce-a395-4994-85e6-259752258b62 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:52.487421 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fceccce-a395-4994-85e6-259752258b62 None admin] PATH_INFO: `/v3/groups/29c1333f63bd4988954525f39dfa8922` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:52.493417 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fceccce-a395-4994-85e6-259752258b62 None admin] RBAC: Authorizing `identity:get_group(group_id=29c1333f63bd4988954525f39dfa8922)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:52.496652 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fceccce-a395-4994-85e6-259752258b62 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:52.499954 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 198/401] 10.222.0.47 () {56 vars in 1180 bytes} [Wed Aug 31 00:06:52 2022] GET /identity/v3/groups/29c1333f63bd4988954525f39dfa8922 => generated 226 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:52.509027 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fceccce-a395-4994-85e6-259752258b62 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:52.545628 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e736c690-6047-4d54-9999-4427b9faadaa None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:52.624636 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29181746-c728-4982-ae27-17f5a83678f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:52.626253 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29181746-c728-4982-ae27-17f5a83678f9 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:52.627012 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29181746-c728-4982-ae27-17f5a83678f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:52.627736 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29181746-c728-4982-ae27-17f5a83678f9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:52.662921 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29181746-c728-4982-ae27-17f5a83678f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:06:52.677261 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-29181746-c728-4982-ae27-17f5a83678f9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 00:06:52.677261 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:52.677261 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:06:52.677261 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:06:52.677261 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:06:52.677261 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:06:52.677261 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:06:52.677261 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:06:52.677261 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:06:52.677261 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:06:52.677261 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:06:52.677261 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:06:52.677261 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:06:52.677261 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:06:52.677261 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:06:52.677261 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:06:52.678341 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:06:52.678341 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:06:52.678341 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:06:52.678341 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:06:52.678341 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:06:52.678341 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:06:52.678341 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:06:52.678341 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:06:52.678341 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:06:52.678341 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:06:52.678341 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:06:52.678341 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Aug 31 00:06:52.678341 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:06:52.678341 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:06:52.678341 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:06:52.678341 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:06:52.679177 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:06:52.679177 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:06:52.679177 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:06:52.679177 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:06:52.679177 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:06:52.679177 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:06:52.679177 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:06:52.679177 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:06:52.679177 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:06:52.679177 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:06:52.679177 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 00:06:52.679177 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Aug 31 00:06:52.685475 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 204/402] 10.222.0.47 () {56 vars in 1114 bytes} [Wed Aug 31 00:06:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:06:52.691868 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29181746-c728-4982-ae27-17f5a83678f9 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:52.741600 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fceccce-a395-4994-85e6-259752258b62 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:52.803764 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:52.819272 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0c43ec-e4be-4bef-9a1d-aef371b92104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:52.820246 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0c43ec-e4be-4bef-9a1d-aef371b92104 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:52.820665 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0c43ec-e4be-4bef-9a1d-aef371b92104 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:52.821240 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0c43ec-e4be-4bef-9a1d-aef371b92104 None admin] PATH_INFO: `/v3/projects/24b0845707914a1f9ffa3665e80a3533` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:52.824736 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0c43ec-e4be-4bef-9a1d-aef371b92104 None admin] RBAC: Authorizing `identity:get_project(project_id=24b0845707914a1f9ffa3665e80a3533)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:52.828050 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0c43ec-e4be-4bef-9a1d-aef371b92104 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:52.831510 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 199/403] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 31 00:06:52 2022] GET /identity/v3/projects/24b0845707914a1f9ffa3665e80a3533 => generated 298 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:52.841606 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0c43ec-e4be-4bef-9a1d-aef371b92104 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:52.906606 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29181746-c728-4982-ae27-17f5a83678f9 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:52.928730 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:52.991316 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb96feb3-5471-4cc3-bca9-7db180168783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:52.992462 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb96feb3-5471-4cc3-bca9-7db180168783 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:52.993115 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb96feb3-5471-4cc3-bca9-7db180168783 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:52.993806 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb96feb3-5471-4cc3-bca9-7db180168783 None admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:53.002571 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb96feb3-5471-4cc3-bca9-7db180168783 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:53.003193 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb96feb3-5471-4cc3-bca9-7db180168783 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:53.004899 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb96feb3-5471-4cc3-bca9-7db180168783 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:53.014834 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 205/404] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 31 00:06:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:06:53.020354 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb96feb3-5471-4cc3-bca9-7db180168783 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:53.060625 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0c43ec-e4be-4bef-9a1d-aef371b92104 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:53.144514 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2beb0c30-af38-4a42-8fb2-bb04d0a4a92e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:53.146187 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beb0c30-af38-4a42-8fb2-bb04d0a4a92e None admin] REQUEST_METHOD: `PUT` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:53.146876 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beb0c30-af38-4a42-8fb2-bb04d0a4a92e None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:53.147534 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beb0c30-af38-4a42-8fb2-bb04d0a4a92e None admin] PATH_INFO: `/v3/projects/24b0845707914a1f9ffa3665e80a3533/groups/29c1333f63bd4988954525f39dfa8922/roles/89f25837440e4981bad54fe74d242232` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:53.152984 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2beb0c30-af38-4a42-8fb2-bb04d0a4a92e None admin] RBAC: Authorizing `identity:create_grant(project_id=24b0845707914a1f9ffa3665e80a3533, group_id=29c1333f63bd4988954525f39dfa8922, role_id=89f25837440e4981bad54fe74d242232)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:53.155766 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2beb0c30-af38-4a42-8fb2-bb04d0a4a92e None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:53.178232 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb96feb3-5471-4cc3-bca9-7db180168783 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:53.188361 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 200/405] 10.222.0.47 () {58 vars in 1442 bytes} [Wed Aug 31 00:06:52 2022] PUT /identity/v3/projects/24b0845707914a1f9ffa3665e80a3533/groups/29c1333f63bd4988954525f39dfa8922/roles/89f25837440e4981bad54fe74d242232 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:06:53.191349 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fb5810-a821-423b-a725-2c190516dc3d None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:53.191812 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fb5810-a821-423b-a725-2c190516dc3d None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:53.192278 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fb5810-a821-423b-a725-2c190516dc3d None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:53.195246 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 201/406] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 00:06:53 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:06:53.203924 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:53.207695 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dc066f-4412-4b3e-b310-4d494c614e41 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:53.208050 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dc066f-4412-4b3e-b310-4d494c614e41 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:53.211029 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dc066f-4412-4b3e-b310-4d494c614e41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:53.235755 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1ff055-b51c-4954-bf42-02d2288f7f83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:53.236632 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1ff055-b51c-4954-bf42-02d2288f7f83 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:53.236919 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1ff055-b51c-4954-bf42-02d2288f7f83 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:53.238521 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1ff055-b51c-4954-bf42-02d2288f7f83 None admin] PATH_INFO: `/v3/groups/29c1333f63bd4988954525f39dfa8922` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:53.238717 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1ff055-b51c-4954-bf42-02d2288f7f83 None admin] RBAC: Authorizing `identity:get_group(group_id=29c1333f63bd4988954525f39dfa8922)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:53.240071 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1ff055-b51c-4954-bf42-02d2288f7f83 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:53.242220 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 206/407] 10.222.0.47 () {56 vars in 1180 bytes} [Wed Aug 31 00:06:53 2022] GET /identity/v3/groups/29c1333f63bd4988954525f39dfa8922 => generated 226 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:06:53.249261 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1ff055-b51c-4954-bf42-02d2288f7f83 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:53.265384 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-a5dc066f-4412-4b3e-b310-4d494c614e41 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:06:53.266633 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-a5dc066f-4412-4b3e-b310-4d494c614e41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:06:53.380867 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1ff055-b51c-4954-bf42-02d2288f7f83 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:53.423625 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25407b2-efae-4483-a750-d892a9a54a18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:53.424711 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25407b2-efae-4483-a750-d892a9a54a18 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:53.424846 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25407b2-efae-4483-a750-d892a9a54a18 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:53.425274 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25407b2-efae-4483-a750-d892a9a54a18 None admin] PATH_INFO: `/v3/projects/f605ca29af4949a5a9696ac63a2a2ffc` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:53.426795 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25407b2-efae-4483-a750-d892a9a54a18 None admin] RBAC: Authorizing `identity:get_project(project_id=f605ca29af4949a5a9696ac63a2a2ffc)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:53.428056 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25407b2-efae-4483-a750-d892a9a54a18 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:53.430187 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 207/408] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 31 00:06:53 2022] GET /identity/v3/projects/f605ca29af4949a5a9696ac63a2a2ffc => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:06:53.440816 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25407b2-efae-4483-a750-d892a9a54a18 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:53.488535 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 202/409] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 00:06:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 00:06:53.523698 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:53.565342 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25407b2-efae-4483-a750-d892a9a54a18 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:53.604367 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2384dc16-42ee-4e1f-b041-83769244ee22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:53.605136 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2384dc16-42ee-4e1f-b041-83769244ee22 None admin] REQUEST_METHOD: `PUT` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:53.606099 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2384dc16-42ee-4e1f-b041-83769244ee22 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:53.606562 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2384dc16-42ee-4e1f-b041-83769244ee22 None admin] PATH_INFO: `/v3/projects/f605ca29af4949a5a9696ac63a2a2ffc/groups/29c1333f63bd4988954525f39dfa8922/roles/89f25837440e4981bad54fe74d242232` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:53.608916 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2384dc16-42ee-4e1f-b041-83769244ee22 None admin] RBAC: Authorizing `identity:create_grant(project_id=f605ca29af4949a5a9696ac63a2a2ffc, group_id=29c1333f63bd4988954525f39dfa8922, role_id=89f25837440e4981bad54fe74d242232)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:53.610384 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2384dc16-42ee-4e1f-b041-83769244ee22 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:53.630132 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 208/410] 10.222.0.47 () {58 vars in 1442 bytes} [Wed Aug 31 00:06:53 2022] PUT /identity/v3/projects/f605ca29af4949a5a9696ac63a2a2ffc/groups/29c1333f63bd4988954525f39dfa8922/roles/89f25837440e4981bad54fe74d242232 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:06:53.932734 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dc066f-4412-4b3e-b310-4d494c614e41 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:53.968020 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:54.004190 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f90cff2-9e80-4d39-82ae-33fd65ad2f76 None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:54.004499 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f90cff2-9e80-4d39-82ae-33fd65ad2f76 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:54.004752 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f90cff2-9e80-4d39-82ae-33fd65ad2f76 None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:54.006398 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 209/411] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 00:06:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:06:54.014120 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d5f52a-dde3-47d2-9ae5-2aaa7b9d2eda None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:54.014404 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d5f52a-dde3-47d2-9ae5-2aaa7b9d2eda None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:54.014848 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d5f52a-dde3-47d2-9ae5-2aaa7b9d2eda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:54.050589 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-44d5f52a-dde3-47d2-9ae5-2aaa7b9d2eda None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:06:54.053628 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-44d5f52a-dde3-47d2-9ae5-2aaa7b9d2eda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:06:54.101982 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dc066f-4412-4b3e-b310-4d494c614e41 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:54.171123 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c6ec85-b488-44ab-a5a4-6c97fb26a215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:54.171771 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c6ec85-b488-44ab-a5a4-6c97fb26a215 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:54.172048 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c6ec85-b488-44ab-a5a4-6c97fb26a215 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:54.172350 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c6ec85-b488-44ab-a5a4-6c97fb26a215 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:54.198678 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c6ec85-b488-44ab-a5a4-6c97fb26a215 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:06:54.203301 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 210/412] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 00:06:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:06:54.208310 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-88c6ec85-b488-44ab-a5a4-6c97fb26a215 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:06:54.208310 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:54.208310 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:06:54.208310 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:06:54.208310 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:06:54.208310 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:06:54.208310 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:06:54.208310 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:06:54.208310 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:06:54.208310 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:06:54.208310 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:06:54.208310 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:06:54.208310 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:06:54.208310 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:06:54.208310 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:06:54.208310 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:06:54.210085 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:06:54.210085 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:06:54.210085 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:06:54.210085 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:06:54.210085 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:06:54.210085 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:06:54.210085 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:06:54.210085 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:06:54.210085 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:06:54.210085 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:06:54.210085 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:06:54.210085 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 31 00:06:54.210085 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:06:54.210085 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:06:54.210085 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:06:54.210085 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:06:54.211675 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:06:54.211675 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:06:54.211675 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:06:54.211675 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:06:54.211675 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:06:54.211675 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:06:54.211675 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:06:54.211675 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:06:54.211675 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:06:54.211675 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:06:54.211675 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:06:54.211675 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 31 00:06:54.212983 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 203/413] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Aug 31 00:06:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:06:54.215766 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d5f52a-dde3-47d2-9ae5-2aaa7b9d2eda None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:54.303567 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:54.390335 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d5f52a-dde3-47d2-9ae5-2aaa7b9d2eda None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:54.431766 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3ad99c-824d-4caf-afcd-0fff93ad3e3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:54.432557 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3ad99c-824d-4caf-afcd-0fff93ad3e3d None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:54.432760 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3ad99c-824d-4caf-afcd-0fff93ad3e3d None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:54.433038 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3ad99c-824d-4caf-afcd-0fff93ad3e3d None admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:54.434955 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3ad99c-824d-4caf-afcd-0fff93ad3e3d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:54.435268 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3ad99c-824d-4caf-afcd-0fff93ad3e3d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:54.436798 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3ad99c-824d-4caf-afcd-0fff93ad3e3d None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:54.445907 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 211/414] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 31 00:06:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:54.453059 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c6ec85-b488-44ab-a5a4-6c97fb26a215 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:54.561010 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:54.580236 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c6ec85-b488-44ab-a5a4-6c97fb26a215 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:54.619007 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e1c93a-f1fc-4903-8a09-7cf4e2b53452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:54.619655 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e1c93a-f1fc-4903-8a09-7cf4e2b53452 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:54.619927 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e1c93a-f1fc-4903-8a09-7cf4e2b53452 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:54.620244 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e1c93a-f1fc-4903-8a09-7cf4e2b53452 None admin] PATH_INFO: `/v3/groups/8bb9f103d76341e38c252bbb57150e81` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:54.622216 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e1c93a-f1fc-4903-8a09-7cf4e2b53452 None admin] RBAC: Authorizing `identity:get_group(group_id=8bb9f103d76341e38c252bbb57150e81)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:54.623871 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e1c93a-f1fc-4903-8a09-7cf4e2b53452 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:54.626161 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 204/415] 10.222.0.47 () {56 vars in 1180 bytes} [Wed Aug 31 00:06:54 2022] GET /identity/v3/groups/8bb9f103d76341e38c252bbb57150e81 => generated 229 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:54.627398 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3ad99c-824d-4caf-afcd-0fff93ad3e3d None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:54.634573 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e1c93a-f1fc-4903-8a09-7cf4e2b53452 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:54.805642 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:54.809851 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3ad99c-824d-4caf-afcd-0fff93ad3e3d None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:54.811166 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e1c93a-f1fc-4903-8a09-7cf4e2b53452 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:54.852899 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec002ba7-1934-44b6-bbc5-1d58efa31f88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:54.853534 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec002ba7-1934-44b6-bbc5-1d58efa31f88 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:54.853814 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec002ba7-1934-44b6-bbc5-1d58efa31f88 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:54.854088 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec002ba7-1934-44b6-bbc5-1d58efa31f88 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:54.860877 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a4d76a-7d4c-4977-a4dd-e3126f2a2bcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:54.862159 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a4d76a-7d4c-4977-a4dd-e3126f2a2bcd None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:54.862733 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a4d76a-7d4c-4977-a4dd-e3126f2a2bcd None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:54.863214 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a4d76a-7d4c-4977-a4dd-e3126f2a2bcd None admin] PATH_INFO: `/v3/projects/549d5b0e486743c994271a9e51f4023c` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:54.865196 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a4d76a-7d4c-4977-a4dd-e3126f2a2bcd None admin] RBAC: Authorizing `identity:get_project(project_id=549d5b0e486743c994271a9e51f4023c)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:54.867123 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a4d76a-7d4c-4977-a4dd-e3126f2a2bcd None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:54.867323 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec002ba7-1934-44b6-bbc5-1d58efa31f88 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:06:54.869196 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 205/416] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 31 00:06:54 2022] GET /identity/v3/projects/549d5b0e486743c994271a9e51f4023c => generated 344 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:54.870786 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c5a476-e7fa-4a9c-a616-3d60648a4ac1 None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:54.871266 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c5a476-e7fa-4a9c-a616-3d60648a4ac1 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:54.871744 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c5a476-e7fa-4a9c-a616-3d60648a4ac1 None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:54.873474 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 206/417] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 00:06:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:06:54.875542 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c5a476-e7fa-4a9c-a616-3d60648a4ac1 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:54.878151 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-ec002ba7-1934-44b6-bbc5-1d58efa31f88 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 00:06:54.878151 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:54.878151 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:06:54.878151 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:06:54.878151 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:06:54.878151 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:06:54.878151 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:06:54.878151 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:06:54.878151 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:06:54.878151 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:06:54.878151 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:06:54.878151 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:06:54.878151 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:06:54.878151 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:06:54.878151 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:06:54.878151 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:06:54.879053 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:06:54.879053 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:06:54.879053 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:06:54.879053 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:06:54.879053 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:06:54.879053 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:06:54.879053 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:06:54.879053 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:06:54.879053 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:06:54.879053 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:06:54.879053 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:06:54.879053 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Aug 31 00:06:54.879053 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:06:54.879053 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:06:54.879053 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:06:54.879053 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:06:54.880436 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:06:54.880436 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:06:54.880436 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:06:54.880436 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:06:54.880436 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:06:54.880436 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:06:54.880436 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:06:54.880436 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:06:54.880436 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:06:54.880436 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:06:54.880436 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 00:06:54.880436 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Aug 31 00:06:54.880436 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 212/418] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 31 00:06:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:06:54.885411 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d1c259-d4cd-4884-928f-cb596ef0dd8b None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:54.885702 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d1c259-d4cd-4884-928f-cb596ef0dd8b None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:54.885980 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d1c259-d4cd-4884-928f-cb596ef0dd8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:54.904872 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:54.907379 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-f6d1c259-d4cd-4884-928f-cb596ef0dd8b None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:06:54.908566 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-f6d1c259-d4cd-4884-928f-cb596ef0dd8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:06:55.049908 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 213/419] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 00:06:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:06:55.051607 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d1c259-d4cd-4884-928f-cb596ef0dd8b None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:55.063637 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c5a476-e7fa-4a9c-a616-3d60648a4ac1 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:55.126800 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b68499-9e06-45c1-b7ba-8d4c14f88ee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:55.128387 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b68499-9e06-45c1-b7ba-8d4c14f88ee3 None admin] REQUEST_METHOD: `PUT` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:55.129033 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b68499-9e06-45c1-b7ba-8d4c14f88ee3 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:55.129727 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b68499-9e06-45c1-b7ba-8d4c14f88ee3 None admin] PATH_INFO: `/v3/projects/549d5b0e486743c994271a9e51f4023c/groups/8bb9f103d76341e38c252bbb57150e81/roles/12f6817f9aaa4e2bb477095a6bed5d0f` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:55.134133 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b68499-9e06-45c1-b7ba-8d4c14f88ee3 None admin] RBAC: Authorizing `identity:create_grant(project_id=549d5b0e486743c994271a9e51f4023c, group_id=8bb9f103d76341e38c252bbb57150e81, role_id=12f6817f9aaa4e2bb477095a6bed5d0f)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:55.140068 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b68499-9e06-45c1-b7ba-8d4c14f88ee3 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:55.174099 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 207/420] 10.222.0.47 () {58 vars in 1442 bytes} [Wed Aug 31 00:06:54 2022] PUT /identity/v3/projects/549d5b0e486743c994271a9e51f4023c/groups/8bb9f103d76341e38c252bbb57150e81/roles/12f6817f9aaa4e2bb477095a6bed5d0f => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:06:55.410550 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:55.442662 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d1c259-d4cd-4884-928f-cb596ef0dd8b None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:55.538333 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f6972e-a0ee-4065-8279-1acd1f3cee94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:55.539875 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f6972e-a0ee-4065-8279-1acd1f3cee94 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:55.540707 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f6972e-a0ee-4065-8279-1acd1f3cee94 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:55.541464 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f6972e-a0ee-4065-8279-1acd1f3cee94 None admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:55.542984 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f6972e-a0ee-4065-8279-1acd1f3cee94 None admin] RBAC: Adding query filter params (name=member) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:55.543714 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f6972e-a0ee-4065-8279-1acd1f3cee94 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:55.546644 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f6972e-a0ee-4065-8279-1acd1f3cee94 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:55.562887 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 214/421] 10.222.0.47 () {56 vars in 1101 bytes} [Wed Aug 31 00:06:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 512 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:55.577332 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b68499-9e06-45c1-b7ba-8d4c14f88ee3 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:55.579919 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f6972e-a0ee-4065-8279-1acd1f3cee94 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:55.711385 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:55.810735 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b68499-9e06-45c1-b7ba-8d4c14f88ee3 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:55.949534 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1d6d81-aa1c-4f54-957c-1dc138f9e94e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:55.950675 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1d6d81-aa1c-4f54-957c-1dc138f9e94e None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:55.950675 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1d6d81-aa1c-4f54-957c-1dc138f9e94e None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:55.950934 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1d6d81-aa1c-4f54-957c-1dc138f9e94e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:55.961893 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f6972e-a0ee-4065-8279-1acd1f3cee94 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:56.057715 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1fb8e8-9893-4dd3-a4a3-dca74cef0228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:56.058686 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1fb8e8-9893-4dd3-a4a3-dca74cef0228 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:56.058686 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1fb8e8-9893-4dd3-a4a3-dca74cef0228 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:56.059017 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1fb8e8-9893-4dd3-a4a3-dca74cef0228 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:56.079700 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1fb8e8-9893-4dd3-a4a3-dca74cef0228 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:06:56.086462 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-4f1fb8e8-9893-4dd3-a4a3-dca74cef0228 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 00:06:56.086462 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:56.086462 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:06:56.086462 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:06:56.086462 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:06:56.086462 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:06:56.086462 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:06:56.086462 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:06:56.086462 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:06:56.086462 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:06:56.086462 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:06:56.086462 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:06:56.086462 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:06:56.086462 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:06:56.086462 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:06:56.086462 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:06:56.088099 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:06:56.088099 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:06:56.088099 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:06:56.088099 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:06:56.088099 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:06:56.088099 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:06:56.088099 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:06:56.088099 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:06:56.088099 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:06:56.088099 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:06:56.088099 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:06:56.088099 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Aug 31 00:06:56.088099 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:06:56.088099 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:06:56.088099 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:06:56.088099 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:06:56.090760 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:06:56.090760 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:06:56.090760 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:06:56.090760 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:06:56.090760 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:06:56.090760 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:06:56.090760 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:06:56.090760 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:06:56.090760 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:06:56.090760 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:06:56.090760 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 00:06:56.090760 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Aug 31 00:06:56.093328 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 215/422] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 31 00:06:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 514 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:06:56.094853 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abf574b-2644-4f84-a3d2-824c3a3ec786 None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:56.095143 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abf574b-2644-4f84-a3d2-824c3a3ec786 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:56.095411 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abf574b-2644-4f84-a3d2-824c3a3ec786 None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:56.096989 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 216/423] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 00:06:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:06:56.097767 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abf574b-2644-4f84-a3d2-824c3a3ec786 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:56.122389 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:56.235952 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1d6d81-aa1c-4f54-957c-1dc138f9e94e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:56.238666 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1d6d81-aa1c-4f54-957c-1dc138f9e94e None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:56.254365 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abf574b-2644-4f84-a3d2-824c3a3ec786 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:56.301317 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0934bafa-edd6-4100-adc2-a904ce47be9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:56.302371 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0934bafa-edd6-4100-adc2-a904ce47be9c None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:56.302898 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0934bafa-edd6-4100-adc2-a904ce47be9c None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:56.303436 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0934bafa-edd6-4100-adc2-a904ce47be9c None admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:56.304334 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0934bafa-edd6-4100-adc2-a904ce47be9c None admin] RBAC: Adding query filter params (name=member) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:56.304839 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0934bafa-edd6-4100-adc2-a904ce47be9c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:56.306473 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0934bafa-edd6-4100-adc2-a904ce47be9c None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:56.321491 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 217/424] 10.222.0.47 () {56 vars in 1101 bytes} [Wed Aug 31 00:06:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:56.323457 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b5eb48-05b7-4ad4-8c67-01313cb62649 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:56.324986 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b5eb48-05b7-4ad4-8c67-01313cb62649 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:56.325477 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b5eb48-05b7-4ad4-8c67-01313cb62649 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:56.346058 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-51b5eb48-05b7-4ad4-8c67-01313cb62649 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:06:56.347740 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-51b5eb48-05b7-4ad4-8c67-01313cb62649 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:06:56.391105 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:56.430922 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 208/425] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 31 00:06:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 850 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 00:06:56.430922 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1d6d81-aa1c-4f54-957c-1dc138f9e94e None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:56.434238 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 218/426] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 00:06:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:06:56.435334 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b5eb48-05b7-4ad4-8c67-01313cb62649 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:56.439090 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:56.552372 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b5eb48-05b7-4ad4-8c67-01313cb62649 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:56.594235 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b6d86a-6b4f-4657-a965-92652f43e99f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:56.595388 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b6d86a-6b4f-4657-a965-92652f43e99f None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:56.595872 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b6d86a-6b4f-4657-a965-92652f43e99f None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:56.596406 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b6d86a-6b4f-4657-a965-92652f43e99f None admin] PATH_INFO: `/v3/projects/24b0845707914a1f9ffa3665e80a3533` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:56.597864 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b6d86a-6b4f-4657-a965-92652f43e99f None admin] RBAC: Authorizing `identity:get_project(project_id=24b0845707914a1f9ffa3665e80a3533)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:56.599571 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b6d86a-6b4f-4657-a965-92652f43e99f None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:56.601633 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 219/427] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 31 00:06:56 2022] GET /identity/v3/projects/24b0845707914a1f9ffa3665e80a3533 => generated 298 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:56.603151 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13008f6-d8d9-499a-a2cd-e05c49a857d1 None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:56.603645 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13008f6-d8d9-499a-a2cd-e05c49a857d1 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:56.604125 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13008f6-d8d9-499a-a2cd-e05c49a857d1 None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:56.606325 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 220/428] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 00:06:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:06:56.607607 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13008f6-d8d9-499a-a2cd-e05c49a857d1 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:56.612857 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1d6d81-aa1c-4f54-957c-1dc138f9e94e None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:56.676078 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303812b0-e2b1-428f-beee-617d6e34f964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:56.677253 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303812b0-e2b1-428f-beee-617d6e34f964 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:56.677253 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303812b0-e2b1-428f-beee-617d6e34f964 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:56.677464 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303812b0-e2b1-428f-beee-617d6e34f964 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:56.694315 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:56.733955 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13008f6-d8d9-499a-a2cd-e05c49a857d1 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:56.736728 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:56.760264 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303812b0-e2b1-428f-beee-617d6e34f964 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:56.761972 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303812b0-e2b1-428f-beee-617d6e34f964 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:56.785597 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629f8e55-3ffe-482c-9fe6-19183e949a54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:56.786811 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629f8e55-3ffe-482c-9fe6-19183e949a54 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:56.787097 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629f8e55-3ffe-482c-9fe6-19183e949a54 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:56.787374 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629f8e55-3ffe-482c-9fe6-19183e949a54 None admin] PATH_INFO: `/v3/groups/29c1333f63bd4988954525f39dfa8922` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:56.788742 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629f8e55-3ffe-482c-9fe6-19183e949a54 None admin] RBAC: Authorizing `identity:get_group(group_id=29c1333f63bd4988954525f39dfa8922)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:56.790302 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629f8e55-3ffe-482c-9fe6-19183e949a54 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:56.794201 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 221/429] 10.222.0.47 () {56 vars in 1180 bytes} [Wed Aug 31 00:06:56 2022] GET /identity/v3/groups/29c1333f63bd4988954525f39dfa8922 => generated 226 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:06:56.796369 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b74b470-26c5-4906-bd8a-ce01b74c0528 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:56.796660 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b74b470-26c5-4906-bd8a-ce01b74c0528 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:56.796934 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b74b470-26c5-4906-bd8a-ce01b74c0528 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:56.822476 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-2b74b470-26c5-4906-bd8a-ce01b74c0528 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:06:56.824201 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-2b74b470-26c5-4906-bd8a-ce01b74c0528 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:06:56.895841 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 209/430] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 31 00:06:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 00:06:56.895841 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303812b0-e2b1-428f-beee-617d6e34f964 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:56.905999 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 222/431] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 00:06:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:06:56.907239 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b74b470-26c5-4906-bd8a-ce01b74c0528 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:56.988061 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:57.004575 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:57.038188 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303812b0-e2b1-428f-beee-617d6e34f964 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:57.044568 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b74b470-26c5-4906-bd8a-ce01b74c0528 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:57.098049 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab682e2e-9855-49fe-9378-b975a00543c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:57.099138 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab682e2e-9855-49fe-9378-b975a00543c2 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:57.099606 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab682e2e-9855-49fe-9378-b975a00543c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:57.100053 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab682e2e-9855-49fe-9378-b975a00543c2 None admin] PATH_INFO: `/v3/projects/f605ca29af4949a5a9696ac63a2a2ffc` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:57.101784 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab682e2e-9855-49fe-9378-b975a00543c2 None admin] RBAC: Authorizing `identity:get_project(project_id=f605ca29af4949a5a9696ac63a2a2ffc)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:57.104232 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab682e2e-9855-49fe-9378-b975a00543c2 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:57.112733 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 223/432] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 31 00:06:56 2022] GET /identity/v3/projects/f605ca29af4949a5a9696ac63a2a2ffc => generated 302 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:57.113953 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab682e2e-9855-49fe-9378-b975a00543c2 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:57.114900 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63a80f9-75cf-4f3b-9ae8-b1a07ffaadda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:57.116279 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63a80f9-75cf-4f3b-9ae8-b1a07ffaadda None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:57.117117 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63a80f9-75cf-4f3b-9ae8-b1a07ffaadda None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:57.117939 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63a80f9-75cf-4f3b-9ae8-b1a07ffaadda None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:57.119889 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63a80f9-75cf-4f3b-9ae8-b1a07ffaadda None admin] RBAC: Adding query filter params (group.id=29c1333f63bd4988954525f39dfa8922, role.id=fdad79ffbcbb4fa380dc9cf7dd108618, scope.project.id=24b0845707914a1f9ffa3665e80a3533) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:57.120821 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63a80f9-75cf-4f3b-9ae8-b1a07ffaadda None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:57.123804 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63a80f9-75cf-4f3b-9ae8-b1a07ffaadda None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:57.136533 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 210/433] 10.222.0.47 () {56 vars in 1376 bytes} [Wed Aug 31 00:06:56 2022] GET /identity/v3/role_assignments?group.id=29c1333f63bd4988954525f39dfa8922&scope.project.id=24b0845707914a1f9ffa3665e80a3533&role.id=fdad79ffbcbb4fa380dc9cf7dd108618 => generated 611 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:57.138566 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63a80f9-75cf-4f3b-9ae8-b1a07ffaadda None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:57.282817 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab682e2e-9855-49fe-9378-b975a00543c2 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:57.347319 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63a80f9-75cf-4f3b-9ae8-b1a07ffaadda None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:57.350347 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b5f110-084c-4fd7-baf2-800e65e920d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:57.351437 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b5f110-084c-4fd7-baf2-800e65e920d2 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:57.351914 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b5f110-084c-4fd7-baf2-800e65e920d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:57.352416 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b5f110-084c-4fd7-baf2-800e65e920d2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:57.366969 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:57.378204 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b5f110-084c-4fd7-baf2-800e65e920d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:06:57.391963 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-59b5f110-084c-4fd7-baf2-800e65e920d2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 00:06:57.391963 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:57.391963 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:06:57.391963 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:06:57.391963 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:06:57.391963 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:06:57.391963 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:06:57.391963 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:06:57.391963 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:06:57.391963 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:06:57.391963 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:06:57.391963 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:06:57.391963 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:06:57.391963 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:06:57.391963 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:06:57.391963 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:06:57.393817 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:06:57.393817 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:06:57.393817 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:06:57.393817 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:06:57.393817 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:06:57.393817 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:06:57.393817 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:06:57.393817 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:06:57.393817 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:06:57.393817 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:06:57.393817 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:06:57.393817 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Aug 31 00:06:57.393817 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:06:57.393817 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:06:57.393817 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:06:57.393817 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:06:57.395382 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:06:57.395382 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:06:57.395382 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:06:57.395382 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:06:57.395382 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:06:57.395382 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:06:57.395382 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:06:57.395382 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:06:57.395382 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:06:57.395382 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:06:57.395382 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 00:06:57.395382 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Aug 31 00:06:57.399132 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 224/434] 10.222.0.47 () {56 vars in 1114 bytes} [Wed Aug 31 00:06:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:06:57.399840 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b5f110-084c-4fd7-baf2-800e65e920d2 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:57.430328 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea40a255-c45a-4558-a64d-cfbdaa1858a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:57.431273 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea40a255-c45a-4558-a64d-cfbdaa1858a9 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:57.431740 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea40a255-c45a-4558-a64d-cfbdaa1858a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:57.432252 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea40a255-c45a-4558-a64d-cfbdaa1858a9 None admin] PATH_INFO: `/v3/groups/29c1333f63bd4988954525f39dfa8922` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:57.434279 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea40a255-c45a-4558-a64d-cfbdaa1858a9 None admin] RBAC: Authorizing `identity:get_group(group_id=29c1333f63bd4988954525f39dfa8922)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:57.436910 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea40a255-c45a-4558-a64d-cfbdaa1858a9 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:57.439475 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 211/435] 10.222.0.47 () {56 vars in 1180 bytes} [Wed Aug 31 00:06:57 2022] GET /identity/v3/groups/29c1333f63bd4988954525f39dfa8922 => generated 226 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:57.442112 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea40a255-c45a-4558-a64d-cfbdaa1858a9 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:57.471823 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:57.608365 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b5f110-084c-4fd7-baf2-800e65e920d2 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:57.629701 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea40a255-c45a-4558-a64d-cfbdaa1858a9 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:57.663502 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaa898d-5a90-412c-a498-3984b033150b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:57.664224 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaa898d-5a90-412c-a498-3984b033150b None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:57.664708 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaa898d-5a90-412c-a498-3984b033150b None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:57.665113 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaa898d-5a90-412c-a498-3984b033150b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:57.679165 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aaa898d-5a90-412c-a498-3984b033150b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:06:57.686357 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-6aaa898d-5a90-412c-a498-3984b033150b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 00:06:57.686357 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:57.686357 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:06:57.686357 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:06:57.686357 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:06:57.686357 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:06:57.686357 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:06:57.686357 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:06:57.686357 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:06:57.686357 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:06:57.686357 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:06:57.686357 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:06:57.686357 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:06:57.686357 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:06:57.686357 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:06:57.686357 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:06:57.687333 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:06:57.687333 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:06:57.687333 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:06:57.687333 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:06:57.687333 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:06:57.687333 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:06:57.687333 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:06:57.687333 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:06:57.687333 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:06:57.687333 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:06:57.687333 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:06:57.687333 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Aug 31 00:06:57.687333 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:06:57.687333 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:06:57.687333 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:06:57.687333 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:06:57.688145 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:06:57.688145 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:06:57.688145 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:06:57.688145 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:06:57.688145 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:06:57.688145 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:06:57.688145 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:06:57.688145 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:06:57.688145 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:06:57.688145 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:06:57.688145 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 00:06:57.688145 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Aug 31 00:06:57.688145 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 225/436] 10.222.0.47 () {56 vars in 1114 bytes} [Wed Aug 31 00:06:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:06:57.688907 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaa898d-5a90-412c-a498-3984b033150b None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:57.695886 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76b2b6c-c58e-4188-b0a7-77daae7f321f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:57.696869 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76b2b6c-c58e-4188-b0a7-77daae7f321f None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:57.697179 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76b2b6c-c58e-4188-b0a7-77daae7f321f None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:57.697450 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76b2b6c-c58e-4188-b0a7-77daae7f321f None admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:57.698080 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76b2b6c-c58e-4188-b0a7-77daae7f321f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:57.698380 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76b2b6c-c58e-4188-b0a7-77daae7f321f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:57.701911 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76b2b6c-c58e-4188-b0a7-77daae7f321f None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:57.711728 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 212/437] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 31 00:06:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:57.712354 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76b2b6c-c58e-4188-b0a7-77daae7f321f None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:57.777915 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:57.818968 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:57.848827 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaa898d-5a90-412c-a498-3984b033150b None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:57.852374 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76b2b6c-c58e-4188-b0a7-77daae7f321f None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:57.887308 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd132c53-039c-4990-97c2-61912bf726ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:57.887965 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd132c53-039c-4990-97c2-61912bf726ed None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:57.888282 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd132c53-039c-4990-97c2-61912bf726ed None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:57.888561 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd132c53-039c-4990-97c2-61912bf726ed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:57.889312 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd132c53-039c-4990-97c2-61912bf726ed None admin] RBAC: Adding query filter params (group.id=29c1333f63bd4988954525f39dfa8922, role.id=fdad79ffbcbb4fa380dc9cf7dd108618, scope.project.id=f605ca29af4949a5a9696ac63a2a2ffc) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:57.889625 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd132c53-039c-4990-97c2-61912bf726ed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:57.891118 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd132c53-039c-4990-97c2-61912bf726ed None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:57.891553 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007a09f7-82b3-40fb-aff9-53479b82849b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:57.892194 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007a09f7-82b3-40fb-aff9-53479b82849b None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:57.892476 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007a09f7-82b3-40fb-aff9-53479b82849b None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:57.892748 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007a09f7-82b3-40fb-aff9-53479b82849b None admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:57.893426 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007a09f7-82b3-40fb-aff9-53479b82849b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:57.893728 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007a09f7-82b3-40fb-aff9-53479b82849b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:57.895144 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007a09f7-82b3-40fb-aff9-53479b82849b None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:57.897722 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 226/438] 10.222.0.47 () {56 vars in 1376 bytes} [Wed Aug 31 00:06:57 2022] GET /identity/v3/role_assignments?group.id=29c1333f63bd4988954525f39dfa8922&scope.project.id=f605ca29af4949a5a9696ac63a2a2ffc&role.id=fdad79ffbcbb4fa380dc9cf7dd108618 => generated 611 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:57.898556 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd132c53-039c-4990-97c2-61912bf726ed None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:57.911830 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 213/439] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 31 00:06:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:57.913322 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ddd848-c8d9-494e-a6a1-f03e5d93608f None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:57.913648 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ddd848-c8d9-494e-a6a1-f03e5d93608f None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:57.914125 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ddd848-c8d9-494e-a6a1-f03e5d93608f None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:57.915714 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 214/440] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 00:06:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:06:57.925622 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d52588-4c9d-48f5-b964-e971f6eb41b5 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:57.926080 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d52588-4c9d-48f5-b964-e971f6eb41b5 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:57.926884 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d52588-4c9d-48f5-b964-e971f6eb41b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:57.958215 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-85d52588-4c9d-48f5-b964-e971f6eb41b5 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:06:57.960490 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-85d52588-4c9d-48f5-b964-e971f6eb41b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:06:58.058785 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd132c53-039c-4990-97c2-61912bf726ed None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:58.087731 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 215/441] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 00:06:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:06:58.088567 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d52588-4c9d-48f5-b964-e971f6eb41b5 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:58.095001 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:58.123836 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44b90f9-cd61-416c-ab83-a036f7640cd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:58.124915 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44b90f9-cd61-416c-ab83-a036f7640cd6 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:58.125335 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44b90f9-cd61-416c-ab83-a036f7640cd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:58.125769 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44b90f9-cd61-416c-ab83-a036f7640cd6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:58.195305 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:58.249243 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44b90f9-cd61-416c-ab83-a036f7640cd6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:58.250741 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44b90f9-cd61-416c-ab83-a036f7640cd6 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:58.256992 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d52588-4c9d-48f5-b964-e971f6eb41b5 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:58.318644 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6179dd4c-f733-4c74-beb0-5588d53e2e87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:58.319425 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6179dd4c-f733-4c74-beb0-5588d53e2e87 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:58.319899 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6179dd4c-f733-4c74-beb0-5588d53e2e87 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:58.320390 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6179dd4c-f733-4c74-beb0-5588d53e2e87 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:58.415293 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6179dd4c-f733-4c74-beb0-5588d53e2e87 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:58.417295 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6179dd4c-f733-4c74-beb0-5588d53e2e87 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:58.425648 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 227/442] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 31 00:06:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 527 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 00:06:58.434412 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44b90f9-cd61-416c-ab83-a036f7640cd6 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:58.469898 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:58.513456 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:58.558487 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 216/443] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 31 00:06:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 470 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 00:06:58.559514 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6179dd4c-f733-4c74-beb0-5588d53e2e87 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:58.602663 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44b90f9-cd61-416c-ab83-a036f7640cd6 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:58.643711 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298c25f3-d94d-4e50-9d2b-461eb36e489c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:58.644456 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298c25f3-d94d-4e50-9d2b-461eb36e489c None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:58.644705 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298c25f3-d94d-4e50-9d2b-461eb36e489c None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:58.644981 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298c25f3-d94d-4e50-9d2b-461eb36e489c None admin] PATH_INFO: `/v3/projects/24b0845707914a1f9ffa3665e80a3533` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:58.646165 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298c25f3-d94d-4e50-9d2b-461eb36e489c None admin] RBAC: Authorizing `identity:get_project(project_id=24b0845707914a1f9ffa3665e80a3533)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:58.647638 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298c25f3-d94d-4e50-9d2b-461eb36e489c None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:58.649346 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 228/444] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 31 00:06:58 2022] GET /identity/v3/projects/24b0845707914a1f9ffa3665e80a3533 => generated 298 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:58.650127 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298c25f3-d94d-4e50-9d2b-461eb36e489c None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:58.706174 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6179dd4c-f733-4c74-beb0-5588d53e2e87 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:58.757102 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8f785b-1d54-4464-89cc-c7dc4c4ecb06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:58.757836 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8f785b-1d54-4464-89cc-c7dc4c4ecb06 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:58.758222 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8f785b-1d54-4464-89cc-c7dc4c4ecb06 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:58.758537 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8f785b-1d54-4464-89cc-c7dc4c4ecb06 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:58.772418 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8f785b-1d54-4464-89cc-c7dc4c4ecb06 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:06:58.778438 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-1c8f785b-1d54-4464-89cc-c7dc4c4ecb06 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:06:58.778438 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:06:58.778438 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:06:58.778438 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:06:58.778438 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:06:58.778438 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:06:58.778438 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:06:58.778438 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:06:58.778438 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:06:58.778438 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:06:58.778438 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:06:58.778438 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:06:58.778438 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:06:58.778438 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:06:58.778438 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:06:58.778438 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:06:58.779910 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:06:58.779910 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:06:58.779910 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:06:58.779910 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:06:58.779910 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:06:58.779910 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:06:58.779910 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:06:58.779910 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:06:58.779910 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:06:58.779910 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:06:58.779910 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:06:58.779910 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 31 00:06:58.779910 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:06:58.779910 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:06:58.779910 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:06:58.779910 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:06:58.781672 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:06:58.781672 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:06:58.781672 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:06:58.781672 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:06:58.781672 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:06:58.781672 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:06:58.781672 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:06:58.781672 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:06:58.781672 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:06:58.781672 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:06:58.781672 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:06:58.781672 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 31 00:06:58.781672 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 217/445] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Aug 31 00:06:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:06:58.781672 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8f785b-1d54-4464-89cc-c7dc4c4ecb06 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:58.785958 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:58.798150 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298c25f3-d94d-4e50-9d2b-461eb36e489c None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:58.819994 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:58.843283 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5316c4d1-81c0-49fc-a109-9a569446afa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:58.844444 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5316c4d1-81c0-49fc-a109-9a569446afa0 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:58.844937 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5316c4d1-81c0-49fc-a109-9a569446afa0 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:58.845377 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5316c4d1-81c0-49fc-a109-9a569446afa0 None admin] PATH_INFO: `/v3/projects/f605ca29af4949a5a9696ac63a2a2ffc` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:58.847482 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5316c4d1-81c0-49fc-a109-9a569446afa0 None admin] RBAC: Authorizing `identity:get_project(project_id=f605ca29af4949a5a9696ac63a2a2ffc)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:58.850269 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5316c4d1-81c0-49fc-a109-9a569446afa0 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:58.853431 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 229/446] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 31 00:06:58 2022] GET /identity/v3/projects/f605ca29af4949a5a9696ac63a2a2ffc => generated 302 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:58.854859 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5316c4d1-81c0-49fc-a109-9a569446afa0 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:58.911652 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8f785b-1d54-4464-89cc-c7dc4c4ecb06 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:58.955280 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1dd6de-da64-4a5a-a645-d9bd010aacb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:58.956026 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1dd6de-da64-4a5a-a645-d9bd010aacb1 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:58.956445 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1dd6de-da64-4a5a-a645-d9bd010aacb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:58.956786 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1dd6de-da64-4a5a-a645-d9bd010aacb1 None admin] PATH_INFO: `/v3/groups/29c1333f63bd4988954525f39dfa8922` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:58.958141 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1dd6de-da64-4a5a-a645-d9bd010aacb1 None admin] RBAC: Authorizing `identity:get_group(group_id=29c1333f63bd4988954525f39dfa8922)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:58.959691 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1dd6de-da64-4a5a-a645-d9bd010aacb1 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:58.961550 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 218/447] 10.222.0.47 () {56 vars in 1180 bytes} [Wed Aug 31 00:06:58 2022] GET /identity/v3/groups/29c1333f63bd4988954525f39dfa8922 => generated 226 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:58.962900 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1dd6de-da64-4a5a-a645-d9bd010aacb1 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:58.974144 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5316c4d1-81c0-49fc-a109-9a569446afa0 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:59.020720 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fba4e79-2ae7-417e-b14c-10fbbbcf3119 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:59.021324 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fba4e79-2ae7-417e-b14c-10fbbbcf3119 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:59.021665 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fba4e79-2ae7-417e-b14c-10fbbbcf3119 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:59.022003 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fba4e79-2ae7-417e-b14c-10fbbbcf3119 None admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:59.022746 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fba4e79-2ae7-417e-b14c-10fbbbcf3119 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:59.023108 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fba4e79-2ae7-417e-b14c-10fbbbcf3119 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:59.024625 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fba4e79-2ae7-417e-b14c-10fbbbcf3119 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:59.039915 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 230/448] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 31 00:06:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:59.039915 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fba4e79-2ae7-417e-b14c-10fbbbcf3119 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:59.071075 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:59.098347 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:59.109252 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1dd6de-da64-4a5a-a645-d9bd010aacb1 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:59.150858 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45feb20b-ee18-4a5b-a5de-eea1e5ad6881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:59.151515 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45feb20b-ee18-4a5b-a5de-eea1e5ad6881 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:59.151826 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45feb20b-ee18-4a5b-a5de-eea1e5ad6881 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:59.152103 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45feb20b-ee18-4a5b-a5de-eea1e5ad6881 None admin] PATH_INFO: `/v3/groups/29c1333f63bd4988954525f39dfa8922` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:59.153317 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45feb20b-ee18-4a5b-a5de-eea1e5ad6881 None admin] RBAC: Authorizing `identity:get_group(group_id=29c1333f63bd4988954525f39dfa8922)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:59.154800 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45feb20b-ee18-4a5b-a5de-eea1e5ad6881 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:59.156459 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 219/449] 10.222.0.47 () {56 vars in 1180 bytes} [Wed Aug 31 00:06:58 2022] GET /identity/v3/groups/29c1333f63bd4988954525f39dfa8922 => generated 226 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:59.157259 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45feb20b-ee18-4a5b-a5de-eea1e5ad6881 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:59.176958 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fba4e79-2ae7-417e-b14c-10fbbbcf3119 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:59.220118 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc57acd-73cd-4518-b431-54d82a5a9353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:59.220881 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc57acd-73cd-4518-b431-54d82a5a9353 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:59.221243 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc57acd-73cd-4518-b431-54d82a5a9353 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:59.221618 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc57acd-73cd-4518-b431-54d82a5a9353 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:59.222452 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc57acd-73cd-4518-b431-54d82a5a9353 None admin] RBAC: Adding query filter params (group.id=29c1333f63bd4988954525f39dfa8922, role.id=89f25837440e4981bad54fe74d242232, scope.project.id=24b0845707914a1f9ffa3665e80a3533) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:59.222915 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc57acd-73cd-4518-b431-54d82a5a9353 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:59.224519 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc57acd-73cd-4518-b431-54d82a5a9353 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:59.232033 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 231/450] 10.222.0.47 () {56 vars in 1376 bytes} [Wed Aug 31 00:06:59 2022] GET /identity/v3/role_assignments?group.id=29c1333f63bd4988954525f39dfa8922&scope.project.id=24b0845707914a1f9ffa3665e80a3533&role.id=89f25837440e4981bad54fe74d242232 => generated 611 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:59.233196 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc57acd-73cd-4518-b431-54d82a5a9353 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:59.306258 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45feb20b-ee18-4a5b-a5de-eea1e5ad6881 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:59.333637 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:59.361268 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc57acd-73cd-4518-b431-54d82a5a9353 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:59.363179 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb88b4aa-709c-41e3-a47f-5e9d87f26da2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:59.363818 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb88b4aa-709c-41e3-a47f-5e9d87f26da2 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:59.364103 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb88b4aa-709c-41e3-a47f-5e9d87f26da2 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:59.364426 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb88b4aa-709c-41e3-a47f-5e9d87f26da2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:59.403269 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:06:59.412752 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99610544-de2a-412e-8f53-ed455aceb67f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:59.413554 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99610544-de2a-412e-8f53-ed455aceb67f None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:59.413969 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99610544-de2a-412e-8f53-ed455aceb67f None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:59.414414 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99610544-de2a-412e-8f53-ed455aceb67f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:59.415730 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99610544-de2a-412e-8f53-ed455aceb67f None admin] RBAC: Adding query filter params (group.id=29c1333f63bd4988954525f39dfa8922, role.id=89f25837440e4981bad54fe74d242232, scope.project.id=f605ca29af4949a5a9696ac63a2a2ffc) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:06:59.416275 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99610544-de2a-412e-8f53-ed455aceb67f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:59.419502 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99610544-de2a-412e-8f53-ed455aceb67f None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:59.440198 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 232/451] 10.222.0.47 () {56 vars in 1376 bytes} [Wed Aug 31 00:06:59 2022] GET /identity/v3/role_assignments?group.id=29c1333f63bd4988954525f39dfa8922&scope.project.id=f605ca29af4949a5a9696ac63a2a2ffc&role.id=89f25837440e4981bad54fe74d242232 => generated 611 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:06:59.485118 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb88b4aa-709c-41e3-a47f-5e9d87f26da2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:59.487415 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb88b4aa-709c-41e3-a47f-5e9d87f26da2 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:59.671010 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 220/452] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 31 00:06:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 514 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 00:06:59.677359 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99610544-de2a-412e-8f53-ed455aceb67f None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:06:59.853985 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99610544-de2a-412e-8f53-ed455aceb67f None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:06:59.903007 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89afb3b-24b3-424e-9ee9-3abe14304ae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:06:59.903802 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89afb3b-24b3-424e-9ee9-3abe14304ae2 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:06:59.904113 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89afb3b-24b3-424e-9ee9-3abe14304ae2 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:06:59.904471 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89afb3b-24b3-424e-9ee9-3abe14304ae2 None admin] PATH_INFO: `/v3/projects/549d5b0e486743c994271a9e51f4023c` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:06:59.905748 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89afb3b-24b3-424e-9ee9-3abe14304ae2 None admin] RBAC: Authorizing `identity:get_project(project_id=549d5b0e486743c994271a9e51f4023c)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:06:59.907713 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89afb3b-24b3-424e-9ee9-3abe14304ae2 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:06:59.910448 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 233/453] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 31 00:06:59 2022] GET /identity/v3/projects/549d5b0e486743c994271a9e51f4023c => generated 344 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:06:59.917030 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb88b4aa-709c-41e3-a47f-5e9d87f26da2 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:00.012184 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:00.065526 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb88b4aa-709c-41e3-a47f-5e9d87f26da2 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:00.111579 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfae298-40db-4a2c-bc54-e1d108d28d23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:00.112353 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfae298-40db-4a2c-bc54-e1d108d28d23 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:00.112671 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfae298-40db-4a2c-bc54-e1d108d28d23 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:00.112981 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfae298-40db-4a2c-bc54-e1d108d28d23 None admin] PATH_INFO: `/v3/groups/8bb9f103d76341e38c252bbb57150e81` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:00.114254 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfae298-40db-4a2c-bc54-e1d108d28d23 None admin] RBAC: Authorizing `identity:get_group(group_id=8bb9f103d76341e38c252bbb57150e81)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:00.115802 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfae298-40db-4a2c-bc54-e1d108d28d23 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:00.117587 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 221/454] 10.222.0.47 () {56 vars in 1180 bytes} [Wed Aug 31 00:06:59 2022] GET /identity/v3/groups/8bb9f103d76341e38c252bbb57150e81 => generated 229 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:00.124753 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89afb3b-24b3-424e-9ee9-3abe14304ae2 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:00.147157 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:00.242612 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89afb3b-24b3-424e-9ee9-3abe14304ae2 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:00.279562 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122c1c91-85e5-43c1-b9c1-7445763c15e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:00.280208 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122c1c91-85e5-43c1-b9c1-7445763c15e5 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:00.280477 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122c1c91-85e5-43c1-b9c1-7445763c15e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:00.280749 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122c1c91-85e5-43c1-b9c1-7445763c15e5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:00.281478 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122c1c91-85e5-43c1-b9c1-7445763c15e5 None admin] RBAC: Adding query filter params (group.id=8bb9f103d76341e38c252bbb57150e81, role.id=12f6817f9aaa4e2bb477095a6bed5d0f, scope.project.id=549d5b0e486743c994271a9e51f4023c) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:00.281782 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122c1c91-85e5-43c1-b9c1-7445763c15e5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:00.283239 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122c1c91-85e5-43c1-b9c1-7445763c15e5 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:00.289903 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 234/455] 10.222.0.47 () {56 vars in 1376 bytes} [Wed Aug 31 00:07:00 2022] GET /identity/v3/role_assignments?group.id=8bb9f103d76341e38c252bbb57150e81&scope.project.id=549d5b0e486743c994271a9e51f4023c&role.id=12f6817f9aaa4e2bb477095a6bed5d0f => generated 611 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:02.944642 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af44897b-0552-4d17-890f-083b1584281c None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:02.945180 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af44897b-0552-4d17-890f-083b1584281c None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:02.945475 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af44897b-0552-4d17-890f-083b1584281c None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:02.948702 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 222/456] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 00:07:02 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:07:02.956422 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00768af0-a0c1-442d-9e04-e521d2a4d2b6 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:02.957861 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00768af0-a0c1-442d-9e04-e521d2a4d2b6 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:02.958616 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00768af0-a0c1-442d-9e04-e521d2a4d2b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:02.999127 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-00768af0-a0c1-442d-9e04-e521d2a4d2b6 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:07:02.999127 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-00768af0-a0c1-442d-9e04-e521d2a4d2b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:07:03.165277 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 235/457] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 00:07:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:07:03.500451 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af44897b-0552-4d17-890f-083b1584281c None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:03.760593 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af44897b-0552-4d17-890f-083b1584281c None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:03.843491 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:03.858589 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69751a44-328d-42c7-9896-f325bf5a8473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:03.859904 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69751a44-328d-42c7-9896-f325bf5a8473 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:03.860472 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69751a44-328d-42c7-9896-f325bf5a8473 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:03.861205 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69751a44-328d-42c7-9896-f325bf5a8473 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:03.887672 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69751a44-328d-42c7-9896-f325bf5a8473 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:03.890365 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69751a44-328d-42c7-9896-f325bf5a8473 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:03.901395 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd719099-49e6-4e0b-b027-f37e8089424e None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:03.902310 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd719099-49e6-4e0b-b027-f37e8089424e None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:03.903243 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd719099-49e6-4e0b-b027-f37e8089424e None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:03.908286 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 236/458] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 00:07:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:07:03.910936 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6977cb-5ac9-4e74-bbad-96c5368c6edb None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:03.911228 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6977cb-5ac9-4e74-bbad-96c5368c6edb None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:03.911508 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6977cb-5ac9-4e74-bbad-96c5368c6edb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:03.939436 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-69751a44-328d-42c7-9896-f325bf5a8473 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:07:03.939436 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:03.939436 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:03.939436 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:03.939436 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:03.939436 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:03.939436 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:03.939436 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:03.939436 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:03.939436 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:03.939436 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:03.939436 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:03.939436 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:07:03.939436 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:07:03.939436 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:07:03.939436 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:07:03.940474 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:03.940474 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:03.940474 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:03.940474 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:03.940474 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:03.940474 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:03.940474 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:03.940474 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:03.940474 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:03.940474 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:03.940474 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:03.940474 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:03.940474 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:03.940474 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:03.940474 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:03.940474 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:03.940474 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:07:03.941333 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:07:03.941333 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:07:03.941333 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 31 00:07:03.941512 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 223/459] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 00:07:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 442 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:07:03.951830 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69751a44-328d-42c7-9896-f325bf5a8473 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:03.966216 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-eb6977cb-5ac9-4e74-bbad-96c5368c6edb None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:07:03.967441 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-eb6977cb-5ac9-4e74-bbad-96c5368c6edb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:07:03.975088 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:04.152304 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 237/460] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 00:07:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 00:07:04.235137 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69751a44-328d-42c7-9896-f325bf5a8473 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:04.241749 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80455427-8844-41aa-8cc4-852ac8976a05 None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:04.242218 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80455427-8844-41aa-8cc4-852ac8976a05 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:04.242699 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80455427-8844-41aa-8cc4-852ac8976a05 None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:04.246108 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 238/461] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 00:07:04 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:07:04.254841 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08da949f-ceb3-4d9a-844a-be35f31875e2 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:04.255282 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08da949f-ceb3-4d9a-844a-be35f31875e2 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:04.255721 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08da949f-ceb3-4d9a-844a-be35f31875e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:04.288519 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-08da949f-ceb3-4d9a-844a-be35f31875e2 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:07:04.290796 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-08da949f-ceb3-4d9a-844a-be35f31875e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:07:04.365260 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b587d2-9137-4f35-9da5-e8edf0100f27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:04.366243 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b587d2-9137-4f35-9da5-e8edf0100f27 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:04.366699 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b587d2-9137-4f35-9da5-e8edf0100f27 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:04.367149 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b587d2-9137-4f35-9da5-e8edf0100f27 None admin] PATH_INFO: `/v3/domains` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:04.368274 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b587d2-9137-4f35-9da5-e8edf0100f27 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:04.368781 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b587d2-9137-4f35-9da5-e8edf0100f27 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:04.372051 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b587d2-9137-4f35-9da5-e8edf0100f27 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:04.434253 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 224/462] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 31 00:07:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 484 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:04.440062 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b587d2-9137-4f35-9da5-e8edf0100f27 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:04.441965 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 239/463] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 00:07:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 00:07:04.448406 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08da949f-ceb3-4d9a-844a-be35f31875e2 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:04.544256 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:04.584540 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:04.635379 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08da949f-ceb3-4d9a-844a-be35f31875e2 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:04.646862 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b587d2-9137-4f35-9da5-e8edf0100f27 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:04.688561 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0e83c2-3238-4ded-b081-e53f86b1c3c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:04.690163 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0e83c2-3238-4ded-b081-e53f86b1c3c1 None admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:04.690595 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0e83c2-3238-4ded-b081-e53f86b1c3c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:04.690884 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0e83c2-3238-4ded-b081-e53f86b1c3c1 None admin] PATH_INFO: `/v3/users` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:04.691618 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0e83c2-3238-4ded-b081-e53f86b1c3c1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:04.693568 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0e83c2-3238-4ded-b081-e53f86b1c3c1 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:04.696821 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f790ea5c-fb90-465c-b071-ef24a64a466d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:04.697805 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f790ea5c-fb90-465c-b071-ef24a64a466d None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:04.698340 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f790ea5c-fb90-465c-b071-ef24a64a466d None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:04.698854 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f790ea5c-fb90-465c-b071-ef24a64a466d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:04.714372 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f790ea5c-fb90-465c-b071-ef24a64a466d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:04.717208 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f790ea5c-fb90-465c-b071-ef24a64a466d None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:04.727548 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 240/464] 10.222.0.47 () {60 vars in 1132 bytes} [Wed Aug 31 00:07:04 2022] POST /identity/v3/users => generated 248 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:07:04.728795 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a0b80a-2649-4562-9e12-da9dae0e00bf None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:04.729087 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a0b80a-2649-4562-9e12-da9dae0e00bf None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:04.729449 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a0b80a-2649-4562-9e12-da9dae0e00bf None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:04.731249 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 241/465] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 00:07:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:07:04.738699 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-f790ea5c-fb90-465c-b071-ef24a64a466d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:07:04.738699 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:04.738699 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:04.738699 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:04.738699 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:04.738699 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:04.738699 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:04.738699 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:04.738699 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:04.738699 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:04.738699 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:04.738699 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:04.738699 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:07:04.738699 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:07:04.738699 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:07:04.738699 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:07:04.739687 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:04.739687 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:04.739687 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:04.739687 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:04.739687 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:04.739687 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:04.739687 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:04.739687 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:04.739687 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:04.739687 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:04.739687 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:04.739687 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:04.739687 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:04.739687 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:04.739687 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:04.739687 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:04.739687 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:07:04.740619 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:07:04.740619 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:07:04.740619 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 31 00:07:04.742573 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2592e2f3-8bf0-4f42-bf2d-c8d323e69313 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:04.742917 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 225/466] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 00:07:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:07:04.748291 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2592e2f3-8bf0-4f42-bf2d-c8d323e69313 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:04.748291 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2592e2f3-8bf0-4f42-bf2d-c8d323e69313 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:04.750412 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f790ea5c-fb90-465c-b071-ef24a64a466d None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:04.772653 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-2592e2f3-8bf0-4f42-bf2d-c8d323e69313 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:07:04.774491 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-2592e2f3-8bf0-4f42-bf2d-c8d323e69313 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:07:04.865666 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 242/467] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 00:07:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 00:07:04.867838 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2592e2f3-8bf0-4f42-bf2d-c8d323e69313 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:04.933773 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:04.946935 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f790ea5c-fb90-465c-b071-ef24a64a466d None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:04.970114 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:05.000189 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a8b2b2-08bd-49a0-9f69-140a9a75b7a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:05.001582 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a8b2b2-08bd-49a0-9f69-140a9a75b7a9 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:05.002194 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a8b2b2-08bd-49a0-9f69-140a9a75b7a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:05.002671 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a8b2b2-08bd-49a0-9f69-140a9a75b7a9 None admin] PATH_INFO: `/v3/domains` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:05.003592 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a8b2b2-08bd-49a0-9f69-140a9a75b7a9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:05.004112 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a8b2b2-08bd-49a0-9f69-140a9a75b7a9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:05.006134 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a8b2b2-08bd-49a0-9f69-140a9a75b7a9 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:05.022056 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 226/468] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 31 00:07:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:05.030645 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2592e2f3-8bf0-4f42-bf2d-c8d323e69313 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:05.031184 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a8b2b2-08bd-49a0-9f69-140a9a75b7a9 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:05.079982 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab502bf-6c54-48cb-aa41-3713bf92559d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:05.080672 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab502bf-6c54-48cb-aa41-3713bf92559d None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:05.080944 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab502bf-6c54-48cb-aa41-3713bf92559d None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:05.081232 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab502bf-6c54-48cb-aa41-3713bf92559d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:05.094931 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab502bf-6c54-48cb-aa41-3713bf92559d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:05.096427 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab502bf-6c54-48cb-aa41-3713bf92559d None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:05.117061 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-7ab502bf-6c54-48cb-aa41-3713bf92559d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:07:05.117061 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:05.117061 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:05.117061 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:05.117061 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:05.117061 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:05.117061 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:05.117061 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:05.117061 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:05.117061 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:05.117061 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:05.117061 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:05.117061 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:07:05.117061 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:07:05.117061 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:07:05.117061 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:07:05.119382 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:05.119382 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:05.119382 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:05.119382 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:05.119382 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:05.119382 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:05.119382 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:05.119382 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:05.119382 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:05.119382 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:05.119382 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:05.119382 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:05.119382 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:05.119382 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:05.119382 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:05.119382 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:05.119382 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:07:05.121653 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:07:05.121653 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:07:05.121653 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Aug 31 00:07:05.121653 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 243/469] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 00:07:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:07:05.125133 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab502bf-6c54-48cb-aa41-3713bf92559d None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:05.212432 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a8b2b2-08bd-49a0-9f69-140a9a75b7a9 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:05.249953 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab502bf-6c54-48cb-aa41-3713bf92559d None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:05.260452 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:05.261890 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628d185d-5550-4edc-a91b-89b2c61ce963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:05.262519 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628d185d-5550-4edc-a91b-89b2c61ce963 None admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:05.262796 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628d185d-5550-4edc-a91b-89b2c61ce963 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:05.263072 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628d185d-5550-4edc-a91b-89b2c61ce963 None admin] PATH_INFO: `/v3/users` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:05.263825 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628d185d-5550-4edc-a91b-89b2c61ce963 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:05.265634 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628d185d-5550-4edc-a91b-89b2c61ce963 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:05.300221 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 227/470] 10.222.0.47 () {60 vars in 1132 bytes} [Wed Aug 31 00:07:05 2022] POST /identity/v3/users => generated 246 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:07:05.300221 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a61e151-ecf7-4ccc-b797-119977145b41 None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:05.300221 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a61e151-ecf7-4ccc-b797-119977145b41 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:05.300221 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a61e151-ecf7-4ccc-b797-119977145b41 None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:05.300221 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 228/471] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 00:07:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:07:05.300221 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a61e151-ecf7-4ccc-b797-119977145b41 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:05.307413 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e690b803-2993-4a77-b80c-1ac194cb9c22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:05.308484 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e690b803-2993-4a77-b80c-1ac194cb9c22 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:05.308973 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e690b803-2993-4a77-b80c-1ac194cb9c22 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:05.309423 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e690b803-2993-4a77-b80c-1ac194cb9c22 None admin] PATH_INFO: `/v3/domains` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:05.310559 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e690b803-2993-4a77-b80c-1ac194cb9c22 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:05.311072 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e690b803-2993-4a77-b80c-1ac194cb9c22 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:05.313645 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e690b803-2993-4a77-b80c-1ac194cb9c22 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:05.321982 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:05.344931 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 244/472] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 31 00:07:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:07:05.347415 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6155cf72-2521-4b49-87c1-609b9e63e9ac None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:05.347879 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6155cf72-2521-4b49-87c1-609b9e63e9ac None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:05.348399 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6155cf72-2521-4b49-87c1-609b9e63e9ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:05.383810 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-6155cf72-2521-4b49-87c1-609b9e63e9ac None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:07:05.386947 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-6155cf72-2521-4b49-87c1-609b9e63e9ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:07:05.499126 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a61e151-ecf7-4ccc-b797-119977145b41 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:05.507855 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 245/473] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 00:07:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:07:05.508995 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6155cf72-2521-4b49-87c1-609b9e63e9ac None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:05.565252 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a92f804-986c-4267-a665-d7169737c46e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:05.566258 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a92f804-986c-4267-a665-d7169737c46e None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:05.566715 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a92f804-986c-4267-a665-d7169737c46e None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:05.567132 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a92f804-986c-4267-a665-d7169737c46e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:05.584794 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a92f804-986c-4267-a665-d7169737c46e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:05.587004 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a92f804-986c-4267-a665-d7169737c46e None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:05.609988 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-3a92f804-986c-4267-a665-d7169737c46e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:07:05.609988 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:05.609988 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:05.609988 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:05.609988 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:05.609988 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:05.609988 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:05.609988 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:05.609988 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:05.609988 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:05.609988 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:05.609988 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:05.609988 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:07:05.609988 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:07:05.609988 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:07:05.609988 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:07:05.611038 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:05.611038 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:05.611038 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:05.611038 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:05.611038 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:05.611038 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:05.611038 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:05.611038 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:05.611038 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:05.611038 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:05.611038 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:05.611038 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:05.611038 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:05.611038 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:05.611038 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:05.611038 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:05.611038 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:07:05.611948 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:07:05.611948 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:07:05.611948 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 31 00:07:05.614255 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 229/474] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 00:07:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:07:05.620504 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a92f804-986c-4267-a665-d7169737c46e None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:05.716344 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:05.724130 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6155cf72-2521-4b49-87c1-609b9e63e9ac None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:05.739261 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:05.803279 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02ffc49-a72a-4eeb-b8d8-3f53c3d9af10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:05.804531 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02ffc49-a72a-4eeb-b8d8-3f53c3d9af10 None admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:05.804957 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02ffc49-a72a-4eeb-b8d8-3f53c3d9af10 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:05.805964 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02ffc49-a72a-4eeb-b8d8-3f53c3d9af10 None admin] PATH_INFO: `/v3/users` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:05.806780 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02ffc49-a72a-4eeb-b8d8-3f53c3d9af10 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:05.808847 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02ffc49-a72a-4eeb-b8d8-3f53c3d9af10 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:05.819165 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a92f804-986c-4267-a665-d7169737c46e None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:05.835738 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 246/475] 10.222.0.47 () {60 vars in 1132 bytes} [Wed Aug 31 00:07:05 2022] POST /identity/v3/users => generated 248 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:07:05.898981 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff3bcc2-8da0-4b0b-b871-f358436d30e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:05.900231 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff3bcc2-8da0-4b0b-b871-f358436d30e2 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:05.900721 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff3bcc2-8da0-4b0b-b871-f358436d30e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:05.901195 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff3bcc2-8da0-4b0b-b871-f358436d30e2 None admin] PATH_INFO: `/v3/domains` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:05.903402 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff3bcc2-8da0-4b0b-b871-f358436d30e2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:05.903941 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff3bcc2-8da0-4b0b-b871-f358436d30e2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:05.907191 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff3bcc2-8da0-4b0b-b871-f358436d30e2 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:05.931483 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 230/476] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 31 00:07:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:07:05.940954 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02ffc49-a72a-4eeb-b8d8-3f53c3d9af10 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:05.993963 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff3bcc2-8da0-4b0b-b871-f358436d30e2 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:06.094991 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02ffc49-a72a-4eeb-b8d8-3f53c3d9af10 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:06.138142 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97c99c0-73cf-4738-8e73-7b3a2f3cf9ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:06.139427 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97c99c0-73cf-4738-8e73-7b3a2f3cf9ad None admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:06.139908 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97c99c0-73cf-4738-8e73-7b3a2f3cf9ad None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:06.140428 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97c99c0-73cf-4738-8e73-7b3a2f3cf9ad None admin] PATH_INFO: `/v3/users` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:06.141301 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97c99c0-73cf-4738-8e73-7b3a2f3cf9ad None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:06.144338 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97c99c0-73cf-4738-8e73-7b3a2f3cf9ad None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:06.175262 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 247/477] 10.222.0.47 () {60 vars in 1132 bytes} [Wed Aug 31 00:07:05 2022] POST /identity/v3/users => generated 249 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:07:06.190046 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff3bcc2-8da0-4b0b-b871-f358436d30e2 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:06.221227 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:06.239947 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d19d94-b0f9-4987-b6a1-24207adb0d2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:06.240621 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d19d94-b0f9-4987-b6a1-24207adb0d2b None admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:06.240898 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d19d94-b0f9-4987-b6a1-24207adb0d2b None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:06.241166 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d19d94-b0f9-4987-b6a1-24207adb0d2b None admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:06.241962 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d19d94-b0f9-4987-b6a1-24207adb0d2b None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:06.243417 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d19d94-b0f9-4987-b6a1-24207adb0d2b None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:06.255241 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.sql.core [None req-21d19d94-b0f9-4987-b6a1-24207adb0d2b None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 31 00:07:06.255241 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 31 00:07:06.255241 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [parameters: {'id': '6ec9cf031531427096a2d96ecff04375', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 31 00:07:06.255241 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81523) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 31 00:07:06.273396 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-21d19d94-b0f9-4987-b6a1-24207adb0d2b None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 31 00:07:06.273396 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:06.273396 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 31 00:07:06.273396 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 31 00:07:06.273396 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 31 00:07:06.273396 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 31 00:07:06.273396 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 31 00:07:06.273396 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application result = self._query(query) Aug 31 00:07:06.273396 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 31 00:07:06.273396 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application conn.query(q) Aug 31 00:07:06.273396 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 31 00:07:06.273396 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 31 00:07:06.273396 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 31 00:07:06.273396 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application result.read() Aug 31 00:07:06.273396 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 31 00:07:06.274392 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 31 00:07:06.274392 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 31 00:07:06.274392 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 31 00:07:06.274392 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 31 00:07:06.274392 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 31 00:07:06.274392 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 31 00:07:06.274392 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 31 00:07:06.274392 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 31 00:07:06.274392 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 31 00:07:06.274392 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 31 00:07:06.274392 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 31 00:07:06.274392 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:06.274392 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 31 00:07:06.274392 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 31 00:07:06.274392 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 31 00:07:06.274392 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return ref.to_dict() Aug 31 00:07:06.274392 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 31 00:07:06.274392 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application next(self.gen) Aug 31 00:07:06.275800 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 31 00:07:06.275800 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application yield resource Aug 31 00:07:06.275800 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 31 00:07:06.275800 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application next(self.gen) Aug 31 00:07:06.275800 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 31 00:07:06.275800 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application self.session.rollback() Aug 31 00:07:06.275800 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 31 00:07:06.275800 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application self.force_reraise() Aug 31 00:07:06.275800 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 31 00:07:06.275800 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise self.value Aug 31 00:07:06.275800 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 31 00:07:06.275800 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 31 00:07:06.275800 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 31 00:07:06.275800 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application session.commit() Aug 31 00:07:06.275800 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 31 00:07:06.275800 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 31 00:07:06.275800 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 31 00:07:06.276973 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application self._prepare_impl() Aug 31 00:07:06.276973 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 31 00:07:06.276973 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application self.session.flush() Aug 31 00:07:06.276973 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 31 00:07:06.276973 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application self._flush(objects) Aug 31 00:07:06.276973 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 31 00:07:06.276973 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 31 00:07:06.276973 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 31 00:07:06.276973 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application compat.raise_( Aug 31 00:07:06.276973 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 31 00:07:06.276973 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception Aug 31 00:07:06.276973 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 31 00:07:06.276973 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application flush_context.execute() Aug 31 00:07:06.276973 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 31 00:07:06.276973 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rec.execute(self) Aug 31 00:07:06.276973 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 31 00:07:06.276973 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 31 00:07:06.277931 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 31 00:07:06.277931 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 31 00:07:06.277931 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 31 00:07:06.277931 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 31 00:07:06.277931 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 31 00:07:06.277931 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 31 00:07:06.277931 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 31 00:07:06.277931 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 31 00:07:06.277931 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 31 00:07:06.277931 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 31 00:07:06.277931 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 31 00:07:06.277931 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 31 00:07:06.277931 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 31 00:07:06.277931 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 31 00:07:06.277931 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 31 00:07:06.277931 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception Aug 31 00:07:06.278751 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 31 00:07:06.278751 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 31 00:07:06.278751 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 31 00:07:06.278751 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 31 00:07:06.278751 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 31 00:07:06.278751 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application result = self._query(query) Aug 31 00:07:06.278751 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 31 00:07:06.278751 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application conn.query(q) Aug 31 00:07:06.278751 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 31 00:07:06.278751 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 31 00:07:06.278751 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 31 00:07:06.278751 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application result.read() Aug 31 00:07:06.278751 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 31 00:07:06.278751 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 31 00:07:06.278751 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 31 00:07:06.278751 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 31 00:07:06.280304 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 31 00:07:06.280304 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 31 00:07:06.280304 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 31 00:07:06.280304 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 31 00:07:06.280304 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 31 00:07:06.280304 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 31 00:07:06.280304 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [parameters: {'id': '6ec9cf031531427096a2d96ecff04375', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 31 00:07:06.280304 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 31 00:07:06.280304 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 31 00:07:06.280304 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 00:07:06.280304 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 31 00:07:06.280304 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:06.280304 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:06.280304 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:06.280304 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:06.280304 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:06.281164 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:06.281164 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:06.281164 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:06.281164 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:06.281164 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:06.281164 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:06.281164 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 31 00:07:06.281164 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 31 00:07:06.281164 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:06.281164 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:06.281164 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 31 00:07:06.281164 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 31 00:07:06.281164 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 31 00:07:06.281164 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 31 00:07:06.281164 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 31 00:07:06.281164 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 31 00:07:06.282037 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 231/478] 10.222.0.47 () {60 vars in 1131 bytes} [Wed Aug 31 00:07:05 2022] POST /identity/v3/roles => generated 144 bytes in 282 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:07:06.283307 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97c99c0-73cf-4738-8e73-7b3a2f3cf9ad None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:06.301225 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:06.408723 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97c99c0-73cf-4738-8e73-7b3a2f3cf9ad None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:06.451474 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28beb45-6ca1-4226-a348-5b3856754612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:06.452399 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28beb45-6ca1-4226-a348-5b3856754612 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:06.452823 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28beb45-6ca1-4226-a348-5b3856754612 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:06.453239 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28beb45-6ca1-4226-a348-5b3856754612 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:06.465742 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28beb45-6ca1-4226-a348-5b3856754612 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:07:06.471501 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-b28beb45-6ca1-4226-a348-5b3856754612 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 00:07:06.471501 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:06.471501 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:06.471501 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:06.471501 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:06.471501 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:06.471501 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:06.471501 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:06.471501 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:06.471501 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:06.471501 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:06.471501 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:06.471501 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:07:06.471501 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:07:06.471501 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:07:06.471501 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:07:06.472679 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:07:06.472679 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:07:06.472679 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:07:06.472679 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:07:06.472679 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:06.472679 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:06.472679 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:06.472679 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:06.472679 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:06.472679 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:06.472679 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:06.472679 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:06.472679 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:06.472679 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:06.472679 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:06.472679 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:06.473703 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:06.473703 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:06.473703 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:06.473703 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:06.473703 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:07:06.473703 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:07:06.473703 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:07:06.473703 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:07:06.473703 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:07:06.473703 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:07:06.473703 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 00:07:06.473703 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Aug 31 00:07:06.475824 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 248/479] 10.222.0.47 () {56 vars in 1114 bytes} [Wed Aug 31 00:07:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:07:06.481911 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d19d94-b0f9-4987-b6a1-24207adb0d2b None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:06.595517 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d19d94-b0f9-4987-b6a1-24207adb0d2b None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:06.632341 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3186d1b-5f27-4481-9581-6ba99b8de4c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:06.633252 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3186d1b-5f27-4481-9581-6ba99b8de4c3 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:06.633673 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3186d1b-5f27-4481-9581-6ba99b8de4c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:06.634088 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3186d1b-5f27-4481-9581-6ba99b8de4c3 None admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:06.634905 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3186d1b-5f27-4481-9581-6ba99b8de4c3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:06.635464 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3186d1b-5f27-4481-9581-6ba99b8de4c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:06.637969 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3186d1b-5f27-4481-9581-6ba99b8de4c3 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:06.647480 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 232/480] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 31 00:07:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:07.823450 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c963aba-28bf-4722-b538-787bcc40e823 None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:07.824552 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c963aba-28bf-4722-b538-787bcc40e823 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:07.825022 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c963aba-28bf-4722-b538-787bcc40e823 None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:07.826509 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 249/481] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 00:07:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:07:07.832172 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5015977-2538-46c4-88c5-2e4b3bdf61f1 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:07.833002 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5015977-2538-46c4-88c5-2e4b3bdf61f1 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:07.833438 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5015977-2538-46c4-88c5-2e4b3bdf61f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:07.858028 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-f5015977-2538-46c4-88c5-2e4b3bdf61f1 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:07:07.860092 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-f5015977-2538-46c4-88c5-2e4b3bdf61f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:07:07.938259 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:07.977925 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 233/482] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 00:07:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:07:08.088695 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9b8ca9-7a11-4570-9904-00a84798da8c None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:08.089875 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9b8ca9-7a11-4570-9904-00a84798da8c None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:08.090359 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9b8ca9-7a11-4570-9904-00a84798da8c None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:08.092386 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 250/483] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 00:07:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 00:07:08.098403 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8feae3-af59-46ba-abc2-b4975fd28b85 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:08.099184 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8feae3-af59-46ba-abc2-b4975fd28b85 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:08.099660 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8feae3-af59-46ba-abc2-b4975fd28b85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:08.121618 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-5f8feae3-af59-46ba-abc2-b4975fd28b85 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:07:08.123183 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-5f8feae3-af59-46ba-abc2-b4975fd28b85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:07:08.203585 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 234/484] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 00:07:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:07:08.460746 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9b8ca9-7a11-4570-9904-00a84798da8c None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:08.561540 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:08.586144 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8feae3-af59-46ba-abc2-b4975fd28b85 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:08.605849 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9b8ca9-7a11-4570-9904-00a84798da8c None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:08.643187 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38620cae-7329-400e-97ab-011e5fb77780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:08.643821 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38620cae-7329-400e-97ab-011e5fb77780 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:08.644096 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38620cae-7329-400e-97ab-011e5fb77780 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:08.644394 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38620cae-7329-400e-97ab-011e5fb77780 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:08.656140 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38620cae-7329-400e-97ab-011e5fb77780 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:07:08.661874 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-38620cae-7329-400e-97ab-011e5fb77780 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:07:08.661874 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:08.661874 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:08.661874 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:08.661874 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:08.661874 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:08.661874 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:08.661874 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:08.661874 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:08.661874 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:08.661874 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:08.661874 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:08.661874 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:07:08.661874 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:07:08.661874 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:07:08.661874 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:07:08.662814 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:07:08.662814 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:07:08.662814 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:07:08.662814 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:07:08.662814 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:08.662814 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:08.662814 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:08.662814 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:08.662814 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:08.662814 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:08.662814 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:08.662814 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:08.662814 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:08.662814 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:08.662814 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:08.662814 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:08.663625 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:08.663625 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:08.663625 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:08.663625 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:08.663625 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:07:08.663625 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:07:08.663625 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:07:08.663625 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:07:08.663625 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:07:08.663625 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:07:08.663625 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:07:08.663625 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Aug 31 00:07:08.663625 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 251/485] 10.222.0.47 () {56 vars in 1102 bytes} [Wed Aug 31 00:07:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:07:08.664359 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ba9b86-38d5-4bf5-87cd-85b37dfac962 None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:08.665188 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ba9b86-38d5-4bf5-87cd-85b37dfac962 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:08.665188 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ba9b86-38d5-4bf5-87cd-85b37dfac962 None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:08.671000 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 252/486] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 00:07:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:07:08.671805 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ba9b86-38d5-4bf5-87cd-85b37dfac962 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:08.728803 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8feae3-af59-46ba-abc2-b4975fd28b85 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:08.745433 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:08.785665 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde86857-105f-48ff-9f30-8fa5b371dfdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:08.786731 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde86857-105f-48ff-9f30-8fa5b371dfdb None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:08.787017 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde86857-105f-48ff-9f30-8fa5b371dfdb None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:08.787978 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde86857-105f-48ff-9f30-8fa5b371dfdb None admin] PATH_INFO: `/v3/roles/service` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:08.805862 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde86857-105f-48ff-9f30-8fa5b371dfdb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:07:08.814867 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-fde86857-105f-48ff-9f30-8fa5b371dfdb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:07:08.814867 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:08.814867 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:08.814867 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:08.814867 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:08.814867 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:08.814867 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:08.814867 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:08.814867 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:08.814867 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:08.814867 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:08.814867 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:08.814867 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:07:08.814867 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:07:08.814867 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:07:08.814867 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:07:08.816055 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:07:08.816055 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:07:08.816055 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:07:08.816055 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:07:08.816055 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:08.816055 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:08.816055 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:08.816055 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:08.816055 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:08.816055 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:08.816055 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:08.816055 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:08.816055 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:08.816055 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:08.816055 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:08.816055 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:08.817176 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:08.817176 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:08.817176 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:08.817176 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:08.817176 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:07:08.817176 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:07:08.817176 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:07:08.817176 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:07:08.817176 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:07:08.817176 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:07:08.817176 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:07:08.817176 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 31 00:07:08.817962 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ba9b86-38d5-4bf5-87cd-85b37dfac962 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:08.818052 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 235/487] 10.222.0.47 () {56 vars in 1102 bytes} [Wed Aug 31 00:07:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:07:08.818052 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b977f20-a0e4-450c-b872-80a4925d09ce None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:08.818052 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b977f20-a0e4-450c-b872-80a4925d09ce None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:08.818478 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b977f20-a0e4-450c-b872-80a4925d09ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:08.845641 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-1b977f20-a0e4-450c-b872-80a4925d09ce None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:07:08.847444 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-1b977f20-a0e4-450c-b872-80a4925d09ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:07:08.861297 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:08.868214 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a3ded1-ad40-480a-a3d8-18e8d97d74e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:08.869125 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a3ded1-ad40-480a-a3d8-18e8d97d74e6 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:08.869611 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a3ded1-ad40-480a-a3d8-18e8d97d74e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:08.870075 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a3ded1-ad40-480a-a3d8-18e8d97d74e6 None admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:08.871541 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a3ded1-ad40-480a-a3d8-18e8d97d74e6 None admin] RBAC: Adding query filter params (name=service) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:08.872073 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a3ded1-ad40-480a-a3d8-18e8d97d74e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:08.873898 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a3ded1-ad40-480a-a3d8-18e8d97d74e6 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:08.887912 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 253/488] 10.222.0.47 () {56 vars in 1103 bytes} [Wed Aug 31 00:07:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:07:08.889163 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a3ded1-ad40-480a-a3d8-18e8d97d74e6 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:08.939048 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 236/489] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 00:07:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:07:08.940436 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b977f20-a0e4-450c-b872-80a4925d09ce None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:09.025881 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a3ded1-ad40-480a-a3d8-18e8d97d74e6 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:09.058459 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:09.064219 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b977f20-a0e4-450c-b872-80a4925d09ce None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:09.065985 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854870cb-3b5f-4357-81c4-952fec188923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:09.066880 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854870cb-3b5f-4357-81c4-952fec188923 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:09.067366 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854870cb-3b5f-4357-81c4-952fec188923 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:09.067840 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854870cb-3b5f-4357-81c4-952fec188923 None admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:09.068761 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854870cb-3b5f-4357-81c4-952fec188923 None admin] RBAC: Adding query filter params (name=service) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:09.069270 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854870cb-3b5f-4357-81c4-952fec188923 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:09.070876 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854870cb-3b5f-4357-81c4-952fec188923 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:09.081491 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 254/490] 10.222.0.47 () {56 vars in 1103 bytes} [Wed Aug 31 00:07:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:09.083117 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80963af-abcc-4b08-b34a-1c5c0ee02e71 None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:09.083621 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80963af-abcc-4b08-b34a-1c5c0ee02e71 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:09.084112 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80963af-abcc-4b08-b34a-1c5c0ee02e71 None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:09.085864 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 255/491] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 00:07:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:07:09.086760 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80963af-abcc-4b08-b34a-1c5c0ee02e71 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:09.106616 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9faab3-9a06-4dff-a6ba-90adba2805fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:09.107319 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9faab3-9a06-4dff-a6ba-90adba2805fa None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:09.107595 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9faab3-9a06-4dff-a6ba-90adba2805fa None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:09.107861 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9faab3-9a06-4dff-a6ba-90adba2805fa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:09.119885 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9faab3-9a06-4dff-a6ba-90adba2805fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:09.121784 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9faab3-9a06-4dff-a6ba-90adba2805fa None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:09.137948 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-0c9faab3-9a06-4dff-a6ba-90adba2805fa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:07:09.137948 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:09.137948 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:09.137948 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:09.137948 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:09.137948 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:09.137948 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:09.137948 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:09.137948 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:09.137948 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:09.137948 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:09.137948 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:09.137948 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:07:09.137948 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:07:09.137948 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:07:09.137948 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:07:09.138958 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:09.138958 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:09.138958 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:09.138958 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:09.138958 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:09.138958 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:09.138958 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:09.138958 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:09.138958 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:09.138958 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:09.138958 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:09.138958 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:09.138958 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:09.138958 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:09.138958 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:09.138958 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:09.138958 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:07:09.139814 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:07:09.139814 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:07:09.139814 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 31 00:07:09.141838 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 237/492] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 00:07:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:07:09.143250 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f9751a-66b9-462c-a293-0369160bd049 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:09.143749 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f9751a-66b9-462c-a293-0369160bd049 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:09.144207 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f9751a-66b9-462c-a293-0369160bd049 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:09.158451 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:09.166905 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-00f9751a-66b9-462c-a293-0369160bd049 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:07:09.169270 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-00f9751a-66b9-462c-a293-0369160bd049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:07:09.208140 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80963af-abcc-4b08-b34a-1c5c0ee02e71 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:09.245051 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85babbe5-45a4-473d-92fe-8be3020d9d5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:09.245778 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85babbe5-45a4-473d-92fe-8be3020d9d5a None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:09.246185 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85babbe5-45a4-473d-92fe-8be3020d9d5a None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:09.246467 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85babbe5-45a4-473d-92fe-8be3020d9d5a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:09.247164 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 238/493] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 00:07:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:07:09.248164 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f9751a-66b9-462c-a293-0369160bd049 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:09.268948 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85babbe5-45a4-473d-92fe-8be3020d9d5a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:09.270964 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85babbe5-45a4-473d-92fe-8be3020d9d5a None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:09.289261 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-85babbe5-45a4-473d-92fe-8be3020d9d5a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:07:09.289261 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:09.289261 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:09.289261 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:09.289261 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:09.289261 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:09.289261 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:09.289261 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:09.289261 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:09.289261 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:09.289261 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:09.289261 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:09.289261 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:07:09.289261 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:07:09.289261 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:07:09.289261 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:07:09.290250 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:09.290250 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:09.290250 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:09.290250 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:09.290250 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:09.290250 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:09.290250 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:09.290250 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:09.290250 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:09.290250 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:09.290250 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:09.290250 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:09.290250 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:09.290250 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:09.290250 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:09.290250 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:09.290250 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:07:09.291131 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:07:09.291131 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:07:09.291131 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Aug 31 00:07:09.293991 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 256/494] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 00:07:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:07:09.295196 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85babbe5-45a4-473d-92fe-8be3020d9d5a None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:09.348088 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:09.373553 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f9751a-66b9-462c-a293-0369160bd049 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:09.416801 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dff5334-2be8-4a78-9644-6a25eba02fe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:09.418132 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dff5334-2be8-4a78-9644-6a25eba02fe1 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:09.418530 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dff5334-2be8-4a78-9644-6a25eba02fe1 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:09.418977 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dff5334-2be8-4a78-9644-6a25eba02fe1 None admin] PATH_INFO: `/v3/domains` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:09.419778 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dff5334-2be8-4a78-9644-6a25eba02fe1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:09.420061 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dff5334-2be8-4a78-9644-6a25eba02fe1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:09.421691 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dff5334-2be8-4a78-9644-6a25eba02fe1 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:09.425198 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85babbe5-45a4-473d-92fe-8be3020d9d5a None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:09.435465 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 239/495] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 31 00:07:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:09.436431 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:09.437516 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dff5334-2be8-4a78-9644-6a25eba02fe1 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:09.471888 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d599a2f3-fc92-4c8b-9128-89aec8840158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:09.473100 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d599a2f3-fc92-4c8b-9128-89aec8840158 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:09.473681 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d599a2f3-fc92-4c8b-9128-89aec8840158 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:09.474174 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d599a2f3-fc92-4c8b-9128-89aec8840158 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:09.488473 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d599a2f3-fc92-4c8b-9128-89aec8840158 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:07:09.494507 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-d599a2f3-fc92-4c8b-9128-89aec8840158 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:07:09.494507 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:09.494507 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:09.494507 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:09.494507 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:09.494507 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:09.494507 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:09.494507 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:09.494507 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:09.494507 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:09.494507 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:09.494507 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:09.494507 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:07:09.494507 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:07:09.494507 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:07:09.494507 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:07:09.495608 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:07:09.495608 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:07:09.495608 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:07:09.495608 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:07:09.495608 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:09.495608 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:09.495608 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:09.495608 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:09.495608 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:09.495608 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:09.495608 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:09.495608 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:09.495608 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:09.495608 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:09.495608 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:09.495608 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:09.496483 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:09.496483 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:09.496483 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:09.496483 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:09.496483 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:07:09.496483 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:07:09.496483 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:07:09.496483 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:07:09.496483 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:07:09.496483 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:07:09.496483 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:07:09.496483 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Aug 31 00:07:09.499178 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 257/496] 10.222.0.47 () {56 vars in 1102 bytes} [Wed Aug 31 00:07:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:07:09.500354 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d599a2f3-fc92-4c8b-9128-89aec8840158 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:09.561248 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dff5334-2be8-4a78-9644-6a25eba02fe1 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:09.610083 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7a436a-ffa9-420e-8d25-5bf5d7580a64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:09.612607 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7a436a-ffa9-420e-8d25-5bf5d7580a64 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:09.612963 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7a436a-ffa9-420e-8d25-5bf5d7580a64 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:09.613213 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7a436a-ffa9-420e-8d25-5bf5d7580a64 None admin] PATH_INFO: `/v3/domains` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:09.614217 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7a436a-ffa9-420e-8d25-5bf5d7580a64 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:09.614526 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7a436a-ffa9-420e-8d25-5bf5d7580a64 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:09.616735 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7a436a-ffa9-420e-8d25-5bf5d7580a64 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:09.629542 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d599a2f3-fc92-4c8b-9128-89aec8840158 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:09.631184 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:09.642098 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 240/497] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 31 00:07:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:09.643396 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7a436a-ffa9-420e-8d25-5bf5d7580a64 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:09.674822 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03501c36-387a-4173-b627-d06f38b1e07e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:09.675848 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03501c36-387a-4173-b627-d06f38b1e07e None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:09.676118 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03501c36-387a-4173-b627-d06f38b1e07e None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:09.676437 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03501c36-387a-4173-b627-d06f38b1e07e None admin] PATH_INFO: `/v3/users/glance` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:09.685335 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03501c36-387a-4173-b627-d06f38b1e07e None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:09.686856 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03501c36-387a-4173-b627-d06f38b1e07e None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:09.703202 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-03501c36-387a-4173-b627-d06f38b1e07e None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 31 00:07:09.703202 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:09.703202 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:09.703202 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:09.703202 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:09.703202 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:09.703202 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:09.703202 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:09.703202 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:09.703202 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:09.703202 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:09.703202 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:09.703202 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 00:07:09.703202 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 00:07:09.703202 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 00:07:09.703202 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 00:07:09.704231 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:09.704231 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:09.704231 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:07:09.704231 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:07:09.704231 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:07:09.704231 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:07:09.704231 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:09.704231 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:09.704231 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:09.704231 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:09.704231 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:09.704231 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:09.704231 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:09.704231 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:09.704231 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:09.704231 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:09.704231 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:09.704231 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:09.705182 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:09.705182 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:09.705182 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 00:07:09.705182 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 00:07:09.705182 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 00:07:09.705182 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 00:07:09.705182 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 00:07:09.705182 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 00:07:09.705182 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 31 00:07:09.705182 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Aug 31 00:07:09.705182 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 258/498] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 31 00:07:09 2022] GET /identity/v3/users/glance => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:07:09.705795 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03501c36-387a-4173-b627-d06f38b1e07e None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:09.737460 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:09.765568 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7a436a-ffa9-420e-8d25-5bf5d7580a64 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:09.802964 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43f51ca-b695-4983-882c-e7a9f4a6965b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:09.803586 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43f51ca-b695-4983-882c-e7a9f4a6965b None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:09.803860 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43f51ca-b695-4983-882c-e7a9f4a6965b None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:09.804127 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43f51ca-b695-4983-882c-e7a9f4a6965b None admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:09.804827 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43f51ca-b695-4983-882c-e7a9f4a6965b None admin] RBAC: Adding query filter params (name=service) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:09.805127 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43f51ca-b695-4983-882c-e7a9f4a6965b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:09.806524 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43f51ca-b695-4983-882c-e7a9f4a6965b None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:09.815383 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 241/499] 10.222.0.47 () {56 vars in 1103 bytes} [Wed Aug 31 00:07:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:09.816300 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43f51ca-b695-4983-882c-e7a9f4a6965b None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:09.817932 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03501c36-387a-4173-b627-d06f38b1e07e None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:09.860339 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f750eecd-e7a2-437c-95b7-add7fc88d84a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:09.860972 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f750eecd-e7a2-437c-95b7-add7fc88d84a None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:09.861251 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f750eecd-e7a2-437c-95b7-add7fc88d84a None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:09.861525 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f750eecd-e7a2-437c-95b7-add7fc88d84a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:09.874415 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f750eecd-e7a2-437c-95b7-add7fc88d84a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:07:09.879807 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-f750eecd-e7a2-437c-95b7-add7fc88d84a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:07:09.879807 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:09.879807 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:09.879807 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:09.879807 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:09.879807 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:09.879807 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:09.879807 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:09.879807 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:09.879807 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:09.879807 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:09.879807 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:09.879807 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:07:09.879807 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:07:09.879807 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:07:09.879807 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:07:09.880773 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:07:09.880773 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:07:09.880773 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:07:09.880773 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:07:09.880773 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:09.880773 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:09.880773 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:09.880773 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:09.880773 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:09.880773 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:09.880773 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:09.880773 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:09.880773 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:09.880773 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:09.880773 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:09.880773 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:09.881623 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:09.881623 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:09.881623 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:09.881623 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:09.881623 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:07:09.881623 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:07:09.881623 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:07:09.881623 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:07:09.881623 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:07:09.881623 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:07:09.881623 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:07:09.881623 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Aug 31 00:07:09.881623 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 259/500] 10.222.0.47 () {56 vars in 1102 bytes} [Wed Aug 31 00:07:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:07:09.882314 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3261d76-b1d2-43e0-b65d-8d4eae3b31ec None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:09.882507 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3261d76-b1d2-43e0-b65d-8d4eae3b31ec None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:09.882744 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3261d76-b1d2-43e0-b65d-8d4eae3b31ec None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:09.884199 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 260/501] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 00:07:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:07:09.884820 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3261d76-b1d2-43e0-b65d-8d4eae3b31ec None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:09.899225 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:09.960833 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43f51ca-b695-4983-882c-e7a9f4a6965b None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:09.998469 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:10.000068 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d9a98c-2146-4965-a7d1-3a43889a53e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:10.001071 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d9a98c-2146-4965-a7d1-3a43889a53e0 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:10.001509 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d9a98c-2146-4965-a7d1-3a43889a53e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:10.001847 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d9a98c-2146-4965-a7d1-3a43889a53e0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:10.013000 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d9a98c-2146-4965-a7d1-3a43889a53e0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:10.015654 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d9a98c-2146-4965-a7d1-3a43889a53e0 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:10.020252 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3261d76-b1d2-43e0-b65d-8d4eae3b31ec None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:10.031359 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-e2d9a98c-2146-4965-a7d1-3a43889a53e0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 31 00:07:10.031359 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:10.031359 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:10.031359 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:10.031359 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:10.031359 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:10.031359 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:10.031359 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:10.031359 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:10.031359 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:10.031359 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:10.031359 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:10.031359 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 00:07:10.031359 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 00:07:10.031359 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 00:07:10.031359 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 00:07:10.032492 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:10.032492 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:10.032492 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:07:10.032492 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:07:10.032492 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:07:10.032492 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:07:10.032492 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:10.032492 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:10.032492 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:10.032492 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:10.032492 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:10.032492 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:10.032492 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:10.032492 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:10.032492 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:10.032492 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:10.032492 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:10.032492 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:10.033408 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:10.033408 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:10.033408 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 00:07:10.033408 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 00:07:10.033408 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 00:07:10.033408 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 00:07:10.033408 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 00:07:10.033408 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 00:07:10.033408 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 31 00:07:10.033408 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 31 00:07:10.033408 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 242/502] 10.222.0.47 () {56 vars in 1093 bytes} [Wed Aug 31 00:07:09 2022] GET /identity/v3/users/nova => generated 82 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:07:10.033408 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d9a98c-2146-4965-a7d1-3a43889a53e0 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:10.068996 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc8ee31-4ec9-422b-b75b-7069433f360a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:10.068996 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc8ee31-4ec9-422b-b75b-7069433f360a None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:10.068996 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc8ee31-4ec9-422b-b75b-7069433f360a None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:10.069389 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc8ee31-4ec9-422b-b75b-7069433f360a None admin] PATH_INFO: `/v3/users` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:10.069863 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc8ee31-4ec9-422b-b75b-7069433f360a None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:10.070176 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc8ee31-4ec9-422b-b75b-7069433f360a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:10.071624 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc8ee31-4ec9-422b-b75b-7069433f360a None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:10.117875 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 261/503] 10.222.0.47 () {56 vars in 1137 bytes} [Wed Aug 31 00:07:09 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:10.119219 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc8ee31-4ec9-422b-b75b-7069433f360a None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:10.151046 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d9a98c-2146-4965-a7d1-3a43889a53e0 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:10.177907 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:10.191583 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285d3b98-f101-4c72-b447-650799f1f87e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:10.192391 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285d3b98-f101-4c72-b447-650799f1f87e None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:10.192679 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285d3b98-f101-4c72-b447-650799f1f87e None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:10.192950 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285d3b98-f101-4c72-b447-650799f1f87e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:10.205874 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285d3b98-f101-4c72-b447-650799f1f87e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:10.207368 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285d3b98-f101-4c72-b447-650799f1f87e None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:10.225467 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-285d3b98-f101-4c72-b447-650799f1f87e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:07:10.225467 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:10.225467 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:10.225467 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:10.225467 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:10.225467 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:10.225467 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:10.225467 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:10.225467 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:10.225467 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:10.225467 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:10.225467 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:10.225467 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:07:10.225467 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:07:10.225467 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:07:10.225467 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:07:10.227366 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:10.227366 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:10.227366 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:10.227366 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:10.227366 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:10.227366 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:10.227366 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:10.227366 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:10.227366 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:10.227366 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:10.227366 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:10.227366 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:10.227366 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:10.227366 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:10.227366 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:10.227366 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:10.227366 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:07:10.229069 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:07:10.229069 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:07:10.229069 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 31 00:07:10.229069 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 243/504] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 00:07:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:07:10.229069 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2742b858-3270-4945-b317-99ec17f932d5 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:10.229069 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2742b858-3270-4945-b317-99ec17f932d5 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:10.229069 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2742b858-3270-4945-b317-99ec17f932d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:10.249405 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc8ee31-4ec9-422b-b75b-7069433f360a None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:10.249615 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-2742b858-3270-4945-b317-99ec17f932d5 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:07:10.250785 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-2742b858-3270-4945-b317-99ec17f932d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:07:10.290090 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb281db5-069b-4580-9208-d5b4307cd262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:10.290617 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb281db5-069b-4580-9208-d5b4307cd262 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:10.292179 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb281db5-069b-4580-9208-d5b4307cd262 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:10.292179 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb281db5-069b-4580-9208-d5b4307cd262 None admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:10.292179 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb281db5-069b-4580-9208-d5b4307cd262 None admin] RBAC: Adding query filter params (name=service) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:10.292179 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb281db5-069b-4580-9208-d5b4307cd262 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:10.294093 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb281db5-069b-4580-9208-d5b4307cd262 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:10.306612 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 262/505] 10.222.0.47 () {56 vars in 1103 bytes} [Wed Aug 31 00:07:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:10.312914 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb281db5-069b-4580-9208-d5b4307cd262 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:10.323946 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 244/506] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 00:07:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:07:10.325268 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2742b858-3270-4945-b317-99ec17f932d5 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:10.326638 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:10.449814 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb281db5-069b-4580-9208-d5b4307cd262 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:10.469988 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2742b858-3270-4945-b317-99ec17f932d5 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:10.474012 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:10.493359 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb057b4-6a84-4930-8fdb-362b3c59b496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:10.493979 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb057b4-6a84-4930-8fdb-362b3c59b496 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:10.494260 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb057b4-6a84-4930-8fdb-362b3c59b496 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:10.494539 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb057b4-6a84-4930-8fdb-362b3c59b496 None admin] PATH_INFO: `/v3/users` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:10.495286 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb057b4-6a84-4930-8fdb-362b3c59b496 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:10.496464 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb057b4-6a84-4930-8fdb-362b3c59b496 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:10.498624 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb057b4-6a84-4930-8fdb-362b3c59b496 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:10.524613 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 263/507] 10.222.0.47 () {56 vars in 1133 bytes} [Wed Aug 31 00:07:10 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:10.525542 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb057b4-6a84-4930-8fdb-362b3c59b496 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:10.536783 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b98ca1-1a12-4e8c-9479-53f80b893c59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:10.537406 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b98ca1-1a12-4e8c-9479-53f80b893c59 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:10.537692 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b98ca1-1a12-4e8c-9479-53f80b893c59 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:10.537964 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b98ca1-1a12-4e8c-9479-53f80b893c59 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:10.612575 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:10.640751 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b98ca1-1a12-4e8c-9479-53f80b893c59 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:10.642339 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b98ca1-1a12-4e8c-9479-53f80b893c59 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:10.661598 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb057b4-6a84-4930-8fdb-362b3c59b496 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:10.707367 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42242f75-d223-4770-a8c2-9fac1ef63760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:10.707990 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42242f75-d223-4770-a8c2-9fac1ef63760 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:10.708295 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42242f75-d223-4770-a8c2-9fac1ef63760 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:10.708577 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42242f75-d223-4770-a8c2-9fac1ef63760 None admin] PATH_INFO: `/v3/domains` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:10.709223 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42242f75-d223-4770-a8c2-9fac1ef63760 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:10.709524 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42242f75-d223-4770-a8c2-9fac1ef63760 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:10.710919 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42242f75-d223-4770-a8c2-9fac1ef63760 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:10.729202 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 264/508] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 31 00:07:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:10.729202 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42242f75-d223-4770-a8c2-9fac1ef63760 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:10.766524 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 245/509] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 31 00:07:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 00:07:10.771205 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b98ca1-1a12-4e8c-9479-53f80b893c59 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:10.773318 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:10.842518 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42242f75-d223-4770-a8c2-9fac1ef63760 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:10.874441 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:10.886208 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3851191-d9c5-4eb7-884e-3e2860deb933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:10.886815 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b98ca1-1a12-4e8c-9479-53f80b893c59 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:10.886919 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3851191-d9c5-4eb7-884e-3e2860deb933 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:10.887224 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3851191-d9c5-4eb7-884e-3e2860deb933 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:10.887409 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3851191-d9c5-4eb7-884e-3e2860deb933 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:10.899909 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3851191-d9c5-4eb7-884e-3e2860deb933 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:10.901440 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3851191-d9c5-4eb7-884e-3e2860deb933 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:10.920364 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-f3851191-d9c5-4eb7-884e-3e2860deb933 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:07:10.920364 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:10.920364 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:10.920364 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:10.920364 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:10.920364 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:10.920364 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:10.920364 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:10.920364 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:10.920364 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:10.920364 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:10.920364 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:10.920364 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:07:10.920364 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:07:10.920364 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:07:10.920364 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:07:10.921514 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:10.921514 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:10.921514 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:10.921514 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:10.921514 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:10.921514 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:10.921514 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:10.921514 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:10.921514 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:10.921514 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:10.921514 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:10.921514 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:10.921514 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:10.921514 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:10.921514 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:10.921514 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:10.921514 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:07:10.922803 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:07:10.922803 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:07:10.922803 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Aug 31 00:07:10.922803 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 265/510] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 00:07:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:07:10.922803 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3851191-d9c5-4eb7-884e-3e2860deb933 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:10.934673 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470e43f3-f8f8-4b3e-a855-b8595796fdc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:10.935462 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470e43f3-f8f8-4b3e-a855-b8595796fdc0 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:10.935743 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470e43f3-f8f8-4b3e-a855-b8595796fdc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:10.936011 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470e43f3-f8f8-4b3e-a855-b8595796fdc0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:11.014656 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470e43f3-f8f8-4b3e-a855-b8595796fdc0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:11.016128 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470e43f3-f8f8-4b3e-a855-b8595796fdc0 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:11.020114 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:11.060939 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3851191-d9c5-4eb7-884e-3e2860deb933 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:11.102866 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e47ace4-ca7f-4f55-a6cb-0e491ebe5798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:11.103897 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e47ace4-ca7f-4f55-a6cb-0e491ebe5798 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:11.104277 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e47ace4-ca7f-4f55-a6cb-0e491ebe5798 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:11.104561 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e47ace4-ca7f-4f55-a6cb-0e491ebe5798 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:11.118287 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e47ace4-ca7f-4f55-a6cb-0e491ebe5798 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:11.120208 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e47ace4-ca7f-4f55-a6cb-0e491ebe5798 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:11.134036 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 246/511] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 31 00:07:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 00:07:11.135921 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470e43f3-f8f8-4b3e-a855-b8595796fdc0 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:11.137587 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-3e47ace4-ca7f-4f55-a6cb-0e491ebe5798 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:07:11.137587 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:11.137587 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:11.137587 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:11.137587 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:11.137587 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:11.137587 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:11.137587 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:11.137587 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:11.137587 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:11.137587 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:11.137587 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:11.137587 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:07:11.137587 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:07:11.137587 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:07:11.137587 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:07:11.139531 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:11.139531 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:11.139531 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:11.139531 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:11.139531 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:11.139531 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:11.139531 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:11.139531 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:11.139531 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:11.139531 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:11.139531 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:11.139531 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:11.139531 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:11.139531 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:11.139531 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:11.139531 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:11.139531 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:07:11.141239 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:07:11.141239 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:07:11.141239 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Aug 31 00:07:11.141239 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 266/512] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 00:07:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:07:11.141239 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e47ace4-ca7f-4f55-a6cb-0e491ebe5798 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:11.175984 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:11.248602 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470e43f3-f8f8-4b3e-a855-b8595796fdc0 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:11.249871 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e47ace4-ca7f-4f55-a6cb-0e491ebe5798 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:11.251053 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:11.286071 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df483351-3170-40a5-b4c6-b3645a98699f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:11.286695 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df483351-3170-40a5-b4c6-b3645a98699f None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:11.286835 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38a0883-8398-4312-a58d-abe1d8ef8cfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:11.286974 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df483351-3170-40a5-b4c6-b3645a98699f None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:11.287242 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df483351-3170-40a5-b4c6-b3645a98699f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:11.287414 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38a0883-8398-4312-a58d-abe1d8ef8cfa None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:11.287754 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38a0883-8398-4312-a58d-abe1d8ef8cfa None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:11.287964 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38a0883-8398-4312-a58d-abe1d8ef8cfa None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:11.295334 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38a0883-8398-4312-a58d-abe1d8ef8cfa None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:11.296837 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38a0883-8398-4312-a58d-abe1d8ef8cfa None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:11.298365 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df483351-3170-40a5-b4c6-b3645a98699f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:11.299818 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df483351-3170-40a5-b4c6-b3645a98699f None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:11.309705 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-a38a0883-8398-4312-a58d-abe1d8ef8cfa None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 31 00:07:11.309705 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:11.309705 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:11.309705 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:11.309705 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:11.309705 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:11.309705 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:11.309705 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:11.309705 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:11.309705 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:11.309705 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:11.309705 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:11.309705 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 00:07:11.309705 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 00:07:11.309705 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 00:07:11.309705 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 00:07:11.310652 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:11.310652 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:11.310652 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:07:11.310652 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:07:11.310652 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:07:11.310652 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:07:11.310652 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:11.310652 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:11.310652 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:11.310652 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:11.310652 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:11.310652 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:11.310652 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:11.310652 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:11.310652 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:11.310652 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:11.310652 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:11.310652 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:11.311661 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:11.311661 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:11.311661 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 00:07:11.311661 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 00:07:11.311661 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 00:07:11.311661 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 00:07:11.311661 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 00:07:11.311661 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 00:07:11.311661 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 31 00:07:11.311661 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 31 00:07:11.311661 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 247/513] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 31 00:07:11 2022] GET /identity/v3/users/cinder => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:07:11.311661 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38a0883-8398-4312-a58d-abe1d8ef8cfa None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:11.314625 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-df483351-3170-40a5-b4c6-b3645a98699f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:07:11.314625 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:11.314625 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:11.314625 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:11.314625 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:11.314625 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:11.314625 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:11.314625 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:11.314625 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:11.314625 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:11.314625 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:11.314625 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:11.314625 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:07:11.314625 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:07:11.314625 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:07:11.314625 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:07:11.317424 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:11.317424 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:11.317424 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:11.317424 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:11.317424 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:11.317424 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:11.317424 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:11.317424 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:11.317424 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:11.317424 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:11.317424 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:11.317424 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:11.317424 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:11.317424 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:11.317424 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:11.317424 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:11.317424 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:07:11.320613 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:07:11.320613 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:07:11.320613 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Aug 31 00:07:11.320613 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 267/514] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 00:07:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:07:11.320613 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df483351-3170-40a5-b4c6-b3645a98699f None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:11.422852 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:11.438987 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38a0883-8398-4312-a58d-abe1d8ef8cfa None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:11.444084 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df483351-3170-40a5-b4c6-b3645a98699f None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:11.481684 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2c28c6-a969-4c04-8dbd-ab92f4144642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:11.482328 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2c28c6-a969-4c04-8dbd-ab92f4144642 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:11.482608 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2c28c6-a969-4c04-8dbd-ab92f4144642 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:11.482879 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2c28c6-a969-4c04-8dbd-ab92f4144642 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:11.484653 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabdfa84-89d7-45a1-b59e-745a57e21bee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:11.485196 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabdfa84-89d7-45a1-b59e-745a57e21bee None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:11.485445 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabdfa84-89d7-45a1-b59e-745a57e21bee None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:11.485714 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabdfa84-89d7-45a1-b59e-745a57e21bee None admin] PATH_INFO: `/v3/domains` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:11.486368 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabdfa84-89d7-45a1-b59e-745a57e21bee None admin] RBAC: Adding query filter params (name=Default) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:11.486772 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabdfa84-89d7-45a1-b59e-745a57e21bee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:11.488067 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabdfa84-89d7-45a1-b59e-745a57e21bee None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:11.494545 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2c28c6-a969-4c04-8dbd-ab92f4144642 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:11.496931 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2c28c6-a969-4c04-8dbd-ab92f4144642 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:11.505166 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 248/515] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 31 00:07:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:11.506789 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabdfa84-89d7-45a1-b59e-745a57e21bee None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:11.517851 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-dc2c28c6-a969-4c04-8dbd-ab92f4144642 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:07:11.517851 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:11.517851 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:11.517851 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:11.517851 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:11.517851 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:11.517851 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:11.517851 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:11.517851 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:11.517851 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:11.517851 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:11.517851 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:11.517851 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:07:11.517851 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:07:11.517851 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:07:11.517851 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:07:11.519042 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:11.519042 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:11.519042 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:11.519042 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:11.519042 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:11.519042 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:11.519042 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:11.519042 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:11.519042 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:11.519042 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:11.519042 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:11.519042 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:11.519042 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:11.519042 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:11.519042 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:11.519042 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:11.519042 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:07:11.519962 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:07:11.519962 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:07:11.519962 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Aug 31 00:07:11.519962 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 268/516] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 00:07:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:07:11.519962 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2c28c6-a969-4c04-8dbd-ab92f4144642 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:11.541598 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:11.633794 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabdfa84-89d7-45a1-b59e-745a57e21bee None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:11.650724 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2c28c6-a969-4c04-8dbd-ab92f4144642 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:11.670919 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb06cd8-6a89-46e6-900b-6653bd449d93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:11.671535 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb06cd8-6a89-46e6-900b-6653bd449d93 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:11.671814 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb06cd8-6a89-46e6-900b-6653bd449d93 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:11.672086 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb06cd8-6a89-46e6-900b-6653bd449d93 None admin] PATH_INFO: `/v3/domains` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:11.672767 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb06cd8-6a89-46e6-900b-6653bd449d93 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:11.673142 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb06cd8-6a89-46e6-900b-6653bd449d93 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:11.674475 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb06cd8-6a89-46e6-900b-6653bd449d93 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:11.682799 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:11.687434 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 249/517] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 31 00:07:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:11.688308 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23056f7e-a5d2-4dd9-b4f3-16bda05364d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:11.688458 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb06cd8-6a89-46e6-900b-6653bd449d93 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:11.688937 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23056f7e-a5d2-4dd9-b4f3-16bda05364d5 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:11.689235 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23056f7e-a5d2-4dd9-b4f3-16bda05364d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:11.689496 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23056f7e-a5d2-4dd9-b4f3-16bda05364d5 None admin] PATH_INFO: `/v3/domains` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:11.690201 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23056f7e-a5d2-4dd9-b4f3-16bda05364d5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:11.690454 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23056f7e-a5d2-4dd9-b4f3-16bda05364d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:11.691855 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23056f7e-a5d2-4dd9-b4f3-16bda05364d5 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:11.704884 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 269/518] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 31 00:07:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:11.705721 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23056f7e-a5d2-4dd9-b4f3-16bda05364d5 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:11.781738 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:11.798393 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb06cd8-6a89-46e6-900b-6653bd449d93 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:11.814135 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23056f7e-a5d2-4dd9-b4f3-16bda05364d5 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:11.835670 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a50772-d4dc-4aa6-8aa7-b2972a6ce416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:11.836324 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a50772-d4dc-4aa6-8aa7-b2972a6ce416 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:11.836597 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a50772-d4dc-4aa6-8aa7-b2972a6ce416 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:11.836872 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a50772-d4dc-4aa6-8aa7-b2972a6ce416 None admin] PATH_INFO: `/v3/users` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:11.837610 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a50772-d4dc-4aa6-8aa7-b2972a6ce416 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:11.837913 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a50772-d4dc-4aa6-8aa7-b2972a6ce416 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:11.839996 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a50772-d4dc-4aa6-8aa7-b2972a6ce416 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:11.849987 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929d6ef8-ce6b-4ebe-b687-41630afb2a78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:11.850620 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929d6ef8-ce6b-4ebe-b687-41630afb2a78 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:11.850896 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929d6ef8-ce6b-4ebe-b687-41630afb2a78 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:11.851167 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929d6ef8-ce6b-4ebe-b687-41630afb2a78 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:11.858411 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929d6ef8-ce6b-4ebe-b687-41630afb2a78 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:11.859864 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929d6ef8-ce6b-4ebe-b687-41630afb2a78 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:11.872315 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-929d6ef8-ce6b-4ebe-b687-41630afb2a78 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 31 00:07:11.872315 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:11.872315 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:11.872315 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:11.872315 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:11.872315 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:11.872315 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:11.872315 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:11.872315 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:11.872315 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:11.872315 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:11.872315 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:11.872315 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 00:07:11.872315 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 00:07:11.872315 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 00:07:11.872315 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 00:07:11.873401 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:11.873401 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:11.873401 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:07:11.873401 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:07:11.873401 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:07:11.873401 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:07:11.873401 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:11.873401 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:11.873401 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:11.873401 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:11.873401 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:11.873401 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:11.873401 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:11.873401 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:11.873401 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:11.873401 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:11.873401 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:11.873401 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:11.874362 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:11.874362 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:11.874362 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 00:07:11.874362 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 00:07:11.874362 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 00:07:11.874362 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 00:07:11.874362 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 00:07:11.874362 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 00:07:11.874362 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 31 00:07:11.874362 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Aug 31 00:07:11.874362 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 270/519] 10.222.0.47 () {56 vars in 1102 bytes} [Wed Aug 31 00:07:11 2022] GET /identity/v3/users/neutron => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:07:11.875390 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929d6ef8-ce6b-4ebe-b687-41630afb2a78 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:11.880335 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 250/520] 10.222.0.47 () {56 vars in 1137 bytes} [Wed Aug 31 00:07:11 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:11.881530 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a50772-d4dc-4aa6-8aa7-b2972a6ce416 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:11.931829 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:11.992667 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929d6ef8-ce6b-4ebe-b687-41630afb2a78 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:11.996676 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a50772-d4dc-4aa6-8aa7-b2972a6ce416 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:12.033509 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd41d12-6ea8-4994-b6d5-7761e7cc77a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:12.034122 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd41d12-6ea8-4994-b6d5-7761e7cc77a7 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:12.034668 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd41d12-6ea8-4994-b6d5-7761e7cc77a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:12.034946 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd41d12-6ea8-4994-b6d5-7761e7cc77a7 None admin] PATH_INFO: `/v3/domains` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:12.035593 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd41d12-6ea8-4994-b6d5-7761e7cc77a7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:12.035898 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd41d12-6ea8-4994-b6d5-7761e7cc77a7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:12.037331 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd41d12-6ea8-4994-b6d5-7761e7cc77a7 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:12.047728 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d81c282-ea8e-438c-af4f-f3145add408f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:12.048530 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d81c282-ea8e-438c-af4f-f3145add408f None admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:12.048931 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d81c282-ea8e-438c-af4f-f3145add408f None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:12.049372 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d81c282-ea8e-438c-af4f-f3145add408f None admin] PATH_INFO: `/v3/users` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:12.050453 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d81c282-ea8e-438c-af4f-f3145add408f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:12.052831 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d81c282-ea8e-438c-af4f-f3145add408f None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:12.061350 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 271/521] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 31 00:07:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:12.061350 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd41d12-6ea8-4994-b6d5-7761e7cc77a7 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:12.080073 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:12.091191 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 251/522] 10.222.0.47 () {60 vars in 1132 bytes} [Wed Aug 31 00:07:11 2022] POST /identity/v3/users => generated 247 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:07:12.093378 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d81c282-ea8e-438c-af4f-f3145add408f None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:12.236422 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd41d12-6ea8-4994-b6d5-7761e7cc77a7 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:12.253252 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:12.266363 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d81c282-ea8e-438c-af4f-f3145add408f None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:12.287861 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2a5337-cecd-47c2-be83-151be9aa02f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:12.288640 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2a5337-cecd-47c2-be83-151be9aa02f0 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:12.289007 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2a5337-cecd-47c2-be83-151be9aa02f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:12.289441 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2a5337-cecd-47c2-be83-151be9aa02f0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:12.300580 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2a5337-cecd-47c2-be83-151be9aa02f0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:12.302210 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2a5337-cecd-47c2-be83-151be9aa02f0 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:12.316613 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-2e2a5337-cecd-47c2-be83-151be9aa02f0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:07:12.316613 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:12.316613 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:12.316613 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:12.316613 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:12.316613 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:12.316613 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:12.316613 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:12.316613 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:12.316613 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:12.316613 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:12.316613 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:12.316613 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 00:07:12.316613 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 00:07:12.316613 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 00:07:12.318167 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 00:07:12.318167 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:12.318167 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:12.318167 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:12.318167 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:12.318167 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:12.318167 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:12.318167 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:12.318167 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:12.318167 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:12.318167 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:12.318167 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:12.318167 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:12.318167 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:12.318167 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:12.318167 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:12.318167 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:12.319715 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 00:07:12.319715 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 00:07:12.319715 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:07:12.319715 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:07:12.319715 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:07:12.319715 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:07:12.319715 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:07:12.319715 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Aug 31 00:07:12.319715 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 272/523] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 31 00:07:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:07:12.319715 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2a5337-cecd-47c2-be83-151be9aa02f0 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:12.337473 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9208bb78-5fdb-4532-a992-804ec58e6812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:12.338101 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9208bb78-5fdb-4532-a992-804ec58e6812 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:12.338382 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9208bb78-5fdb-4532-a992-804ec58e6812 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:12.338662 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9208bb78-5fdb-4532-a992-804ec58e6812 None admin] PATH_INFO: `/v3/users` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:12.339894 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9208bb78-5fdb-4532-a992-804ec58e6812 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:12.340234 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9208bb78-5fdb-4532-a992-804ec58e6812 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:12.342254 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9208bb78-5fdb-4532-a992-804ec58e6812 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:12.363388 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 252/524] 10.222.0.47 () {56 vars in 1139 bytes} [Wed Aug 31 00:07:12 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:12.364430 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9208bb78-5fdb-4532-a992-804ec58e6812 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:12.426003 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:12.484585 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9208bb78-5fdb-4532-a992-804ec58e6812 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:12.497418 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2a5337-cecd-47c2-be83-151be9aa02f0 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:12.530605 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573cb040-ec03-40b2-be4e-29771162d3b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:12.531252 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573cb040-ec03-40b2-be4e-29771162d3b4 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:12.531533 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573cb040-ec03-40b2-be4e-29771162d3b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:12.531806 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573cb040-ec03-40b2-be4e-29771162d3b4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:12.535635 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd092e60-7f8e-446d-becd-ea8694fb87dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:12.536485 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd092e60-7f8e-446d-becd-ea8694fb87dc None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:12.536928 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd092e60-7f8e-446d-becd-ea8694fb87dc None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:12.537356 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd092e60-7f8e-446d-becd-ea8694fb87dc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:12.539658 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573cb040-ec03-40b2-be4e-29771162d3b4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:12.541168 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573cb040-ec03-40b2-be4e-29771162d3b4 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:12.555473 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-573cb040-ec03-40b2-be4e-29771162d3b4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:07:12.555473 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:12.555473 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:12.555473 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:12.555473 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:12.555473 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:12.555473 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:12.555473 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:12.555473 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:12.555473 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:12.555473 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:12.555473 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:12.555473 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 00:07:12.555473 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 00:07:12.555473 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 00:07:12.556546 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 00:07:12.556546 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:12.556546 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:12.556546 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:12.556546 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:12.556546 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:12.556546 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:12.556546 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:12.556546 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:12.556546 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:12.556546 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:12.556546 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:12.556546 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:12.556546 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:12.556546 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:12.556546 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:12.556546 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:12.557694 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 00:07:12.557694 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 00:07:12.557694 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:07:12.557694 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:07:12.557694 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:07:12.557694 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:07:12.557694 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:07:12.557694 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 31 00:07:12.557694 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 253/525] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 31 00:07:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:07:12.557694 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573cb040-ec03-40b2-be4e-29771162d3b4 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:12.594248 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:12.630774 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd092e60-7f8e-446d-becd-ea8694fb87dc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:12.632437 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd092e60-7f8e-446d-becd-ea8694fb87dc None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:12.673499 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573cb040-ec03-40b2-be4e-29771162d3b4 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:12.693067 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:12.714181 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebde9bf8-e98e-4412-91df-112f553d0a9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:12.715500 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebde9bf8-e98e-4412-91df-112f553d0a9c None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:12.715786 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebde9bf8-e98e-4412-91df-112f553d0a9c None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:12.716052 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebde9bf8-e98e-4412-91df-112f553d0a9c None admin] PATH_INFO: `/v3/projects` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:12.716832 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebde9bf8-e98e-4412-91df-112f553d0a9c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:12.717135 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebde9bf8-e98e-4412-91df-112f553d0a9c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:12.718610 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebde9bf8-e98e-4412-91df-112f553d0a9c None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:12.738445 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 254/526] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Aug 31 00:07:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:12.739306 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebde9bf8-e98e-4412-91df-112f553d0a9c None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:12.753043 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 273/527] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 31 00:07:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 00:07:12.754835 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd092e60-7f8e-446d-becd-ea8694fb87dc None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:12.833254 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:12.863849 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebde9bf8-e98e-4412-91df-112f553d0a9c None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:12.873717 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd092e60-7f8e-446d-becd-ea8694fb87dc None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:12.908193 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5b60fc-e22c-4ce1-84f3-0f8fded35069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:12.909576 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5b60fc-e22c-4ce1-84f3-0f8fded35069 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:12.910010 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5b60fc-e22c-4ce1-84f3-0f8fded35069 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:12.910944 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5b60fc-e22c-4ce1-84f3-0f8fded35069 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:12.923267 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40550452-9fc1-40ab-b28a-2e4e20a337da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:12.923935 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40550452-9fc1-40ab-b28a-2e4e20a337da None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:12.924195 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40550452-9fc1-40ab-b28a-2e4e20a337da None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:12.924466 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40550452-9fc1-40ab-b28a-2e4e20a337da None admin] PATH_INFO: `/v3/projects` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:12.925180 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40550452-9fc1-40ab-b28a-2e4e20a337da None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:12.925484 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40550452-9fc1-40ab-b28a-2e4e20a337da None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:12.926973 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40550452-9fc1-40ab-b28a-2e4e20a337da None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:12.952322 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 274/528] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Aug 31 00:07:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:12.952322 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40550452-9fc1-40ab-b28a-2e4e20a337da None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:12.993881 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:13.028710 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5b60fc-e22c-4ce1-84f3-0f8fded35069 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:13.030155 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5b60fc-e22c-4ce1-84f3-0f8fded35069 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:13.073278 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40550452-9fc1-40ab-b28a-2e4e20a337da None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:13.113715 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:13.121997 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c2242b-fbfc-4853-a7b6-41b734706b82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:13.122971 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c2242b-fbfc-4853-a7b6-41b734706b82 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:13.123250 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c2242b-fbfc-4853-a7b6-41b734706b82 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:13.123522 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c2242b-fbfc-4853-a7b6-41b734706b82 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:13.124308 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c2242b-fbfc-4853-a7b6-41b734706b82 None admin] RBAC: Adding query filter params (role.id=1e6d7ecde4b0415bb944f25eda475f9c, scope.project.id=1b647cccb30a427193fc62dbebe0c6f1, user.id=cc025521e1dc4c91ab50a8718a87754f) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:13.124618 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c2242b-fbfc-4853-a7b6-41b734706b82 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:13.126675 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c2242b-fbfc-4853-a7b6-41b734706b82 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:13.133634 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 275/529] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 31 00:07:12 2022] GET /identity/v3/role_assignments?user.id=cc025521e1dc4c91ab50a8718a87754f&scope.project.id=1b647cccb30a427193fc62dbebe0c6f1&role.id=1e6d7ecde4b0415bb944f25eda475f9c => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:13.142245 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c2242b-fbfc-4853-a7b6-41b734706b82 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:13.167106 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 255/530] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 31 00:07:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 00:07:13.169818 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5b60fc-e22c-4ce1-84f3-0f8fded35069 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:13.282695 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:13.315248 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c2242b-fbfc-4853-a7b6-41b734706b82 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:13.316506 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5b60fc-e22c-4ce1-84f3-0f8fded35069 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:13.366484 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa32c2d-6801-49b9-b683-23e974eaf92d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:13.366937 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa32c2d-6801-49b9-b683-23e974eaf92d None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:13.367219 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa32c2d-6801-49b9-b683-23e974eaf92d None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:13.367782 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab58693-872f-4f3a-9963-0a499822cacd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:13.368879 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab58693-872f-4f3a-9963-0a499822cacd None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:13.369368 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab58693-872f-4f3a-9963-0a499822cacd None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:13.369837 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab58693-872f-4f3a-9963-0a499822cacd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:13.372482 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa32c2d-6801-49b9-b683-23e974eaf92d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:13.374035 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa32c2d-6801-49b9-b683-23e974eaf92d None admin] RBAC: Adding query filter params (role.id=1e6d7ecde4b0415bb944f25eda475f9c, scope.project.id=1b647cccb30a427193fc62dbebe0c6f1, user.id=9ea002bf49c248dbae7147665fa10fd1) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:13.374620 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa32c2d-6801-49b9-b683-23e974eaf92d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:13.377131 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa32c2d-6801-49b9-b683-23e974eaf92d None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:13.385108 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 256/531] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 31 00:07:13 2022] GET /identity/v3/role_assignments?user.id=9ea002bf49c248dbae7147665fa10fd1&scope.project.id=1b647cccb30a427193fc62dbebe0c6f1&role.id=1e6d7ecde4b0415bb944f25eda475f9c => generated 259 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:13.388532 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa32c2d-6801-49b9-b683-23e974eaf92d None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:13.391394 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab58693-872f-4f3a-9963-0a499822cacd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:13.394649 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab58693-872f-4f3a-9963-0a499822cacd None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:13.428512 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-8ab58693-872f-4f3a-9963-0a499822cacd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:07:13.428512 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:13.428512 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:13.428512 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:13.428512 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:13.428512 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:13.428512 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:13.428512 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:13.428512 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:13.428512 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:13.428512 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:13.428512 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:13.428512 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:07:13.428512 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:07:13.428512 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:07:13.428512 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:07:13.429586 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:13.429586 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:13.429586 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:13.429586 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:13.429586 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:13.429586 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:13.429586 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:13.429586 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:13.429586 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:13.429586 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:13.429586 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:13.429586 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:13.429586 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:13.429586 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:13.429586 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:13.429586 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:13.429586 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:07:13.430640 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:07:13.430640 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:07:13.430640 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Aug 31 00:07:13.436468 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 276/532] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 00:07:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:07:13.438481 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab58693-872f-4f3a-9963-0a499822cacd None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:13.577460 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:13.651438 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa32c2d-6801-49b9-b683-23e974eaf92d None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:13.690748 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab58693-872f-4f3a-9963-0a499822cacd None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:13.736637 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f29ed66-455a-4f84-94d2-3bd07e2b13e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:13.737284 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f29ed66-455a-4f84-94d2-3bd07e2b13e4 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:13.737567 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f29ed66-455a-4f84-94d2-3bd07e2b13e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:13.737835 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f29ed66-455a-4f84-94d2-3bd07e2b13e4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:13.755178 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:13.758527 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f29ed66-455a-4f84-94d2-3bd07e2b13e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:13.761913 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f29ed66-455a-4f84-94d2-3bd07e2b13e4 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:13.774984 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cddcc1c-7b23-4c12-bb0d-375b2f474d38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:13.775605 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cddcc1c-7b23-4c12-bb0d-375b2f474d38 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:13.775888 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cddcc1c-7b23-4c12-bb0d-375b2f474d38 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:13.776181 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cddcc1c-7b23-4c12-bb0d-375b2f474d38 None admin] PATH_INFO: `/v3/domains` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:13.776871 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cddcc1c-7b23-4c12-bb0d-375b2f474d38 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:13.777365 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cddcc1c-7b23-4c12-bb0d-375b2f474d38 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:13.779000 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cddcc1c-7b23-4c12-bb0d-375b2f474d38 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:13.791342 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-2f29ed66-455a-4f84-94d2-3bd07e2b13e4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:07:13.791342 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:13.791342 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:13.791342 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:13.791342 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:13.791342 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:13.791342 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:13.791342 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:13.791342 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:13.791342 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:13.791342 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:13.791342 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:13.791342 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:07:13.791342 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:07:13.791342 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:07:13.791342 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:07:13.793107 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:13.793107 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:13.793107 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:13.793107 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:13.793107 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:13.793107 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:13.793107 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:13.793107 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:13.793107 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:13.793107 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:13.793107 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:13.793107 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:13.793107 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:13.793107 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:13.793107 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:13.793107 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:13.793107 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:07:13.794752 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:07:13.794752 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:07:13.794752 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 31 00:07:13.798499 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 257/533] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 00:07:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 412 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:07:13.805297 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f29ed66-455a-4f84-94d2-3bd07e2b13e4 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:13.814679 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 277/534] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 31 00:07:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 377 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:13.820826 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cddcc1c-7b23-4c12-bb0d-375b2f474d38 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:13.996191 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cddcc1c-7b23-4c12-bb0d-375b2f474d38 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:13.997224 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f29ed66-455a-4f84-94d2-3bd07e2b13e4 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:14.008415 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:14.029747 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28674b8-f036-4689-bf79-00c1f80fe04a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:14.030384 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28674b8-f036-4689-bf79-00c1f80fe04a None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:14.030661 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28674b8-f036-4689-bf79-00c1f80fe04a None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:14.030948 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28674b8-f036-4689-bf79-00c1f80fe04a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:14.038832 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28674b8-f036-4689-bf79-00c1f80fe04a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:14.040332 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28674b8-f036-4689-bf79-00c1f80fe04a None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:14.053434 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-a28674b8-f036-4689-bf79-00c1f80fe04a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:07:14.053434 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:14.053434 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:14.053434 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:14.053434 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:14.053434 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:14.053434 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:14.053434 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:14.053434 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:14.053434 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:14.053434 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:14.053434 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:14.053434 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 00:07:14.053434 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 00:07:14.053434 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 00:07:14.055067 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 00:07:14.055067 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:14.055067 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:14.055067 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:14.055067 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:14.055067 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:14.055067 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:14.055067 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:14.055067 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:14.055067 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:14.055067 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:14.055067 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:14.055067 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:14.055067 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:14.055067 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:14.055067 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:14.055067 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:14.056758 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 00:07:14.056758 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 00:07:14.056758 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:07:14.056758 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:07:14.056758 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:07:14.056758 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:07:14.056758 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:07:14.056758 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Aug 31 00:07:14.056758 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 278/535] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 31 00:07:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:07:14.064799 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28674b8-f036-4689-bf79-00c1f80fe04a None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:14.101431 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e808826a-8c39-4d60-8845-1d4565bb4544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:14.103552 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e808826a-8c39-4d60-8845-1d4565bb4544 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:14.104367 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e808826a-8c39-4d60-8845-1d4565bb4544 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:14.105673 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e808826a-8c39-4d60-8845-1d4565bb4544 None admin] PATH_INFO: `/v3/domains` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:14.107201 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e808826a-8c39-4d60-8845-1d4565bb4544 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:14.108237 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e808826a-8c39-4d60-8845-1d4565bb4544 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:14.118849 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e808826a-8c39-4d60-8845-1d4565bb4544 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:14.161034 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 258/536] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 31 00:07:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 356 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:14.168172 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e808826a-8c39-4d60-8845-1d4565bb4544 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:14.179641 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28674b8-f036-4689-bf79-00c1f80fe04a None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:14.293498 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c20c588-1d48-49d5-bda0-0cb4f512347f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:14.294443 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c20c588-1d48-49d5-bda0-0cb4f512347f None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:14.294936 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c20c588-1d48-49d5-bda0-0cb4f512347f None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:14.295430 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c20c588-1d48-49d5-bda0-0cb4f512347f None admin] PATH_INFO: `/v3/projects` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:14.296768 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c20c588-1d48-49d5-bda0-0cb4f512347f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:14.297320 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c20c588-1d48-49d5-bda0-0cb4f512347f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:14.300403 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c20c588-1d48-49d5-bda0-0cb4f512347f None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:14.308544 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:14.338815 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 279/537] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Aug 31 00:07:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:07:14.352187 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c20c588-1d48-49d5-bda0-0cb4f512347f None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:14.402833 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e808826a-8c39-4d60-8845-1d4565bb4544 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:14.454168 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:14.470461 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c54928-acc4-465f-b06d-f49b9ab44443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:14.471834 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c54928-acc4-465f-b06d-f49b9ab44443 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:14.472551 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c54928-acc4-465f-b06d-f49b9ab44443 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:14.473265 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c54928-acc4-465f-b06d-f49b9ab44443 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:14.486374 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c54928-acc4-465f-b06d-f49b9ab44443 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:14.489598 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c54928-acc4-465f-b06d-f49b9ab44443 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:14.514442 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-30c54928-acc4-465f-b06d-f49b9ab44443 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:07:14.514442 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:14.514442 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:14.514442 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:14.514442 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:14.514442 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:14.514442 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:14.514442 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:14.514442 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:14.514442 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:14.514442 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:14.514442 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:14.514442 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 00:07:14.514442 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 00:07:14.514442 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 00:07:14.516131 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 00:07:14.516131 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:14.516131 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:14.516131 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:14.516131 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:14.516131 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:14.516131 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:14.516131 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:14.516131 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:14.516131 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:14.516131 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:14.516131 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:14.516131 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:14.516131 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:14.516131 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:14.516131 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:14.516131 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:14.518160 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 00:07:14.518160 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 00:07:14.518160 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:07:14.518160 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:07:14.518160 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:07:14.518160 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:07:14.518160 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:07:14.518160 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 31 00:07:14.522021 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 259/538] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 31 00:07:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 356 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:07:14.533632 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c54928-acc4-465f-b06d-f49b9ab44443 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:14.638014 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c20c588-1d48-49d5-bda0-0cb4f512347f None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:14.708367 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14048f6-fac7-46fd-9ea8-fbc9e0a469ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:14.709132 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14048f6-fac7-46fd-9ea8-fbc9e0a469ff None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:14.709769 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14048f6-fac7-46fd-9ea8-fbc9e0a469ff None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:14.710128 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14048f6-fac7-46fd-9ea8-fbc9e0a469ff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:14.711125 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14048f6-fac7-46fd-9ea8-fbc9e0a469ff None admin] RBAC: Adding query filter params (role.id=1e6d7ecde4b0415bb944f25eda475f9c, scope.project.id=1b647cccb30a427193fc62dbebe0c6f1, user.id=beecda6e9feb400288618745c784989f) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:14.711595 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14048f6-fac7-46fd-9ea8-fbc9e0a469ff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:14.715907 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14048f6-fac7-46fd-9ea8-fbc9e0a469ff None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:14.734704 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 280/539] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 31 00:07:14 2022] GET /identity/v3/role_assignments?user.id=beecda6e9feb400288618745c784989f&scope.project.id=1b647cccb30a427193fc62dbebe0c6f1&role.id=1e6d7ecde4b0415bb944f25eda475f9c => generated 259 bytes in 387 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:07:14.773466 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c54928-acc4-465f-b06d-f49b9ab44443 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:14.794796 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:14.836416 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb4a3bf-eab3-47e2-ba2c-3ce488dcc0e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:14.837464 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb4a3bf-eab3-47e2-ba2c-3ce488dcc0e0 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:14.837933 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb4a3bf-eab3-47e2-ba2c-3ce488dcc0e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:14.838430 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb4a3bf-eab3-47e2-ba2c-3ce488dcc0e0 None admin] PATH_INFO: `/v3/projects` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:14.839851 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb4a3bf-eab3-47e2-ba2c-3ce488dcc0e0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:14.840444 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb4a3bf-eab3-47e2-ba2c-3ce488dcc0e0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:14.843534 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb4a3bf-eab3-47e2-ba2c-3ce488dcc0e0 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:14.869778 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 260/540] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Aug 31 00:07:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:14.880399 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14048f6-fac7-46fd-9ea8-fbc9e0a469ff None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:14.910277 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4875356-b929-42ab-bc8a-7138b641a8a6 None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:14.910802 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4875356-b929-42ab-bc8a-7138b641a8a6 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:14.911277 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4875356-b929-42ab-bc8a-7138b641a8a6 None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:14.914563 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 261/541] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 00:07:14 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:07:14.923003 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5304f958-2df2-4eda-a2e3-3a8da90b0a10 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:14.923680 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5304f958-2df2-4eda-a2e3-3a8da90b0a10 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:14.924191 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5304f958-2df2-4eda-a2e3-3a8da90b0a10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:14.967319 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-5304f958-2df2-4eda-a2e3-3a8da90b0a10 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:07:14.969242 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-5304f958-2df2-4eda-a2e3-3a8da90b0a10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:07:15.025500 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:15.040329 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14048f6-fac7-46fd-9ea8-fbc9e0a469ff None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:15.118992 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4987d0ec-dff3-44ba-a7fc-7a2d8d2da9fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:15.124394 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4987d0ec-dff3-44ba-a7fc-7a2d8d2da9fe None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:15.125570 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4987d0ec-dff3-44ba-a7fc-7a2d8d2da9fe None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:15.127848 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4987d0ec-dff3-44ba-a7fc-7a2d8d2da9fe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:15.134524 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4987d0ec-dff3-44ba-a7fc-7a2d8d2da9fe None admin] RBAC: Adding query filter params (role.id=1e6d7ecde4b0415bb944f25eda475f9c, scope.project.id=1b647cccb30a427193fc62dbebe0c6f1, user.id=daae792cd11d4c4ca7aae0558998aced) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:15.135321 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4987d0ec-dff3-44ba-a7fc-7a2d8d2da9fe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:15.142444 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4987d0ec-dff3-44ba-a7fc-7a2d8d2da9fe None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:15.162704 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 281/542] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 31 00:07:14 2022] GET /identity/v3/role_assignments?user.id=daae792cd11d4c4ca7aae0558998aced&scope.project.id=1b647cccb30a427193fc62dbebe0c6f1&role.id=1e6d7ecde4b0415bb944f25eda475f9c => generated 259 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:15.182039 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 262/543] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 00:07:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:07:15.424535 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8baea3-0b70-403b-8fef-1099691ac9cd None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:15.425372 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8baea3-0b70-403b-8fef-1099691ac9cd None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:15.425620 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8baea3-0b70-403b-8fef-1099691ac9cd None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:15.427523 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 282/544] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 00:07:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:07:15.437599 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ab86e1-ecd4-4cbb-a4bf-25c457f3e70d None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:15.437891 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ab86e1-ecd4-4cbb-a4bf-25c457f3e70d None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:15.438217 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ab86e1-ecd4-4cbb-a4bf-25c457f3e70d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:15.466945 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-a6ab86e1-ecd4-4cbb-a4bf-25c457f3e70d None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:07:15.468220 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-a6ab86e1-ecd4-4cbb-a4bf-25c457f3e70d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:07:15.583965 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 263/545] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 00:07:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:07:15.750621 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8baea3-0b70-403b-8fef-1099691ac9cd None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:15.913105 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8baea3-0b70-403b-8fef-1099691ac9cd None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:15.963182 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845dde00-4787-4be8-ab4e-0cd3c2082e61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:15.963828 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845dde00-4787-4be8-ab4e-0cd3c2082e61 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:15.964174 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845dde00-4787-4be8-ab4e-0cd3c2082e61 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:15.964458 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845dde00-4787-4be8-ab4e-0cd3c2082e61 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:15.975826 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845dde00-4787-4be8-ab4e-0cd3c2082e61 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:07:15.980971 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-845dde00-4787-4be8-ab4e-0cd3c2082e61 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:07:15.980971 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:15.980971 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:15.980971 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:15.980971 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:15.980971 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:15.980971 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:15.980971 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:15.980971 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:15.980971 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:15.980971 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:15.980971 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:15.980971 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:07:15.980971 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:07:15.980971 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:07:15.980971 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:07:15.981948 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:07:15.981948 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:07:15.981948 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:07:15.981948 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:07:15.981948 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:15.981948 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:15.981948 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:15.981948 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:15.981948 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:15.981948 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:15.981948 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:15.981948 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:15.981948 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:15.981948 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:15.981948 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:15.981948 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:15.982758 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:15.982758 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:15.982758 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:15.982758 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:15.982758 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:07:15.982758 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:07:15.982758 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:07:15.982758 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:07:15.982758 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:07:15.982758 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:07:15.982758 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:07:15.982758 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Aug 31 00:07:15.982758 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 283/546] 10.222.0.47 () {56 vars in 1102 bytes} [Wed Aug 31 00:07:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:07:15.988192 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ab86e1-ecd4-4cbb-a4bf-25c457f3e70d None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:16.012677 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845dde00-4787-4be8-ab4e-0cd3c2082e61 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:16.033325 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:16.065901 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:16.133386 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845dde00-4787-4be8-ab4e-0cd3c2082e61 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:16.174604 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e95d20-075a-4303-9595-4afa6b4da4a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:16.175601 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e95d20-075a-4303-9595-4afa6b4da4a6 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:16.176086 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e95d20-075a-4303-9595-4afa6b4da4a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:16.176683 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e95d20-075a-4303-9595-4afa6b4da4a6 None admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:16.177557 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e95d20-075a-4303-9595-4afa6b4da4a6 None admin] RBAC: Adding query filter params (name=service) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:16.178094 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e95d20-075a-4303-9595-4afa6b4da4a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:16.179693 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e95d20-075a-4303-9595-4afa6b4da4a6 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:16.189101 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 284/547] 10.222.0.47 () {56 vars in 1103 bytes} [Wed Aug 31 00:07:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:07:16.198289 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e95d20-075a-4303-9595-4afa6b4da4a6 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:16.252979 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ab86e1-ecd4-4cbb-a4bf-25c457f3e70d None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:16.326775 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853dba15-495c-4c06-a1cf-74eaa9bfed9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:16.328653 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853dba15-495c-4c06-a1cf-74eaa9bfed9b None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:16.329914 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853dba15-495c-4c06-a1cf-74eaa9bfed9b None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:16.330500 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853dba15-495c-4c06-a1cf-74eaa9bfed9b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:16.351772 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853dba15-495c-4c06-a1cf-74eaa9bfed9b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:07:16.364699 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-853dba15-495c-4c06-a1cf-74eaa9bfed9b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:07:16.364699 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:16.364699 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:16.364699 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:16.364699 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:16.364699 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:16.364699 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:16.364699 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:16.364699 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:16.364699 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:16.364699 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:16.364699 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:16.364699 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:07:16.364699 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:07:16.364699 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:07:16.364699 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:07:16.365709 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:07:16.365709 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:07:16.365709 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:07:16.365709 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:07:16.365709 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:16.365709 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:16.365709 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:16.365709 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:16.365709 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:16.365709 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:16.365709 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:16.365709 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:16.365709 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:16.365709 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:16.365709 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:16.365709 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:16.366674 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:16.366674 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:16.366674 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:16.366674 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:16.366674 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:07:16.366674 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:07:16.366674 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:07:16.366674 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:07:16.366674 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:07:16.366674 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:07:16.366674 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:07:16.366674 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 31 00:07:16.372222 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 264/548] 10.222.0.47 () {56 vars in 1102 bytes} [Wed Aug 31 00:07:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 388 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:07:16.375055 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:16.377220 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853dba15-495c-4c06-a1cf-74eaa9bfed9b None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:16.430815 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e95d20-075a-4303-9595-4afa6b4da4a6 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:16.507883 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b09548-c566-4b50-9472-24e5e83e44cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:16.508565 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b09548-c566-4b50-9472-24e5e83e44cb None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:16.508843 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b09548-c566-4b50-9472-24e5e83e44cb None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:16.509118 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b09548-c566-4b50-9472-24e5e83e44cb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:16.536781 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b09548-c566-4b50-9472-24e5e83e44cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:16.538274 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b09548-c566-4b50-9472-24e5e83e44cb None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:16.568928 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-a1b09548-c566-4b50-9472-24e5e83e44cb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:07:16.568928 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:16.568928 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:16.568928 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:16.568928 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:16.568928 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:16.568928 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:16.568928 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:16.568928 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:16.568928 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:16.568928 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:16.568928 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:16.568928 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:07:16.568928 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:07:16.568928 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:07:16.568928 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:07:16.570112 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:16.570112 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:16.570112 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:16.570112 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:16.570112 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:16.570112 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:16.570112 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:16.570112 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:16.570112 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:16.570112 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:16.570112 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:16.570112 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:16.570112 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:16.570112 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:16.570112 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:16.570112 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:16.570112 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:07:16.571004 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:07:16.571004 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:07:16.571004 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Aug 31 00:07:16.572100 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 285/549] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 00:07:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 372 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:07:16.579642 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b09548-c566-4b50-9472-24e5e83e44cb None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:16.592045 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:16.606766 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853dba15-495c-4c06-a1cf-74eaa9bfed9b None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:16.675209 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724e56e0-a272-4e3a-9656-a0599de61343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:16.676263 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724e56e0-a272-4e3a-9656-a0599de61343 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:16.676761 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724e56e0-a272-4e3a-9656-a0599de61343 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:16.677252 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724e56e0-a272-4e3a-9656-a0599de61343 None admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:16.678441 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724e56e0-a272-4e3a-9656-a0599de61343 None admin] RBAC: Adding query filter params (name=service) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:16.679233 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724e56e0-a272-4e3a-9656-a0599de61343 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:16.682000 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724e56e0-a272-4e3a-9656-a0599de61343 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:16.706760 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 265/550] 10.222.0.47 () {56 vars in 1103 bytes} [Wed Aug 31 00:07:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:16.706760 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d7f7e5-b413-491b-b24b-0214ad0c263b None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:16.706760 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d7f7e5-b413-491b-b24b-0214ad0c263b None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:16.706760 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d7f7e5-b413-491b-b24b-0214ad0c263b None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:16.714451 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 266/551] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 00:07:16 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:07:16.716966 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b710f9f-c445-4f6b-841b-57483917f62e None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:16.717495 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b710f9f-c445-4f6b-841b-57483917f62e None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:16.717996 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b710f9f-c445-4f6b-841b-57483917f62e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:16.751344 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-6b710f9f-c445-4f6b-841b-57483917f62e None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:07:16.753430 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-6b710f9f-c445-4f6b-841b-57483917f62e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:07:16.777413 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b09548-c566-4b50-9472-24e5e83e44cb None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:16.814952 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:16.823078 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855dc93b-7c3b-47a5-813b-ecaf0b26827f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:16.824733 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855dc93b-7c3b-47a5-813b-ecaf0b26827f None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:16.825202 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855dc93b-7c3b-47a5-813b-ecaf0b26827f None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:16.825744 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855dc93b-7c3b-47a5-813b-ecaf0b26827f None admin] PATH_INFO: `/v3/domains` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:16.826612 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855dc93b-7c3b-47a5-813b-ecaf0b26827f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:16.827066 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855dc93b-7c3b-47a5-813b-ecaf0b26827f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:16.828821 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855dc93b-7c3b-47a5-813b-ecaf0b26827f None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:16.849451 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 286/552] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 31 00:07:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:16.851407 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855dc93b-7c3b-47a5-813b-ecaf0b26827f None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:16.897526 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 267/553] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 00:07:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:07:16.906192 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b710f9f-c445-4f6b-841b-57483917f62e None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:16.998550 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855dc93b-7c3b-47a5-813b-ecaf0b26827f None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:17.050902 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea3c5fb-eb38-4cbf-b7a7-e3f1f00d78c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:17.052373 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea3c5fb-eb38-4cbf-b7a7-e3f1f00d78c1 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:17.052800 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea3c5fb-eb38-4cbf-b7a7-e3f1f00d78c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:17.053224 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea3c5fb-eb38-4cbf-b7a7-e3f1f00d78c1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:17.064975 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea3c5fb-eb38-4cbf-b7a7-e3f1f00d78c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:17.066800 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea3c5fb-eb38-4cbf-b7a7-e3f1f00d78c1 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:17.085742 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-eea3c5fb-eb38-4cbf-b7a7-e3f1f00d78c1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:07:17.085742 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:17.085742 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:17.085742 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:17.085742 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:17.085742 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:17.085742 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:17.085742 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:17.085742 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:17.085742 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:17.085742 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:17.085742 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:17.085742 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:07:17.085742 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:07:17.085742 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:07:17.085742 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:07:17.086932 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:17.086932 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:17.086932 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:17.086932 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:17.086932 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:17.086932 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:17.086932 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:17.086932 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:17.086932 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:17.086932 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:17.086932 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:17.086932 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:17.086932 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:17.086932 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:17.086932 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:17.086932 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:17.086932 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:07:17.087877 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:07:17.087877 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:07:17.087877 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Aug 31 00:07:17.094831 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 287/554] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 00:07:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:07:17.096775 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea3c5fb-eb38-4cbf-b7a7-e3f1f00d78c1 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:17.172010 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:17.183435 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:17.212084 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b710f9f-c445-4f6b-841b-57483917f62e None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:17.281551 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f7e9ec-1562-4350-b44d-3adddc3d606e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:17.282634 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f7e9ec-1562-4350-b44d-3adddc3d606e None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:17.283131 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f7e9ec-1562-4350-b44d-3adddc3d606e None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:17.283711 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f7e9ec-1562-4350-b44d-3adddc3d606e None admin] PATH_INFO: `/v3/users/swift` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:17.297664 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea3c5fb-eb38-4cbf-b7a7-e3f1f00d78c1 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:17.298666 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f7e9ec-1562-4350-b44d-3adddc3d606e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:17.301788 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f7e9ec-1562-4350-b44d-3adddc3d606e None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:17.326718 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-05f7e9ec-1562-4350-b44d-3adddc3d606e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 31 00:07:17.326718 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:17.326718 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:17.326718 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:17.326718 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:17.326718 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:17.326718 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:17.326718 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:17.326718 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:17.326718 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:17.326718 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:17.326718 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:17.326718 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 00:07:17.326718 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 00:07:17.326718 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 00:07:17.326718 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 00:07:17.328624 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:17.328624 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:17.328624 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:07:17.328624 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:07:17.328624 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:07:17.328624 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:07:17.328624 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:17.328624 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:17.328624 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:17.328624 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:17.328624 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:17.328624 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:17.328624 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:17.328624 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:17.328624 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:17.328624 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:17.328624 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:17.328624 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:17.330273 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:17.330273 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:17.330273 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 00:07:17.330273 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 00:07:17.330273 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 00:07:17.330273 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 00:07:17.330273 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 00:07:17.330273 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 00:07:17.330273 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 31 00:07:17.330273 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 31 00:07:17.330273 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 268/555] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Aug 31 00:07:16 2022] GET /identity/v3/users/swift => generated 83 bytes in 424 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:07:17.339921 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f66c09-006c-482a-8a71-5e866f96ad79 None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:17.340838 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f66c09-006c-482a-8a71-5e866f96ad79 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:17.341268 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f66c09-006c-482a-8a71-5e866f96ad79 None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:17.344456 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 269/556] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 00:07:17 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:07:17.346270 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f66c09-006c-482a-8a71-5e866f96ad79 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:17.346657 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc9e5e9-809f-4e31-afdd-eb4158140194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:17.347562 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc9e5e9-809f-4e31-afdd-eb4158140194 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:17.348120 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc9e5e9-809f-4e31-afdd-eb4158140194 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:17.348620 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc9e5e9-809f-4e31-afdd-eb4158140194 None admin] PATH_INFO: `/v3/domains` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:17.349507 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc9e5e9-809f-4e31-afdd-eb4158140194 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:17.350055 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc9e5e9-809f-4e31-afdd-eb4158140194 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:17.351693 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc9e5e9-809f-4e31-afdd-eb4158140194 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:17.368172 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 288/557] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 31 00:07:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:07:17.372490 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f43f67-2697-4c92-b64d-d188e2fbe84c None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:17.372998 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f43f67-2697-4c92-b64d-d188e2fbe84c None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:17.373440 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f43f67-2697-4c92-b64d-d188e2fbe84c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:17.411592 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-74f43f67-2697-4c92-b64d-d188e2fbe84c None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:07:17.414539 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-74f43f67-2697-4c92-b64d-d188e2fbe84c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:07:17.520491 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 289/558] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 00:07:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:07:17.522837 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f43f67-2697-4c92-b64d-d188e2fbe84c None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:17.531065 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f66c09-006c-482a-8a71-5e866f96ad79 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:17.569087 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:17.607267 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0512d01d-76b9-40fe-b04c-6de64c5bbc52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:17.608533 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0512d01d-76b9-40fe-b04c-6de64c5bbc52 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:17.609217 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0512d01d-76b9-40fe-b04c-6de64c5bbc52 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:17.609691 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0512d01d-76b9-40fe-b04c-6de64c5bbc52 None admin] PATH_INFO: `/v3/users` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:17.611228 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0512d01d-76b9-40fe-b04c-6de64c5bbc52 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:17.611772 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0512d01d-76b9-40fe-b04c-6de64c5bbc52 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:17.614710 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0512d01d-76b9-40fe-b04c-6de64c5bbc52 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:17.647250 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 270/559] 10.222.0.47 () {56 vars in 1135 bytes} [Wed Aug 31 00:07:17 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:17.653869 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0512d01d-76b9-40fe-b04c-6de64c5bbc52 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:17.657538 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:17.670311 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f43f67-2697-4c92-b64d-d188e2fbe84c None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:17.722314 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d2f64b-3dee-4531-ac01-6bebc59e8bb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:17.723120 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d2f64b-3dee-4531-ac01-6bebc59e8bb3 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:17.723597 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d2f64b-3dee-4531-ac01-6bebc59e8bb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:17.723893 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d2f64b-3dee-4531-ac01-6bebc59e8bb3 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:17.735297 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d2f64b-3dee-4531-ac01-6bebc59e8bb3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:17.737982 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d2f64b-3dee-4531-ac01-6bebc59e8bb3 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:17.763592 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-e5d2f64b-3dee-4531-ac01-6bebc59e8bb3 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 31 00:07:17.763592 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:17.763592 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:17.763592 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:17.763592 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:17.763592 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:17.763592 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:17.763592 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:17.763592 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:17.763592 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:17.763592 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:17.763592 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:17.763592 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 00:07:17.763592 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 00:07:17.763592 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 00:07:17.763592 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 00:07:17.764838 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:17.764838 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:17.764838 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:07:17.764838 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:07:17.764838 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:07:17.764838 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:07:17.764838 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:17.764838 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:17.764838 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:17.764838 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:17.764838 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:17.764838 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:17.764838 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:17.764838 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:17.764838 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:17.764838 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:17.764838 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:17.764838 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:17.771145 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:17.771145 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:17.771145 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 00:07:17.771145 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 00:07:17.771145 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 00:07:17.771145 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 00:07:17.771145 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 00:07:17.771145 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 00:07:17.771145 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 31 00:07:17.771145 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Aug 31 00:07:17.771145 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 290/560] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 31 00:07:17 2022] GET /identity/v3/users/glance => generated 84 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:07:17.771145 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27545982-dc37-4942-bd5d-dccd4f420488 None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:17.771145 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27545982-dc37-4942-bd5d-dccd4f420488 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:17.771907 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27545982-dc37-4942-bd5d-dccd4f420488 None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:17.772337 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 291/561] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 00:07:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:07:17.773784 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27545982-dc37-4942-bd5d-dccd4f420488 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:17.798174 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0512d01d-76b9-40fe-b04c-6de64c5bbc52 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:17.852864 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bca1da-60b3-4247-bcc2-3fc9b089d5f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:17.853591 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bca1da-60b3-4247-bcc2-3fc9b089d5f7 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:17.853934 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bca1da-60b3-4247-bcc2-3fc9b089d5f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:17.854269 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bca1da-60b3-4247-bcc2-3fc9b089d5f7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:17.866732 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bca1da-60b3-4247-bcc2-3fc9b089d5f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:07:17.872370 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-a2bca1da-60b3-4247-bcc2-3fc9b089d5f7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:07:17.872370 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:17.872370 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:17.872370 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:17.872370 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:17.872370 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:17.872370 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:17.872370 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:17.872370 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:17.872370 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:17.872370 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:17.872370 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:17.872370 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:07:17.872370 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:07:17.872370 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:07:17.872370 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:07:17.874209 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:07:17.874209 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:07:17.874209 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:07:17.874209 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:07:17.874209 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:17.874209 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:17.874209 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:17.874209 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:17.874209 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:17.874209 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:17.874209 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:17.874209 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:17.874209 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:17.874209 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:17.874209 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:17.874209 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:17.875796 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:17.875796 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:17.875796 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:17.875796 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:17.875796 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:07:17.875796 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:07:17.875796 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:07:17.875796 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:07:17.875796 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:07:17.875796 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:07:17.875796 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:07:17.875796 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 31 00:07:17.875796 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 271/562] 10.222.0.47 () {56 vars in 1102 bytes} [Wed Aug 31 00:07:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:07:17.875796 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bca1da-60b3-4247-bcc2-3fc9b089d5f7 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:17.926493 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:17.943083 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27545982-dc37-4942-bd5d-dccd4f420488 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:17.959324 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:17.999162 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd82848e-6b64-4b34-ae13-e50db06a690f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:18.000130 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd82848e-6b64-4b34-ae13-e50db06a690f None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:18.000636 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd82848e-6b64-4b34-ae13-e50db06a690f None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:18.001105 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd82848e-6b64-4b34-ae13-e50db06a690f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:18.026651 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bca1da-60b3-4247-bcc2-3fc9b089d5f7 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:18.071272 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7da105-e14e-4944-a7c6-e8d198ac2b83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:18.071898 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7da105-e14e-4944-a7c6-e8d198ac2b83 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:18.072244 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7da105-e14e-4944-a7c6-e8d198ac2b83 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:18.072520 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7da105-e14e-4944-a7c6-e8d198ac2b83 None admin] PATH_INFO: `/v3/users` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:18.074482 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7da105-e14e-4944-a7c6-e8d198ac2b83 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:18.075029 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7da105-e14e-4944-a7c6-e8d198ac2b83 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:18.077580 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7da105-e14e-4944-a7c6-e8d198ac2b83 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:18.083353 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd82848e-6b64-4b34-ae13-e50db06a690f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:18.084873 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd82848e-6b64-4b34-ae13-e50db06a690f None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:18.099044 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 272/563] 10.222.0.47 () {56 vars in 1137 bytes} [Wed Aug 31 00:07:17 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:18.100138 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d6c186-a2af-4d05-8f36-447b2b92030c None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:18.100479 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d6c186-a2af-4d05-8f36-447b2b92030c None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:18.100757 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d6c186-a2af-4d05-8f36-447b2b92030c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:18.119568 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-98d6c186-a2af-4d05-8f36-447b2b92030c None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:07:18.121386 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-98d6c186-a2af-4d05-8f36-447b2b92030c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:07:18.193652 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:18.210052 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 273/564] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 00:07:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:07:18.211244 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d6c186-a2af-4d05-8f36-447b2b92030c None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:18.211749 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 292/565] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 31 00:07:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 00:07:18.213307 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd82848e-6b64-4b34-ae13-e50db06a690f None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:18.290458 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:18.379489 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d6c186-a2af-4d05-8f36-447b2b92030c None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:18.410910 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd82848e-6b64-4b34-ae13-e50db06a690f None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:18.434573 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7b4234-6ac9-4892-a39b-beca23c84b25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:18.435225 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7b4234-6ac9-4892-a39b-beca23c84b25 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:18.435496 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7b4234-6ac9-4892-a39b-beca23c84b25 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:18.435766 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7b4234-6ac9-4892-a39b-beca23c84b25 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:18.449722 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7b4234-6ac9-4892-a39b-beca23c84b25 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:07:18.454972 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-5e7b4234-6ac9-4892-a39b-beca23c84b25 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:07:18.454972 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:18.454972 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:18.454972 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:18.454972 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:18.454972 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:18.454972 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:18.454972 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:18.454972 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:18.454972 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:18.454972 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:18.454972 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:18.454972 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:07:18.454972 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:07:18.454972 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:07:18.454972 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:07:18.456485 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:07:18.456485 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:07:18.456485 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:07:18.456485 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:07:18.456485 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:18.456485 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:18.456485 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:18.456485 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:18.456485 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:18.456485 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:18.456485 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:18.456485 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:18.456485 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:18.456485 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:18.456485 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:18.456485 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:18.457485 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:18.457485 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:18.457485 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:18.457485 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:18.457485 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:07:18.457485 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:07:18.457485 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:07:18.457485 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:07:18.457485 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:07:18.457485 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:07:18.457485 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:07:18.457485 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 31 00:07:18.457485 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 274/566] 10.222.0.47 () {56 vars in 1102 bytes} [Wed Aug 31 00:07:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:07:18.457485 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7b4234-6ac9-4892-a39b-beca23c84b25 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:18.477734 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050d8246-94a9-4bc9-95fa-6a4bedec8990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:18.478761 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050d8246-94a9-4bc9-95fa-6a4bedec8990 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:18.479229 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050d8246-94a9-4bc9-95fa-6a4bedec8990 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:18.480316 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050d8246-94a9-4bc9-95fa-6a4bedec8990 None admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:18.481238 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050d8246-94a9-4bc9-95fa-6a4bedec8990 None admin] RBAC: Adding query filter params (name=service) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:18.481541 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050d8246-94a9-4bc9-95fa-6a4bedec8990 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:18.483846 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050d8246-94a9-4bc9-95fa-6a4bedec8990 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:18.503742 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 293/567] 10.222.0.47 () {56 vars in 1103 bytes} [Wed Aug 31 00:07:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:18.503742 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050d8246-94a9-4bc9-95fa-6a4bedec8990 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:18.600213 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:18.614395 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7b4234-6ac9-4892-a39b-beca23c84b25 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:18.637032 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:18.650833 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050d8246-94a9-4bc9-95fa-6a4bedec8990 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:18.671735 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e15d49b-278f-49e5-a41b-ee7ba126744b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:18.672421 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e15d49b-278f-49e5-a41b-ee7ba126744b None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:18.672699 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e15d49b-278f-49e5-a41b-ee7ba126744b None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:18.672972 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e15d49b-278f-49e5-a41b-ee7ba126744b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:18.686367 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e15d49b-278f-49e5-a41b-ee7ba126744b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:18.687930 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e15d49b-278f-49e5-a41b-ee7ba126744b None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:18.691485 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f9d22d-88c0-4bb1-95e8-b0f7566ba00a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:18.692127 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f9d22d-88c0-4bb1-95e8-b0f7566ba00a None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:18.692440 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f9d22d-88c0-4bb1-95e8-b0f7566ba00a None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:18.692715 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f9d22d-88c0-4bb1-95e8-b0f7566ba00a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:18.706116 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f9d22d-88c0-4bb1-95e8-b0f7566ba00a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:18.707608 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f9d22d-88c0-4bb1-95e8-b0f7566ba00a None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:18.708547 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-6e15d49b-278f-49e5-a41b-ee7ba126744b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:07:18.708547 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:18.708547 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:18.708547 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:18.708547 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:18.708547 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:18.708547 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:18.708547 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:18.708547 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:18.708547 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:18.708547 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:18.708547 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:18.708547 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:07:18.708547 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:07:18.708547 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:07:18.708547 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:07:18.710489 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:18.710489 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:18.710489 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:18.710489 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:18.710489 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:18.710489 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:18.710489 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:18.710489 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:18.710489 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:18.710489 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:18.710489 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:18.710489 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:18.710489 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:18.710489 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:18.710489 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:18.710489 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:18.710489 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:07:18.712725 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:07:18.712725 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:07:18.712725 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 31 00:07:18.716430 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 275/568] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 00:07:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:07:18.717741 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e15d49b-278f-49e5-a41b-ee7ba126744b None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:18.731492 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-b4f9d22d-88c0-4bb1-95e8-b0f7566ba00a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:07:18.731492 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:18.731492 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:18.731492 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:18.731492 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:18.731492 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:18.731492 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:18.731492 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:18.731492 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:18.731492 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:18.731492 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:18.731492 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:18.731492 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:07:18.731492 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:07:18.731492 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:07:18.731492 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:07:18.732679 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:18.732679 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:18.732679 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:18.732679 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:18.732679 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:18.732679 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:18.732679 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:18.732679 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:18.732679 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:18.732679 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:18.732679 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:18.732679 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:18.732679 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:18.732679 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:18.732679 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:18.732679 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:18.732679 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:07:18.733924 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:07:18.733924 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:07:18.733924 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Aug 31 00:07:18.733924 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 294/569] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 00:07:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:07:18.734984 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f9d22d-88c0-4bb1-95e8-b0f7566ba00a None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:18.864762 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f9d22d-88c0-4bb1-95e8-b0f7566ba00a None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:18.875991 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:18.907493 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dc67a9-d7bc-4a73-b13e-815890e38ef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:18.908333 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dc67a9-d7bc-4a73-b13e-815890e38ef6 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:18.908496 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dc67a9-d7bc-4a73-b13e-815890e38ef6 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:18.908767 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dc67a9-d7bc-4a73-b13e-815890e38ef6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:18.910505 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e15d49b-278f-49e5-a41b-ee7ba126744b None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:18.920582 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dc67a9-d7bc-4a73-b13e-815890e38ef6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:18.922045 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dc67a9-d7bc-4a73-b13e-815890e38ef6 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:18.937887 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-63dc67a9-d7bc-4a73-b13e-815890e38ef6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:07:18.937887 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:18.937887 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:18.937887 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:18.937887 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:18.937887 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:18.937887 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:18.937887 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:18.937887 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:18.937887 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:18.937887 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:18.937887 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:18.937887 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:07:18.937887 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:07:18.937887 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:07:18.937887 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:07:18.939582 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:18.939582 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:18.939582 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:18.939582 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:18.939582 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:18.939582 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:18.939582 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:18.939582 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:18.939582 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:18.939582 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:18.939582 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:18.939582 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:18.939582 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:18.939582 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:18.939582 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:18.939582 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:18.939582 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:07:18.940526 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:07:18.940526 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:07:18.940526 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Aug 31 00:07:18.940526 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 295/570] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 00:07:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:07:18.940526 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dc67a9-d7bc-4a73-b13e-815890e38ef6 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:18.960304 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e9c811-fac5-4452-b006-537ecd0299e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:18.960962 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e9c811-fac5-4452-b006-537ecd0299e3 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:18.961235 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e9c811-fac5-4452-b006-537ecd0299e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:18.961504 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e9c811-fac5-4452-b006-537ecd0299e3 None admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:18.962169 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e9c811-fac5-4452-b006-537ecd0299e3 None admin] RBAC: Adding query filter params (name=service) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:18.962464 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e9c811-fac5-4452-b006-537ecd0299e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:18.963840 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e9c811-fac5-4452-b006-537ecd0299e3 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:18.973877 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 276/571] 10.222.0.47 () {56 vars in 1103 bytes} [Wed Aug 31 00:07:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:18.974730 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e9c811-fac5-4452-b006-537ecd0299e3 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:19.006006 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:19.062047 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dc67a9-d7bc-4a73-b13e-815890e38ef6 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:19.098575 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e23649-e527-4bf9-ab93-fc2186e47c11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:19.099637 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e23649-e527-4bf9-ab93-fc2186e47c11 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:19.099637 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e23649-e527-4bf9-ab93-fc2186e47c11 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:19.099939 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e23649-e527-4bf9-ab93-fc2186e47c11 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:19.103309 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e9c811-fac5-4452-b006-537ecd0299e3 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:19.111190 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e23649-e527-4bf9-ab93-fc2186e47c11 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:07:19.116645 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-d2e23649-e527-4bf9-ab93-fc2186e47c11 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:07:19.116645 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:19.116645 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:19.116645 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:19.116645 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:19.116645 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:19.116645 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:19.116645 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:19.116645 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:19.116645 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:19.116645 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:19.116645 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:19.116645 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:07:19.116645 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:07:19.116645 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:07:19.116645 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:07:19.117718 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:07:19.117718 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:07:19.117718 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:07:19.117718 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:07:19.117718 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:19.117718 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:19.117718 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:19.117718 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:19.117718 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:19.117718 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:19.117718 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:19.117718 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:19.117718 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:19.117718 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:19.117718 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:19.117718 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:19.118586 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:19.118586 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:19.118586 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:19.118586 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:19.118586 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:07:19.118586 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:07:19.118586 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:07:19.118586 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:07:19.118586 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:07:19.118586 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:07:19.118586 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:07:19.118586 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Aug 31 00:07:19.118586 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 296/572] 10.222.0.47 () {56 vars in 1102 bytes} [Wed Aug 31 00:07:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:07:19.119282 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e23649-e527-4bf9-ab93-fc2186e47c11 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:19.144861 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:19.147681 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac84397-7b34-4dc0-9be2-2f5d29b045e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:19.149772 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac84397-7b34-4dc0-9be2-2f5d29b045e5 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:19.150049 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac84397-7b34-4dc0-9be2-2f5d29b045e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:19.150317 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac84397-7b34-4dc0-9be2-2f5d29b045e5 None admin] PATH_INFO: `/v3/domains` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:19.151441 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac84397-7b34-4dc0-9be2-2f5d29b045e5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:19.152062 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac84397-7b34-4dc0-9be2-2f5d29b045e5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:19.154311 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac84397-7b34-4dc0-9be2-2f5d29b045e5 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:19.168345 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 277/573] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 31 00:07:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:19.169640 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac84397-7b34-4dc0-9be2-2f5d29b045e5 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:19.246074 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e23649-e527-4bf9-ab93-fc2186e47c11 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:19.284692 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac10e8b9-421e-4cd6-86ea-6a23b4d3b0c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:19.285309 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac10e8b9-421e-4cd6-86ea-6a23b4d3b0c0 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:19.285588 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac10e8b9-421e-4cd6-86ea-6a23b4d3b0c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:19.285860 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac10e8b9-421e-4cd6-86ea-6a23b4d3b0c0 None admin] PATH_INFO: `/v3/domains` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:19.286524 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac10e8b9-421e-4cd6-86ea-6a23b4d3b0c0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:19.286829 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac10e8b9-421e-4cd6-86ea-6a23b4d3b0c0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:19.288242 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac10e8b9-421e-4cd6-86ea-6a23b4d3b0c0 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:19.294813 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:19.302360 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 297/574] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 31 00:07:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:19.303646 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac10e8b9-421e-4cd6-86ea-6a23b4d3b0c0 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:19.326533 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac84397-7b34-4dc0-9be2-2f5d29b045e5 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:19.376733 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4689588-87a7-4eee-9f78-1acee560bedd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:19.377838 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4689588-87a7-4eee-9f78-1acee560bedd None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:19.377838 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4689588-87a7-4eee-9f78-1acee560bedd None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:19.377838 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4689588-87a7-4eee-9f78-1acee560bedd None admin] PATH_INFO: `/v3/domains` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:19.378442 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4689588-87a7-4eee-9f78-1acee560bedd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:19.378751 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4689588-87a7-4eee-9f78-1acee560bedd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:19.380145 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4689588-87a7-4eee-9f78-1acee560bedd None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:19.393755 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 278/575] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 31 00:07:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:19.394656 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4689588-87a7-4eee-9f78-1acee560bedd None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:19.426608 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:19.460619 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac10e8b9-421e-4cd6-86ea-6a23b4d3b0c0 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:19.499091 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8291694-031f-4d6a-8adc-a51323923172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:19.499725 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8291694-031f-4d6a-8adc-a51323923172 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:19.499996 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8291694-031f-4d6a-8adc-a51323923172 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:19.500297 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8291694-031f-4d6a-8adc-a51323923172 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:19.510778 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8291694-031f-4d6a-8adc-a51323923172 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:19.514609 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8291694-031f-4d6a-8adc-a51323923172 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:19.529499 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4689588-87a7-4eee-9f78-1acee560bedd None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:19.530479 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-c8291694-031f-4d6a-8adc-a51323923172 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:07:19.530479 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:19.530479 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:19.530479 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:19.530479 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:19.530479 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:19.530479 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:19.530479 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:19.530479 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:19.530479 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:19.530479 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:19.530479 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:19.530479 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:07:19.530479 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:07:19.530479 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:07:19.530479 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:07:19.531662 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:19.531662 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:19.531662 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:19.531662 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:19.531662 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:19.531662 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:19.531662 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:19.531662 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:19.531662 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:19.531662 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:19.531662 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:19.531662 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:19.531662 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:19.531662 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:19.531662 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:19.531662 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:19.531662 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:07:19.532790 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:07:19.532790 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:07:19.532790 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Aug 31 00:07:19.532790 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 298/576] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 00:07:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:07:19.532790 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8291694-031f-4d6a-8adc-a51323923172 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:19.576938 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5598d71c-8249-4ee7-8354-46d14c9139cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:19.577560 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5598d71c-8249-4ee7-8354-46d14c9139cb None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:19.577906 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5598d71c-8249-4ee7-8354-46d14c9139cb None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:19.578220 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5598d71c-8249-4ee7-8354-46d14c9139cb None admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:19.578851 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5598d71c-8249-4ee7-8354-46d14c9139cb None admin] RBAC: Adding query filter params (name=service) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:19.579161 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5598d71c-8249-4ee7-8354-46d14c9139cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:19.580628 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5598d71c-8249-4ee7-8354-46d14c9139cb None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:19.590915 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 279/577] 10.222.0.47 () {56 vars in 1103 bytes} [Wed Aug 31 00:07:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:19.592267 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5598d71c-8249-4ee7-8354-46d14c9139cb None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:19.602524 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:19.668126 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8291694-031f-4d6a-8adc-a51323923172 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:19.705162 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:19.712841 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5ba389-5f86-483f-9d34-e7e5994f8e4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:19.713499 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5ba389-5f86-483f-9d34-e7e5994f8e4c None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:19.713780 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5ba389-5f86-483f-9d34-e7e5994f8e4c None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:19.714639 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5ba389-5f86-483f-9d34-e7e5994f8e4c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:19.720245 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5598d71c-8249-4ee7-8354-46d14c9139cb None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:19.722529 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5ba389-5f86-483f-9d34-e7e5994f8e4c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:19.724053 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5ba389-5f86-483f-9d34-e7e5994f8e4c None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:19.737407 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-fd5ba389-5f86-483f-9d34-e7e5994f8e4c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:07:19.737407 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:19.737407 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:19.737407 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:19.737407 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:19.737407 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:19.737407 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:19.737407 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:19.737407 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:19.737407 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:19.737407 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:19.737407 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:19.737407 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 00:07:19.737407 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 00:07:19.737407 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 00:07:19.739084 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 00:07:19.739084 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:19.739084 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:19.739084 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:19.739084 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:19.739084 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:19.739084 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:19.739084 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:19.739084 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:19.739084 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:19.739084 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:19.739084 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:19.739084 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:19.739084 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:19.739084 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:19.739084 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:19.739084 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:19.740576 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 00:07:19.740576 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 00:07:19.740576 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:07:19.740576 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:07:19.740576 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:07:19.740576 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:07:19.740576 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:07:19.740576 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Aug 31 00:07:19.740576 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 299/578] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 31 00:07:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:07:19.740576 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5ba389-5f86-483f-9d34-e7e5994f8e4c None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:19.775895 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d975c58-698d-4d28-8b86-0d499ae8ca0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:19.776846 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d975c58-698d-4d28-8b86-0d499ae8ca0e None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:19.777048 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d975c58-698d-4d28-8b86-0d499ae8ca0e None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:19.777273 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d975c58-698d-4d28-8b86-0d499ae8ca0e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:19.786339 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d975c58-698d-4d28-8b86-0d499ae8ca0e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:19.787855 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d975c58-698d-4d28-8b86-0d499ae8ca0e None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:19.809646 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-2d975c58-698d-4d28-8b86-0d499ae8ca0e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:07:19.809646 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:19.809646 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:19.809646 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:19.809646 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:19.809646 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:19.809646 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:19.809646 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:19.809646 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:19.809646 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:19.809646 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:19.809646 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:19.809646 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 00:07:19.809646 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 00:07:19.809646 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 00:07:19.810869 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 00:07:19.810869 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:19.810869 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:19.810869 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:19.810869 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:19.810869 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:19.810869 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:19.810869 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:19.810869 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:19.810869 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:19.810869 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:19.810869 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:19.810869 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:19.810869 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:19.810869 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:19.810869 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:19.810869 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:19.811823 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 00:07:19.811823 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 00:07:19.811823 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:07:19.811823 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:07:19.811823 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:07:19.811823 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:07:19.811823 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:07:19.811823 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 31 00:07:19.811823 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 280/579] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 31 00:07:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:07:19.812473 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d975c58-698d-4d28-8b86-0d499ae8ca0e None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:19.862506 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5ba389-5f86-483f-9d34-e7e5994f8e4c None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:19.902617 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1725995-ba35-4c86-8bd2-15b63c10af2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:19.903002 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1725995-ba35-4c86-8bd2-15b63c10af2f None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:19.903285 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1725995-ba35-4c86-8bd2-15b63c10af2f None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:19.903563 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1725995-ba35-4c86-8bd2-15b63c10af2f None admin] PATH_INFO: `/v3/users/nova` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:19.905812 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:19.912131 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1725995-ba35-4c86-8bd2-15b63c10af2f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:19.913620 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1725995-ba35-4c86-8bd2-15b63c10af2f None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:19.925852 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-d1725995-ba35-4c86-8bd2-15b63c10af2f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 31 00:07:19.925852 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:19.925852 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:19.925852 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:19.925852 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:19.925852 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:19.925852 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:19.925852 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:19.925852 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:19.925852 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:19.925852 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:19.925852 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:19.925852 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 00:07:19.925852 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 00:07:19.925852 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 00:07:19.925852 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 00:07:19.926941 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:19.926941 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:19.926941 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:07:19.926941 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:07:19.926941 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:07:19.926941 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:07:19.926941 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:19.926941 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:19.926941 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:19.926941 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:19.926941 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:19.926941 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:19.926941 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:19.926941 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:19.926941 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:19.926941 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:19.926941 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:19.926941 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:19.928859 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:19.928859 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:19.928859 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 00:07:19.928859 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 00:07:19.928859 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 00:07:19.928859 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 00:07:19.928859 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 00:07:19.928859 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 00:07:19.928859 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 31 00:07:19.928859 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Aug 31 00:07:19.928859 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 300/580] 10.222.0.47 () {56 vars in 1093 bytes} [Wed Aug 31 00:07:19 2022] GET /identity/v3/users/nova => generated 82 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:07:19.928859 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1725995-ba35-4c86-8bd2-15b63c10af2f None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:19.969400 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d975c58-698d-4d28-8b86-0d499ae8ca0e None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:20.001632 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:20.021485 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630abea0-8765-4d71-8b05-e0e790b1c10a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:20.022446 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630abea0-8765-4d71-8b05-e0e790b1c10a None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:20.022905 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630abea0-8765-4d71-8b05-e0e790b1c10a None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:20.023352 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630abea0-8765-4d71-8b05-e0e790b1c10a None admin] PATH_INFO: `/v3/domains` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:20.024479 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630abea0-8765-4d71-8b05-e0e790b1c10a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:20.024987 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630abea0-8765-4d71-8b05-e0e790b1c10a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:20.027236 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630abea0-8765-4d71-8b05-e0e790b1c10a None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:20.048766 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 281/581] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 31 00:07:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:20.049648 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630abea0-8765-4d71-8b05-e0e790b1c10a None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:20.076753 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1725995-ba35-4c86-8bd2-15b63c10af2f None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:20.116632 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dccf584-12d2-40c5-9b3d-beee88ea1778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:20.117869 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dccf584-12d2-40c5-9b3d-beee88ea1778 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:20.117869 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dccf584-12d2-40c5-9b3d-beee88ea1778 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:20.117869 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dccf584-12d2-40c5-9b3d-beee88ea1778 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:20.132065 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dccf584-12d2-40c5-9b3d-beee88ea1778 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:20.133591 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dccf584-12d2-40c5-9b3d-beee88ea1778 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:20.148982 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-8dccf584-12d2-40c5-9b3d-beee88ea1778 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:07:20.148982 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:20.148982 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:20.148982 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:20.148982 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:20.148982 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:20.148982 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:20.148982 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:20.148982 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:20.148982 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:20.148982 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:20.148982 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:20.148982 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:07:20.148982 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:07:20.148982 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:07:20.148982 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:07:20.150990 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:20.150990 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:20.150990 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:20.150990 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:20.150990 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:20.150990 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:20.150990 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:20.150990 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:20.150990 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:20.150990 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:20.150990 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:20.150990 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:20.150990 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:20.150990 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:20.150990 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:20.150990 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:20.150990 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:07:20.152618 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:07:20.152618 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:07:20.152618 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Aug 31 00:07:20.152618 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 301/582] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 00:07:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:07:20.152618 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dccf584-12d2-40c5-9b3d-beee88ea1778 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:20.177453 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630abea0-8765-4d71-8b05-e0e790b1c10a None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:20.209905 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:20.225109 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1e084f-194c-4a2c-8ea6-8de767656553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:20.225730 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1e084f-194c-4a2c-8ea6-8de767656553 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:20.226009 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1e084f-194c-4a2c-8ea6-8de767656553 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:20.226276 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1e084f-194c-4a2c-8ea6-8de767656553 None admin] PATH_INFO: `/v3/projects` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:20.226984 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1e084f-194c-4a2c-8ea6-8de767656553 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:20.227289 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1e084f-194c-4a2c-8ea6-8de767656553 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:20.230672 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1e084f-194c-4a2c-8ea6-8de767656553 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:20.243873 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 282/583] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Aug 31 00:07:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:20.244764 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1e084f-194c-4a2c-8ea6-8de767656553 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:20.282108 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dccf584-12d2-40c5-9b3d-beee88ea1778 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:20.283833 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:20.320770 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cf61b4-b92c-4663-afd5-8c4a10330b15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:20.321393 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cf61b4-b92c-4663-afd5-8c4a10330b15 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:20.321677 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cf61b4-b92c-4663-afd5-8c4a10330b15 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:20.321954 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cf61b4-b92c-4663-afd5-8c4a10330b15 None admin] PATH_INFO: `/v3/projects` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:20.322663 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cf61b4-b92c-4663-afd5-8c4a10330b15 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:20.322973 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cf61b4-b92c-4663-afd5-8c4a10330b15 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:20.325084 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cf61b4-b92c-4663-afd5-8c4a10330b15 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:20.341077 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 302/584] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Aug 31 00:07:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:20.341955 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cf61b4-b92c-4663-afd5-8c4a10330b15 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:20.376905 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1e084f-194c-4a2c-8ea6-8de767656553 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:20.422755 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826f0f8b-941d-4952-b35c-5433c4917af4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:20.423696 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826f0f8b-941d-4952-b35c-5433c4917af4 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:20.424145 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826f0f8b-941d-4952-b35c-5433c4917af4 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:20.424621 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826f0f8b-941d-4952-b35c-5433c4917af4 None admin] PATH_INFO: `/v3/users` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:20.425847 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826f0f8b-941d-4952-b35c-5433c4917af4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:20.426329 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826f0f8b-941d-4952-b35c-5433c4917af4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:20.428681 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826f0f8b-941d-4952-b35c-5433c4917af4 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:20.451051 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 283/585] 10.222.0.47 () {56 vars in 1133 bytes} [Wed Aug 31 00:07:20 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:20.451933 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826f0f8b-941d-4952-b35c-5433c4917af4 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:20.476609 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cf61b4-b92c-4663-afd5-8c4a10330b15 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:20.514376 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f41cae-79c0-42ce-8dc7-7de55b2e23cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:20.515014 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f41cae-79c0-42ce-8dc7-7de55b2e23cc None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:20.515296 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f41cae-79c0-42ce-8dc7-7de55b2e23cc None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:20.515600 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f41cae-79c0-42ce-8dc7-7de55b2e23cc None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:20.523310 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f41cae-79c0-42ce-8dc7-7de55b2e23cc None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:20.524801 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f41cae-79c0-42ce-8dc7-7de55b2e23cc None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:20.532490 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:20.544719 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-40f41cae-79c0-42ce-8dc7-7de55b2e23cc None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 31 00:07:20.544719 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:20.544719 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:20.544719 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:20.544719 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:20.544719 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:20.544719 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:20.544719 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:20.544719 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:20.544719 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:20.544719 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:20.544719 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:20.544719 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 00:07:20.544719 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 00:07:20.544719 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 00:07:20.544719 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 00:07:20.551899 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:20.551899 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:20.551899 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:07:20.551899 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:07:20.551899 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:07:20.551899 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:07:20.551899 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:20.551899 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:20.551899 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:20.551899 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:20.551899 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:20.551899 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:20.551899 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:20.551899 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:20.551899 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:20.551899 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:20.551899 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:20.551899 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:20.553179 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:20.553179 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:20.553179 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 00:07:20.553179 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 00:07:20.553179 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 00:07:20.553179 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 00:07:20.553179 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 00:07:20.553179 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 00:07:20.553179 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 31 00:07:20.553179 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Aug 31 00:07:20.553179 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 303/586] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 31 00:07:20 2022] GET /identity/v3/users/cinder => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:07:20.553179 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f41cae-79c0-42ce-8dc7-7de55b2e23cc None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:20.577723 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:20.621248 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826f0f8b-941d-4952-b35c-5433c4917af4 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:20.660641 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af7de05-4d7a-40f7-833b-4d34d36f839d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:20.661263 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af7de05-4d7a-40f7-833b-4d34d36f839d None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:20.661545 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af7de05-4d7a-40f7-833b-4d34d36f839d None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:20.661822 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af7de05-4d7a-40f7-833b-4d34d36f839d None admin] PATH_INFO: `/v3/domains` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:20.662473 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af7de05-4d7a-40f7-833b-4d34d36f839d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:20.662775 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af7de05-4d7a-40f7-833b-4d34d36f839d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:20.664192 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af7de05-4d7a-40f7-833b-4d34d36f839d None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:20.676475 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 284/587] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 31 00:07:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:20.677333 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af7de05-4d7a-40f7-833b-4d34d36f839d None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:20.689005 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f41cae-79c0-42ce-8dc7-7de55b2e23cc None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:20.734271 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0235b3ef-eb63-4730-b026-d09a7471c6f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:20.734954 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0235b3ef-eb63-4730-b026-d09a7471c6f1 None admin] REQUEST_METHOD: `PUT` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:20.735230 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0235b3ef-eb63-4730-b026-d09a7471c6f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:20.735525 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0235b3ef-eb63-4730-b026-d09a7471c6f1 None admin] PATH_INFO: `/v3/projects/1b647cccb30a427193fc62dbebe0c6f1/users/cc025521e1dc4c91ab50a8718a87754f/roles/1e6d7ecde4b0415bb944f25eda475f9c` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:20.754200 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0235b3ef-eb63-4730-b026-d09a7471c6f1 None admin] RBAC: Authorizing `identity:create_grant(project_id=1b647cccb30a427193fc62dbebe0c6f1, user_id=cc025521e1dc4c91ab50a8718a87754f, role_id=1e6d7ecde4b0415bb944f25eda475f9c)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:20.756832 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0235b3ef-eb63-4730-b026-d09a7471c6f1 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:20.774966 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 304/588] 10.222.0.47 () {58 vars in 1439 bytes} [Wed Aug 31 00:07:20 2022] PUT /identity/v3/projects/1b647cccb30a427193fc62dbebe0c6f1/users/cc025521e1dc4c91ab50a8718a87754f/roles/1e6d7ecde4b0415bb944f25eda475f9c => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:07:20.776431 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0235b3ef-eb63-4730-b026-d09a7471c6f1 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:20.814529 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af7de05-4d7a-40f7-833b-4d34d36f839d None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:20.818695 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:20.873631 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:20.879690 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bc2919-9efb-46ce-9031-8a03a3dac2fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:20.880809 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bc2919-9efb-46ce-9031-8a03a3dac2fd None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:20.881116 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bc2919-9efb-46ce-9031-8a03a3dac2fd None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:20.881534 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bc2919-9efb-46ce-9031-8a03a3dac2fd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:20.882767 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bc2919-9efb-46ce-9031-8a03a3dac2fd None admin] RBAC: Adding query filter params (role.id=1e6d7ecde4b0415bb944f25eda475f9c, scope.project.id=1b647cccb30a427193fc62dbebe0c6f1, user.id=ffbfbf19509645f49dbf9566e447c8c5) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:20.883356 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bc2919-9efb-46ce-9031-8a03a3dac2fd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:20.885835 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bc2919-9efb-46ce-9031-8a03a3dac2fd None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:20.904197 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 285/589] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 31 00:07:20 2022] GET /identity/v3/role_assignments?user.id=ffbfbf19509645f49dbf9566e447c8c5&scope.project.id=1b647cccb30a427193fc62dbebe0c6f1&role.id=1e6d7ecde4b0415bb944f25eda475f9c => generated 259 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:20.904197 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bc2919-9efb-46ce-9031-8a03a3dac2fd None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:20.928826 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0235b3ef-eb63-4730-b026-d09a7471c6f1 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:21.017621 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f13b392-74ad-4e80-af2c-962f5a0d7939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:21.018887 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f13b392-74ad-4e80-af2c-962f5a0d7939 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:21.019549 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f13b392-74ad-4e80-af2c-962f5a0d7939 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:21.021026 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f13b392-74ad-4e80-af2c-962f5a0d7939 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:21.049302 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f13b392-74ad-4e80-af2c-962f5a0d7939 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:21.054719 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f13b392-74ad-4e80-af2c-962f5a0d7939 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:21.086048 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-8f13b392-74ad-4e80-af2c-962f5a0d7939 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:07:21.086048 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:21.086048 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:21.086048 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:21.086048 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:21.086048 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:21.086048 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:21.086048 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:21.086048 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:21.086048 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:21.086048 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:21.086048 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:21.086048 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:07:21.086048 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:07:21.086048 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:07:21.086048 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:07:21.087849 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:21.087849 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:21.087849 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:21.087849 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:21.087849 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:21.087849 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:21.087849 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:21.087849 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:21.087849 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:21.087849 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:21.087849 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:21.087849 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:21.087849 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:21.087849 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:21.087849 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:21.087849 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:21.087849 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:07:21.091199 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:07:21.091199 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:07:21.091199 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Aug 31 00:07:21.091199 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 305/590] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 00:07:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:07:21.091199 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f13b392-74ad-4e80-af2c-962f5a0d7939 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:21.113725 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bc2919-9efb-46ce-9031-8a03a3dac2fd None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:21.164546 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fe196f-9fce-495a-9fe8-625652d5e9d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:21.165568 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fe196f-9fce-495a-9fe8-625652d5e9d7 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:21.166034 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fe196f-9fce-495a-9fe8-625652d5e9d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:21.166504 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fe196f-9fce-495a-9fe8-625652d5e9d7 None admin] PATH_INFO: `/v3/users` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:21.171180 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fe196f-9fce-495a-9fe8-625652d5e9d7 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:21.171722 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fe196f-9fce-495a-9fe8-625652d5e9d7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:21.174921 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fe196f-9fce-495a-9fe8-625652d5e9d7 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:21.211553 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 286/591] 10.222.0.47 () {56 vars in 1137 bytes} [Wed Aug 31 00:07:20 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:21.217841 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fe196f-9fce-495a-9fe8-625652d5e9d7 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:21.280822 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f13b392-74ad-4e80-af2c-962f5a0d7939 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:21.285964 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:21.342913 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:21.368562 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b852d3-4507-497c-bc45-0a99681a9fe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:21.369300 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b852d3-4507-497c-bc45-0a99681a9fe9 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:21.369582 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b852d3-4507-497c-bc45-0a99681a9fe9 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:21.369857 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b852d3-4507-497c-bc45-0a99681a9fe9 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:21.380942 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b852d3-4507-497c-bc45-0a99681a9fe9 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:21.382744 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b852d3-4507-497c-bc45-0a99681a9fe9 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:21.393155 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fe196f-9fce-495a-9fe8-625652d5e9d7 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:21.397424 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-91b852d3-4507-497c-bc45-0a99681a9fe9 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 31 00:07:21.397424 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:21.397424 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:21.397424 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:21.397424 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:21.397424 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:21.397424 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:21.397424 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:21.397424 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:21.397424 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:21.397424 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:21.397424 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:21.397424 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 00:07:21.397424 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 00:07:21.397424 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 00:07:21.397424 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 00:07:21.399179 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:21.399179 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:21.399179 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:07:21.399179 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:07:21.399179 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:07:21.399179 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:07:21.399179 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:21.399179 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:21.399179 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:21.399179 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:21.399179 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:21.399179 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:21.399179 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:21.399179 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:21.399179 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:21.399179 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:21.399179 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:21.399179 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:21.401085 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:21.401085 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:21.401085 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 00:07:21.401085 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 00:07:21.401085 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 00:07:21.401085 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 00:07:21.401085 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 00:07:21.401085 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 00:07:21.401085 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 31 00:07:21.401085 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Aug 31 00:07:21.404056 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 306/592] 10.222.0.47 () {56 vars in 1102 bytes} [Wed Aug 31 00:07:21 2022] GET /identity/v3/users/neutron => generated 85 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:07:21.405061 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b852d3-4507-497c-bc45-0a99681a9fe9 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:21.482774 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e8a35a-3f1f-4d5b-ae1a-31d781ad82be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:21.484915 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e8a35a-3f1f-4d5b-ae1a-31d781ad82be None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:21.486056 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e8a35a-3f1f-4d5b-ae1a-31d781ad82be None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:21.486775 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e8a35a-3f1f-4d5b-ae1a-31d781ad82be None admin] PATH_INFO: `/v3/domains` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:21.488484 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e8a35a-3f1f-4d5b-ae1a-31d781ad82be None admin] RBAC: Adding query filter params (name=Default) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:21.489316 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e8a35a-3f1f-4d5b-ae1a-31d781ad82be None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:21.492433 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e8a35a-3f1f-4d5b-ae1a-31d781ad82be None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:21.525079 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 287/593] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 31 00:07:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:21.525079 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e8a35a-3f1f-4d5b-ae1a-31d781ad82be None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:21.587397 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b852d3-4507-497c-bc45-0a99681a9fe9 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:21.645297 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c90696-6799-45da-9125-bcddd2e2aff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:21.646789 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c90696-6799-45da-9125-bcddd2e2aff1 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:21.647540 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c90696-6799-45da-9125-bcddd2e2aff1 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:21.648309 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c90696-6799-45da-9125-bcddd2e2aff1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:21.669386 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c90696-6799-45da-9125-bcddd2e2aff1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:21.672522 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c90696-6799-45da-9125-bcddd2e2aff1 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:21.679558 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:21.702735 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-48c90696-6799-45da-9125-bcddd2e2aff1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:07:21.702735 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:21.702735 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:21.702735 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:21.702735 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:21.702735 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:21.702735 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:21.702735 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:21.702735 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:21.702735 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:21.702735 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:21.702735 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:21.702735 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:07:21.702735 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:07:21.702735 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:07:21.702735 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:07:21.703783 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:21.703783 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:21.703783 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:21.703783 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:21.703783 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:21.703783 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:21.703783 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:21.703783 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:21.703783 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:21.703783 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:21.703783 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:21.703783 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:21.703783 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:21.703783 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:21.703783 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:21.703783 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:21.703783 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:07:21.704743 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:07:21.704743 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:07:21.704743 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Aug 31 00:07:21.711085 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e8a35a-3f1f-4d5b-ae1a-31d781ad82be None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:21.712008 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 307/594] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 00:07:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:07:21.713456 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c90696-6799-45da-9125-bcddd2e2aff1 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:21.751943 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc41880-e22d-495c-a02a-44d7ff8710c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:21.753077 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc41880-e22d-495c-a02a-44d7ff8710c7 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:21.753564 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc41880-e22d-495c-a02a-44d7ff8710c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:21.754088 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc41880-e22d-495c-a02a-44d7ff8710c7 None admin] PATH_INFO: `/v3/users` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:21.755054 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc41880-e22d-495c-a02a-44d7ff8710c7 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:21.755565 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc41880-e22d-495c-a02a-44d7ff8710c7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:21.757365 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc41880-e22d-495c-a02a-44d7ff8710c7 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:21.784780 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 288/595] 10.222.0.47 () {56 vars in 1139 bytes} [Wed Aug 31 00:07:21 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:21.785555 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:21.788047 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc41880-e22d-495c-a02a-44d7ff8710c7 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:21.908060 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c90696-6799-45da-9125-bcddd2e2aff1 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:21.946789 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9106a0e-37a7-4714-adac-dcc9f4e9640d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:21.947443 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9106a0e-37a7-4714-adac-dcc9f4e9640d None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:21.947727 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9106a0e-37a7-4714-adac-dcc9f4e9640d None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:21.948007 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9106a0e-37a7-4714-adac-dcc9f4e9640d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:21.956381 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9106a0e-37a7-4714-adac-dcc9f4e9640d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:21.957865 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9106a0e-37a7-4714-adac-dcc9f4e9640d None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:21.971394 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-a9106a0e-37a7-4714-adac-dcc9f4e9640d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:07:21.971394 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:21.971394 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:21.971394 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:21.971394 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:21.971394 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:21.971394 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:21.971394 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:21.971394 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:21.971394 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:21.971394 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:21.971394 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:21.971394 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 00:07:21.971394 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 00:07:21.971394 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 00:07:21.973217 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 00:07:21.973217 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:21.973217 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:21.973217 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:21.973217 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:21.973217 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:21.973217 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:21.973217 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:21.973217 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:21.973217 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:21.973217 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:21.973217 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:21.973217 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:21.973217 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:21.973217 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:21.973217 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:21.973217 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:21.974932 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 00:07:21.974932 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 00:07:21.974932 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:07:21.974932 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:07:21.974932 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:07:21.974932 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:07:21.974932 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:07:21.974932 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Aug 31 00:07:21.984194 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 308/596] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 31 00:07:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:07:21.984194 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9106a0e-37a7-4714-adac-dcc9f4e9640d None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:21.992639 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc41880-e22d-495c-a02a-44d7ff8710c7 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:22.064477 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed17adea-9be4-46c6-aa82-8b453c69f95e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:22.065669 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed17adea-9be4-46c6-aa82-8b453c69f95e None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:22.066229 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed17adea-9be4-46c6-aa82-8b453c69f95e None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:22.066662 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed17adea-9be4-46c6-aa82-8b453c69f95e None admin] PATH_INFO: `/v3/domains` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:22.067757 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed17adea-9be4-46c6-aa82-8b453c69f95e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:22.068309 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed17adea-9be4-46c6-aa82-8b453c69f95e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:22.070915 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed17adea-9be4-46c6-aa82-8b453c69f95e None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:22.095025 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:22.098985 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 289/597] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 31 00:07:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:22.101068 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed17adea-9be4-46c6-aa82-8b453c69f95e None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:22.108128 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9106a0e-37a7-4714-adac-dcc9f4e9640d None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:22.108847 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:22.149965 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3600f1ec-0790-4773-8c9a-822fb1c931ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:22.150477 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3600f1ec-0790-4773-8c9a-822fb1c931ad None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:22.150765 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3600f1ec-0790-4773-8c9a-822fb1c931ad None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:22.151042 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3600f1ec-0790-4773-8c9a-822fb1c931ad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:22.163605 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3600f1ec-0790-4773-8c9a-822fb1c931ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:22.165045 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3600f1ec-0790-4773-8c9a-822fb1c931ad None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:22.181192 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-3600f1ec-0790-4773-8c9a-822fb1c931ad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:07:22.181192 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:22.181192 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:22.181192 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:22.181192 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:22.181192 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:22.181192 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:22.181192 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:22.181192 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:22.181192 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:22.181192 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:22.181192 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:22.181192 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:07:22.181192 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:07:22.181192 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:07:22.181192 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:07:22.184117 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:22.184117 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:22.184117 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:22.184117 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:22.184117 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:22.184117 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:22.184117 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:22.184117 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:22.184117 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:22.184117 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:22.184117 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:22.184117 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:22.184117 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:22.184117 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:22.184117 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:22.184117 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:22.184117 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:07:22.187040 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:07:22.187040 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:07:22.187040 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Aug 31 00:07:22.187040 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 309/598] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 00:07:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:07:22.187040 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3600f1ec-0790-4773-8c9a-822fb1c931ad None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:22.298236 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3600f1ec-0790-4773-8c9a-822fb1c931ad None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:22.326739 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed17adea-9be4-46c6-aa82-8b453c69f95e None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:22.337767 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cba9eb-d63a-4e92-9b51-0115a58321e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:22.338443 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cba9eb-d63a-4e92-9b51-0115a58321e8 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:22.338728 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cba9eb-d63a-4e92-9b51-0115a58321e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:22.339050 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cba9eb-d63a-4e92-9b51-0115a58321e8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:22.348106 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cba9eb-d63a-4e92-9b51-0115a58321e8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:22.349244 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cba9eb-d63a-4e92-9b51-0115a58321e8 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:22.363144 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-a0cba9eb-d63a-4e92-9b51-0115a58321e8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:07:22.363144 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:22.363144 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:22.363144 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:22.363144 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:22.363144 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:22.363144 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:22.363144 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:22.363144 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:22.363144 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:22.363144 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:22.363144 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:22.363144 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 00:07:22.363144 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 00:07:22.363144 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 00:07:22.364676 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 00:07:22.364676 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:22.364676 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:22.364676 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:22.364676 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:22.364676 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:22.364676 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:22.364676 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:22.364676 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:22.364676 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:22.364676 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:22.364676 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:22.364676 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:22.364676 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:22.364676 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:22.364676 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:22.364676 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:22.366362 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 00:07:22.366362 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 00:07:22.366362 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:07:22.366362 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:07:22.366362 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:07:22.366362 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:07:22.366362 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:07:22.366362 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Aug 31 00:07:22.369344 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 310/599] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 31 00:07:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:07:22.370957 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cba9eb-d63a-4e92-9b51-0115a58321e8 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:22.383730 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:22.410602 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e5a5d4-dd41-40aa-9b71-7c2bcec4752f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:22.411415 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e5a5d4-dd41-40aa-9b71-7c2bcec4752f None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:22.411575 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e5a5d4-dd41-40aa-9b71-7c2bcec4752f None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:22.411822 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e5a5d4-dd41-40aa-9b71-7c2bcec4752f None admin] PATH_INFO: `/v3/projects` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:22.412965 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e5a5d4-dd41-40aa-9b71-7c2bcec4752f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:22.413294 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e5a5d4-dd41-40aa-9b71-7c2bcec4752f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:22.414868 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e5a5d4-dd41-40aa-9b71-7c2bcec4752f None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:22.435852 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 290/600] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Aug 31 00:07:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:22.437666 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e5a5d4-dd41-40aa-9b71-7c2bcec4752f None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:22.523746 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:22.578683 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cba9eb-d63a-4e92-9b51-0115a58321e8 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:22.585391 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e5a5d4-dd41-40aa-9b71-7c2bcec4752f None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:22.630515 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93964b44-bdc9-46a5-8687-4d4e0d0fdf97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:22.631451 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93964b44-bdc9-46a5-8687-4d4e0d0fdf97 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:22.632218 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93964b44-bdc9-46a5-8687-4d4e0d0fdf97 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:22.632685 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93964b44-bdc9-46a5-8687-4d4e0d0fdf97 None admin] PATH_INFO: `/v3/domains` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:22.633576 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93964b44-bdc9-46a5-8687-4d4e0d0fdf97 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:22.634036 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93964b44-bdc9-46a5-8687-4d4e0d0fdf97 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:22.636011 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93964b44-bdc9-46a5-8687-4d4e0d0fdf97 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:22.654696 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 311/601] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 31 00:07:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:22.656069 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93964b44-bdc9-46a5-8687-4d4e0d0fdf97 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:22.657876 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb00cf4-8abf-4d21-96d6-31334e84c030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:22.659043 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb00cf4-8abf-4d21-96d6-31334e84c030 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:22.659979 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb00cf4-8abf-4d21-96d6-31334e84c030 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:22.660327 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb00cf4-8abf-4d21-96d6-31334e84c030 None admin] PATH_INFO: `/v3/projects` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:22.662339 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb00cf4-8abf-4d21-96d6-31334e84c030 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:22.662339 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb00cf4-8abf-4d21-96d6-31334e84c030 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:22.665757 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb00cf4-8abf-4d21-96d6-31334e84c030 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:22.690469 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 291/602] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Aug 31 00:07:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:22.692270 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb00cf4-8abf-4d21-96d6-31334e84c030 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:22.765210 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:22.826324 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93964b44-bdc9-46a5-8687-4d4e0d0fdf97 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:22.842921 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb00cf4-8abf-4d21-96d6-31334e84c030 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:22.871282 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:22.884814 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528b9bad-d4f2-4152-b63b-afa013798f37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:22.885777 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528b9bad-d4f2-4152-b63b-afa013798f37 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:22.886277 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528b9bad-d4f2-4152-b63b-afa013798f37 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:22.886765 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528b9bad-d4f2-4152-b63b-afa013798f37 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:22.892231 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa13b1b0-22e0-4cda-94b0-0c0f06745427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:22.893319 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa13b1b0-22e0-4cda-94b0-0c0f06745427 None admin] REQUEST_METHOD: `PUT` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:22.893769 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa13b1b0-22e0-4cda-94b0-0c0f06745427 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:22.894245 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa13b1b0-22e0-4cda-94b0-0c0f06745427 None admin] PATH_INFO: `/v3/projects/1b647cccb30a427193fc62dbebe0c6f1/users/9ea002bf49c248dbae7147665fa10fd1/roles/1e6d7ecde4b0415bb944f25eda475f9c` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:22.896602 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528b9bad-d4f2-4152-b63b-afa013798f37 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:22.898486 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528b9bad-d4f2-4152-b63b-afa013798f37 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:22.913219 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-528b9bad-d4f2-4152-b63b-afa013798f37 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:07:22.913219 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:22.913219 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:22.913219 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:22.913219 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:22.913219 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:22.913219 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:22.913219 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:22.913219 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:22.913219 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:22.913219 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:22.913219 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:22.913219 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 00:07:22.913219 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 00:07:22.913219 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 00:07:22.914194 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 00:07:22.914194 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:22.914194 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:22.914194 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:22.914194 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:22.914194 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:22.914194 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:22.914194 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:22.914194 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:22.914194 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:22.914194 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:22.914194 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:22.914194 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:22.914194 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:22.914194 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:22.914194 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:22.914194 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:22.915099 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 00:07:22.915099 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 00:07:22.915099 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:07:22.915099 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:07:22.915099 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:07:22.915099 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:07:22.915099 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:07:22.915099 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 31 00:07:22.918824 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 292/603] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 31 00:07:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:07:22.919971 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528b9bad-d4f2-4152-b63b-afa013798f37 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:22.924289 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa13b1b0-22e0-4cda-94b0-0c0f06745427 None admin] RBAC: Authorizing `identity:create_grant(project_id=1b647cccb30a427193fc62dbebe0c6f1, user_id=9ea002bf49c248dbae7147665fa10fd1, role_id=1e6d7ecde4b0415bb944f25eda475f9c)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:22.927079 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa13b1b0-22e0-4cda-94b0-0c0f06745427 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:22.951520 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 312/604] 10.222.0.47 () {58 vars in 1439 bytes} [Wed Aug 31 00:07:22 2022] PUT /identity/v3/projects/1b647cccb30a427193fc62dbebe0c6f1/users/9ea002bf49c248dbae7147665fa10fd1/roles/1e6d7ecde4b0415bb944f25eda475f9c => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:07:22.953666 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa13b1b0-22e0-4cda-94b0-0c0f06745427 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:23.072729 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528b9bad-d4f2-4152-b63b-afa013798f37 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:23.107393 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa13b1b0-22e0-4cda-94b0-0c0f06745427 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:23.128668 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97eab7ae-f9d7-471c-9120-073f85456f7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:23.129637 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eab7ae-f9d7-471c-9120-073f85456f7b None admin] REQUEST_METHOD: `PUT` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:23.129920 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eab7ae-f9d7-471c-9120-073f85456f7b None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:23.130199 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eab7ae-f9d7-471c-9120-073f85456f7b None admin] PATH_INFO: `/v3/projects/1b647cccb30a427193fc62dbebe0c6f1/users/beecda6e9feb400288618745c784989f/roles/1e6d7ecde4b0415bb944f25eda475f9c` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:23.137621 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:23.157149 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97eab7ae-f9d7-471c-9120-073f85456f7b None admin] RBAC: Authorizing `identity:create_grant(project_id=1b647cccb30a427193fc62dbebe0c6f1, user_id=beecda6e9feb400288618745c784989f, role_id=1e6d7ecde4b0415bb944f25eda475f9c)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:23.158956 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97eab7ae-f9d7-471c-9120-073f85456f7b None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:23.166011 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11170f62-b792-4b0c-b24a-a69b97556b3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:23.167168 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11170f62-b792-4b0c-b24a-a69b97556b3f None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:23.167766 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11170f62-b792-4b0c-b24a-a69b97556b3f None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:23.168528 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11170f62-b792-4b0c-b24a-a69b97556b3f None admin] PATH_INFO: `/v3/projects` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:23.169788 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11170f62-b792-4b0c-b24a-a69b97556b3f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:23.170454 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11170f62-b792-4b0c-b24a-a69b97556b3f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:23.172559 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11170f62-b792-4b0c-b24a-a69b97556b3f None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:23.178940 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 293/605] 10.222.0.47 () {58 vars in 1439 bytes} [Wed Aug 31 00:07:22 2022] PUT /identity/v3/projects/1b647cccb30a427193fc62dbebe0c6f1/users/beecda6e9feb400288618745c784989f/roles/1e6d7ecde4b0415bb944f25eda475f9c => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:07:23.180277 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875c49e7-b6cf-454f-854d-174a4f9ad49d None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:23.180563 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875c49e7-b6cf-454f-854d-174a4f9ad49d None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:23.180836 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875c49e7-b6cf-454f-854d-174a4f9ad49d None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:23.186508 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 294/606] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 00:07:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:07:23.190362 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2efcf27-c19f-4e04-a67b-768d312dd223 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:23.190698 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2efcf27-c19f-4e04-a67b-768d312dd223 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:23.191050 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2efcf27-c19f-4e04-a67b-768d312dd223 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:23.196613 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 313/607] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Aug 31 00:07:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:23.206130 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11170f62-b792-4b0c-b24a-a69b97556b3f None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:23.215158 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-a2efcf27-c19f-4e04-a67b-768d312dd223 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:07:23.216591 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-a2efcf27-c19f-4e04-a67b-768d312dd223 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:07:23.265129 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:23.312824 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 295/608] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 00:07:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:07:23.431163 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11170f62-b792-4b0c-b24a-a69b97556b3f None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:23.507287 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7710288-d12d-4975-ba52-8c29c22854d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:23.508468 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7710288-d12d-4975-ba52-8c29c22854d4 None admin] REQUEST_METHOD: `PUT` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:23.508957 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7710288-d12d-4975-ba52-8c29c22854d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:23.509448 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7710288-d12d-4975-ba52-8c29c22854d4 None admin] PATH_INFO: `/v3/projects/1b647cccb30a427193fc62dbebe0c6f1/users/daae792cd11d4c4ca7aae0558998aced/roles/1e6d7ecde4b0415bb944f25eda475f9c` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:23.556362 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7710288-d12d-4975-ba52-8c29c22854d4 None admin] RBAC: Authorizing `identity:create_grant(project_id=1b647cccb30a427193fc62dbebe0c6f1, user_id=daae792cd11d4c4ca7aae0558998aced, role_id=1e6d7ecde4b0415bb944f25eda475f9c)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:23.556362 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7710288-d12d-4975-ba52-8c29c22854d4 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:23.572099 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 314/609] 10.222.0.47 () {58 vars in 1439 bytes} [Wed Aug 31 00:07:23 2022] PUT /identity/v3/projects/1b647cccb30a427193fc62dbebe0c6f1/users/daae792cd11d4c4ca7aae0558998aced/roles/1e6d7ecde4b0415bb944f25eda475f9c => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:07:23.647024 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2efcf27-c19f-4e04-a67b-768d312dd223 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:23.844781 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2efcf27-c19f-4e04-a67b-768d312dd223 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:23.900626 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33e911b-b4df-4634-b1a5-bceded4830a3 None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:23.900923 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33e911b-b4df-4634-b1a5-bceded4830a3 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:23.901182 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33e911b-b4df-4634-b1a5-bceded4830a3 None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:23.903546 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 315/610] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 00:07:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:07:23.909499 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f47818-c41e-4cbd-8f4d-49d4114d6535 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:23.909835 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f47818-c41e-4cbd-8f4d-49d4114d6535 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:23.910205 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f47818-c41e-4cbd-8f4d-49d4114d6535 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:23.911072 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dacaf73-bdd0-446d-8e20-d74d97aa6c67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:23.912494 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dacaf73-bdd0-446d-8e20-d74d97aa6c67 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:23.913222 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dacaf73-bdd0-446d-8e20-d74d97aa6c67 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:23.913963 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dacaf73-bdd0-446d-8e20-d74d97aa6c67 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:23.942024 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dacaf73-bdd0-446d-8e20-d74d97aa6c67 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:07:23.951045 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-8dacaf73-bdd0-446d-8e20-d74d97aa6c67 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:07:23.951045 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:23.951045 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:23.951045 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:23.951045 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:23.951045 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:23.951045 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:23.951045 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:23.951045 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:23.951045 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:23.951045 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:23.951045 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:23.951045 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:07:23.951045 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:07:23.951045 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:07:23.951045 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:07:23.952909 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:07:23.952909 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:07:23.952909 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:07:23.952909 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:07:23.952909 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:23.952909 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:23.952909 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:23.952909 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:23.952909 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:23.952909 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:23.952909 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:23.952909 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:23.952909 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:23.952909 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:23.952909 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:23.952909 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:23.954659 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:23.954659 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:23.954659 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:23.954659 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:23.954659 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:07:23.954659 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:07:23.954659 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:07:23.954659 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:07:23.954659 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:07:23.954659 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:07:23.954659 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:07:23.954659 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 31 00:07:23.954659 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 296/611] 10.222.0.47 () {56 vars in 1102 bytes} [Wed Aug 31 00:07:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:07:23.956005 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-09f47818-c41e-4cbd-8f4d-49d4114d6535 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:07:23.956005 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-09f47818-c41e-4cbd-8f4d-49d4114d6535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:07:23.967432 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dacaf73-bdd0-446d-8e20-d74d97aa6c67 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:24.020704 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:24.030518 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:24.130936 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dacaf73-bdd0-446d-8e20-d74d97aa6c67 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:24.153891 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 316/612] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 00:07:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:07:24.180955 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b7e1b7-6d7d-4852-8741-626330a2c9dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:24.181591 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b7e1b7-6d7d-4852-8741-626330a2c9dd None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:24.181939 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b7e1b7-6d7d-4852-8741-626330a2c9dd None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:24.182213 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b7e1b7-6d7d-4852-8741-626330a2c9dd None admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:24.183453 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b7e1b7-6d7d-4852-8741-626330a2c9dd None admin] RBAC: Adding query filter params (name=service) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:24.183755 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b7e1b7-6d7d-4852-8741-626330a2c9dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:24.185351 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b7e1b7-6d7d-4852-8741-626330a2c9dd None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:24.196460 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 297/613] 10.222.0.47 () {56 vars in 1103 bytes} [Wed Aug 31 00:07:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:24.204866 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f47818-c41e-4cbd-8f4d-49d4114d6535 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:24.356669 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f47818-c41e-4cbd-8f4d-49d4114d6535 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:24.405354 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52aa4d28-13cd-47d4-bb03-ec363a173394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:24.405997 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aa4d28-13cd-47d4-bb03-ec363a173394 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:24.406276 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aa4d28-13cd-47d4-bb03-ec363a173394 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:24.406537 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aa4d28-13cd-47d4-bb03-ec363a173394 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:24.424927 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52aa4d28-13cd-47d4-bb03-ec363a173394 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:24.426450 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52aa4d28-13cd-47d4-bb03-ec363a173394 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:24.454189 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-52aa4d28-13cd-47d4-bb03-ec363a173394 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:07:24.454189 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:24.454189 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:24.454189 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:24.454189 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:24.454189 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:24.454189 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:24.454189 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:24.454189 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:24.454189 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:24.454189 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:24.454189 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:24.454189 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:07:24.454189 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:07:24.454189 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:07:24.454189 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:07:24.457116 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:24.457116 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:24.457116 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:24.457116 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:24.457116 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:24.457116 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:24.457116 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:24.457116 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:24.457116 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:24.457116 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:24.457116 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:24.457116 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:24.457116 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:24.457116 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:24.457116 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:24.457116 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:24.457116 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:07:24.458879 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:07:24.458879 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:07:24.458879 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Aug 31 00:07:24.464185 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 317/614] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 00:07:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:07:24.468739 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b7e1b7-6d7d-4852-8741-626330a2c9dd None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:24.551775 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52aa4d28-13cd-47d4-bb03-ec363a173394 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:24.580668 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:24.617185 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:24.650609 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b7e1b7-6d7d-4852-8741-626330a2c9dd None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:24.710616 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837a6d2c-4a8e-4af0-b320-0108bfcde5a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:24.711153 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837a6d2c-4a8e-4af0-b320-0108bfcde5a3 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:24.711437 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837a6d2c-4a8e-4af0-b320-0108bfcde5a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:24.711709 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837a6d2c-4a8e-4af0-b320-0108bfcde5a3 None admin] PATH_INFO: `/v3/domains` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:24.712397 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837a6d2c-4a8e-4af0-b320-0108bfcde5a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:24.712696 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837a6d2c-4a8e-4af0-b320-0108bfcde5a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:24.714133 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837a6d2c-4a8e-4af0-b320-0108bfcde5a3 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:24.746678 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 298/615] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 31 00:07:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:24.750393 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837a6d2c-4a8e-4af0-b320-0108bfcde5a3 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:24.775812 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52aa4d28-13cd-47d4-bb03-ec363a173394 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:24.853528 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ceccb67-6729-47da-a30f-a2acff2ac22a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:24.854184 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceccb67-6729-47da-a30f-a2acff2ac22a None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:24.854467 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceccb67-6729-47da-a30f-a2acff2ac22a None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:24.854946 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceccb67-6729-47da-a30f-a2acff2ac22a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:24.880114 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ceccb67-6729-47da-a30f-a2acff2ac22a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:07:24.893139 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-0ceccb67-6729-47da-a30f-a2acff2ac22a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:07:24.893139 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:24.893139 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:24.893139 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:24.893139 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:24.893139 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:24.893139 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:24.893139 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:24.893139 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:24.893139 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:24.893139 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:24.893139 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:24.893139 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:07:24.893139 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:07:24.893139 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:07:24.893139 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:07:24.894816 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:07:24.894816 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:07:24.894816 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:07:24.894816 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:07:24.894816 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:24.894816 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:24.894816 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:24.894816 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:24.894816 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:24.894816 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:24.894816 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:24.894816 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:24.894816 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:24.894816 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:24.894816 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:24.894816 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:24.896282 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:24.896282 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:24.896282 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:24.896282 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:24.896282 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:07:24.896282 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:07:24.896282 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:07:24.896282 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:07:24.896282 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:07:24.896282 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:07:24.896282 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:07:24.896282 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Aug 31 00:07:24.896282 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 318/616] 10.222.0.47 () {56 vars in 1102 bytes} [Wed Aug 31 00:07:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 344 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:07:24.908198 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ceccb67-6729-47da-a30f-a2acff2ac22a None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:24.968739 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837a6d2c-4a8e-4af0-b320-0108bfcde5a3 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:25.010460 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:25.052040 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ceccb67-6729-47da-a30f-a2acff2ac22a None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:25.091665 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4692cf1d-6500-49a1-b62f-e9b6f8b8030d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:25.092796 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4692cf1d-6500-49a1-b62f-e9b6f8b8030d None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:25.093058 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4692cf1d-6500-49a1-b62f-e9b6f8b8030d None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:25.093314 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4692cf1d-6500-49a1-b62f-e9b6f8b8030d None admin] PATH_INFO: `/v3/users/swift` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:25.095387 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ba1241-08ab-4cbf-b919-5e48b1860fee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:25.096013 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ba1241-08ab-4cbf-b919-5e48b1860fee None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:25.096575 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ba1241-08ab-4cbf-b919-5e48b1860fee None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:25.096830 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ba1241-08ab-4cbf-b919-5e48b1860fee None admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:25.097518 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ba1241-08ab-4cbf-b919-5e48b1860fee None admin] RBAC: Adding query filter params (name=service) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:25.097825 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ba1241-08ab-4cbf-b919-5e48b1860fee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:25.100752 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ba1241-08ab-4cbf-b919-5e48b1860fee None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:25.113139 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4692cf1d-6500-49a1-b62f-e9b6f8b8030d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:25.116622 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4692cf1d-6500-49a1-b62f-e9b6f8b8030d None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:25.119346 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 319/617] 10.222.0.47 () {56 vars in 1103 bytes} [Wed Aug 31 00:07:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:07:25.127285 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ba1241-08ab-4cbf-b919-5e48b1860fee None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:25.138078 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-4692cf1d-6500-49a1-b62f-e9b6f8b8030d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 31 00:07:25.138078 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:25.138078 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:25.138078 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:25.138078 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:25.138078 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:25.138078 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:25.138078 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:25.138078 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:25.138078 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:25.138078 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:25.138078 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:25.138078 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 00:07:25.138078 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 00:07:25.138078 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 00:07:25.138078 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 00:07:25.140903 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:25.140903 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:25.140903 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:07:25.140903 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:07:25.140903 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:07:25.140903 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:07:25.140903 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:25.140903 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:25.140903 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:25.140903 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:25.140903 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:25.140903 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:25.140903 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:25.140903 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:25.140903 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:25.140903 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:25.140903 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:25.140903 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:25.143133 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:25.143133 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:25.143133 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 00:07:25.143133 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 00:07:25.143133 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 00:07:25.143133 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 00:07:25.143133 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 00:07:25.143133 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 00:07:25.143133 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 31 00:07:25.143133 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 31 00:07:25.143133 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 299/618] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Aug 31 00:07:24 2022] GET /identity/v3/users/swift => generated 83 bytes in 389 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:07:25.154603 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4692cf1d-6500-49a1-b62f-e9b6f8b8030d None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:25.178607 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:25.357215 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ba1241-08ab-4cbf-b919-5e48b1860fee None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:25.376533 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4692cf1d-6500-49a1-b62f-e9b6f8b8030d None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:25.414784 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:25.418686 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e893b38a-7334-4343-97d6-93a9067f9b69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:25.419330 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e893b38a-7334-4343-97d6-93a9067f9b69 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:25.419609 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e893b38a-7334-4343-97d6-93a9067f9b69 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:25.419883 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e893b38a-7334-4343-97d6-93a9067f9b69 None admin] PATH_INFO: `/v3/users` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:25.420670 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e893b38a-7334-4343-97d6-93a9067f9b69 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:25.420981 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e893b38a-7334-4343-97d6-93a9067f9b69 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:25.422452 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e893b38a-7334-4343-97d6-93a9067f9b69 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:25.433235 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47702b17-a63b-42cf-a581-9fbef59eeec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:25.434054 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47702b17-a63b-42cf-a581-9fbef59eeec4 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:25.434344 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47702b17-a63b-42cf-a581-9fbef59eeec4 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:25.435045 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47702b17-a63b-42cf-a581-9fbef59eeec4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:25.449165 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47702b17-a63b-42cf-a581-9fbef59eeec4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:25.450608 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47702b17-a63b-42cf-a581-9fbef59eeec4 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:25.476191 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-47702b17-a63b-42cf-a581-9fbef59eeec4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:07:25.476191 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:25.476191 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:25.476191 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:25.476191 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:25.476191 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:25.476191 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:25.476191 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:25.476191 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:25.476191 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:25.476191 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:25.476191 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:25.476191 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:07:25.476191 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:07:25.476191 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:07:25.476191 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:07:25.478713 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:25.478713 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:25.478713 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:25.478713 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:25.478713 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:25.478713 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:25.478713 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:25.478713 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:25.478713 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:25.478713 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:25.478713 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:25.478713 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:25.478713 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:25.478713 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:25.478713 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:25.478713 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:25.478713 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:07:25.480727 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:07:25.480727 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:07:25.480727 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Aug 31 00:07:25.480727 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 320/619] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 00:07:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 343 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:07:25.480727 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47702b17-a63b-42cf-a581-9fbef59eeec4 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:25.482489 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 300/620] 10.222.0.47 () {56 vars in 1135 bytes} [Wed Aug 31 00:07:25 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:25.490160 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e893b38a-7334-4343-97d6-93a9067f9b69 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:25.609682 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47702b17-a63b-42cf-a581-9fbef59eeec4 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:25.664695 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208022ed-740b-4bbb-9410-d1de41bfd825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:25.664695 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208022ed-740b-4bbb-9410-d1de41bfd825 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:25.664695 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208022ed-740b-4bbb-9410-d1de41bfd825 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:25.664695 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208022ed-740b-4bbb-9410-d1de41bfd825 None admin] PATH_INFO: `/v3/domains` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:25.665361 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208022ed-740b-4bbb-9410-d1de41bfd825 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:25.665361 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208022ed-740b-4bbb-9410-d1de41bfd825 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:25.665638 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:25.666221 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208022ed-740b-4bbb-9410-d1de41bfd825 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:25.688643 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 321/621] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 31 00:07:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:25.690043 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addccb4c-decf-44f6-9753-2232d19c27d1 None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:25.690352 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addccb4c-decf-44f6-9753-2232d19c27d1 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:25.690606 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addccb4c-decf-44f6-9753-2232d19c27d1 None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:25.692267 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 322/622] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 00:07:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:07:25.698169 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1270112f-57c7-41b5-8905-2245c8f6668c None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:25.699212 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1270112f-57c7-41b5-8905-2245c8f6668c None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:25.699454 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1270112f-57c7-41b5-8905-2245c8f6668c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:25.720975 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-1270112f-57c7-41b5-8905-2245c8f6668c None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:07:25.722551 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-1270112f-57c7-41b5-8905-2245c8f6668c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:07:25.734142 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e893b38a-7334-4343-97d6-93a9067f9b69 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:25.776199 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:25.783711 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afabc38b-dc8f-4d2a-94f4-e49cd13587b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:25.784736 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afabc38b-dc8f-4d2a-94f4-e49cd13587b2 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:25.785022 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afabc38b-dc8f-4d2a-94f4-e49cd13587b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:25.785339 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afabc38b-dc8f-4d2a-94f4-e49cd13587b2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:25.797531 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afabc38b-dc8f-4d2a-94f4-e49cd13587b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:25.799029 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afabc38b-dc8f-4d2a-94f4-e49cd13587b2 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:25.811994 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 323/623] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 00:07:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:07:25.812912 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1270112f-57c7-41b5-8905-2245c8f6668c None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:25.825616 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-afabc38b-dc8f-4d2a-94f4-e49cd13587b2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:07:25.825616 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:25.825616 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:25.825616 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:25.825616 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:25.825616 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:25.825616 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:25.825616 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:25.825616 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:25.825616 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:25.825616 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:25.825616 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:25.825616 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:07:25.825616 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:07:25.825616 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:07:25.825616 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:07:25.829051 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:25.829051 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:25.829051 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:25.829051 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:25.829051 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:25.829051 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:25.829051 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:25.829051 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:25.829051 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:25.829051 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:25.829051 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:25.829051 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:25.829051 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:25.829051 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:25.829051 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:25.829051 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:25.829051 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:07:25.832400 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:07:25.832400 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:07:25.832400 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 31 00:07:25.832400 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 301/624] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 00:07:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:07:25.842752 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afabc38b-dc8f-4d2a-94f4-e49cd13587b2 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:25.945283 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1270112f-57c7-41b5-8905-2245c8f6668c None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:25.992638 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433cfd3e-8981-4e86-b9c8-c4a74701282b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:25.993283 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433cfd3e-8981-4e86-b9c8-c4a74701282b None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:25.993561 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433cfd3e-8981-4e86-b9c8-c4a74701282b None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:25.993834 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433cfd3e-8981-4e86-b9c8-c4a74701282b None admin] PATH_INFO: `/v3/users/glance` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:26.021738 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433cfd3e-8981-4e86-b9c8-c4a74701282b None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:26.023230 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433cfd3e-8981-4e86-b9c8-c4a74701282b None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:26.049610 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-433cfd3e-8981-4e86-b9c8-c4a74701282b None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 31 00:07:26.049610 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:26.049610 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:26.049610 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:26.049610 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:26.049610 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:26.049610 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:26.049610 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:26.049610 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:26.049610 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:26.049610 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:26.049610 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:26.049610 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 00:07:26.049610 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 00:07:26.049610 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 00:07:26.049610 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 00:07:26.052141 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:26.052141 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:26.052141 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:07:26.052141 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:07:26.052141 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:07:26.052141 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:07:26.052141 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:26.052141 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:26.052141 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:26.052141 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:26.052141 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:26.052141 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:26.052141 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:26.052141 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:26.052141 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:26.052141 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:26.052141 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:26.052141 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:26.054465 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:26.054465 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:26.054465 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 00:07:26.054465 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 00:07:26.054465 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 00:07:26.054465 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 00:07:26.054465 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 00:07:26.054465 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 00:07:26.054465 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 31 00:07:26.054465 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Aug 31 00:07:26.054465 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 324/625] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 31 00:07:25 2022] GET /identity/v3/users/glance => generated 84 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:07:26.073634 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433cfd3e-8981-4e86-b9c8-c4a74701282b None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:26.113177 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:26.149033 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afabc38b-dc8f-4d2a-94f4-e49cd13587b2 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:26.212927 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:26.218231 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d43e06-fbf2-40a4-ba93-124e386bd081 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:26.219266 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d43e06-fbf2-40a4-ba93-124e386bd081 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:26.219748 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d43e06-fbf2-40a4-ba93-124e386bd081 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:26.220257 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d43e06-fbf2-40a4-ba93-124e386bd081 None admin] PATH_INFO: `/v3/domains` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:26.221407 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d43e06-fbf2-40a4-ba93-124e386bd081 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:26.221947 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d43e06-fbf2-40a4-ba93-124e386bd081 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:26.227225 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d43e06-fbf2-40a4-ba93-124e386bd081 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:26.263287 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 302/626] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 31 00:07:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 422 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:26.270121 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcfc01a-abd4-4f58-9ce9-78270d7e0b59 None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:26.270618 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcfc01a-abd4-4f58-9ce9-78270d7e0b59 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:26.271089 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcfc01a-abd4-4f58-9ce9-78270d7e0b59 None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:26.275397 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 303/627] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 00:07:26 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:07:26.279915 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcfc01a-abd4-4f58-9ce9-78270d7e0b59 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:26.281114 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433cfd3e-8981-4e86-b9c8-c4a74701282b None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:26.336724 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a670e21-03c5-4bd9-84fa-68ab28ef6378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:26.337917 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a670e21-03c5-4bd9-84fa-68ab28ef6378 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:26.338416 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a670e21-03c5-4bd9-84fa-68ab28ef6378 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:26.338873 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a670e21-03c5-4bd9-84fa-68ab28ef6378 None admin] PATH_INFO: `/v3/users` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:26.340906 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a670e21-03c5-4bd9-84fa-68ab28ef6378 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:26.341581 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a670e21-03c5-4bd9-84fa-68ab28ef6378 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:26.344493 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a670e21-03c5-4bd9-84fa-68ab28ef6378 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:26.387723 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 325/628] 10.222.0.47 () {56 vars in 1137 bytes} [Wed Aug 31 00:07:26 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:07:26.387723 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fed36b-3005-465f-8eac-d9b5ec585ce8 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:26.387723 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fed36b-3005-465f-8eac-d9b5ec585ce8 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:26.387723 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fed36b-3005-465f-8eac-d9b5ec585ce8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:26.407576 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcfc01a-abd4-4f58-9ce9-78270d7e0b59 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:26.420466 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-81fed36b-3005-465f-8eac-d9b5ec585ce8 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:07:26.422690 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-81fed36b-3005-465f-8eac-d9b5ec585ce8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:07:26.445640 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b240f9bb-926c-4f10-874b-9bc21a057309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:26.446286 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b240f9bb-926c-4f10-874b-9bc21a057309 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:26.446567 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b240f9bb-926c-4f10-874b-9bc21a057309 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:26.446838 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b240f9bb-926c-4f10-874b-9bc21a057309 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:26.454296 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b240f9bb-926c-4f10-874b-9bc21a057309 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:26.455854 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b240f9bb-926c-4f10-874b-9bc21a057309 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:26.469322 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-b240f9bb-926c-4f10-874b-9bc21a057309 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:07:26.469322 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:26.469322 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:26.469322 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:26.469322 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:26.469322 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:26.469322 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:26.469322 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:26.469322 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:26.469322 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:26.469322 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:26.469322 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:26.469322 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 00:07:26.469322 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 00:07:26.469322 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 00:07:26.470343 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 00:07:26.470343 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:26.470343 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:26.470343 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:26.470343 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:26.470343 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:26.470343 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:26.470343 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:26.470343 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:26.470343 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:26.470343 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:26.470343 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:26.470343 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:26.470343 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:26.470343 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:26.470343 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:26.470343 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:26.471256 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 00:07:26.471256 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 00:07:26.471256 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:07:26.471256 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:07:26.471256 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:07:26.471256 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:07:26.471256 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:07:26.471256 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 31 00:07:26.471256 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 304/629] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 31 00:07:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:07:26.471256 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b240f9bb-926c-4f10-874b-9bc21a057309 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:26.510670 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:26.553600 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 326/630] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 00:07:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:07:26.554588 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fed36b-3005-465f-8eac-d9b5ec585ce8 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:26.598202 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:26.630252 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b240f9bb-926c-4f10-874b-9bc21a057309 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:26.697699 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bdfa7f-b013-478f-801d-0eceb4ceb4f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:26.700050 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bdfa7f-b013-478f-801d-0eceb4ceb4f9 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:26.700603 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bdfa7f-b013-478f-801d-0eceb4ceb4f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:26.701090 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bdfa7f-b013-478f-801d-0eceb4ceb4f9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:26.721840 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bdfa7f-b013-478f-801d-0eceb4ceb4f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:07:26.732396 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-86bdfa7f-b013-478f-801d-0eceb4ceb4f9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:07:26.732396 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:26.732396 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:26.732396 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:26.732396 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:26.732396 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:26.732396 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:26.732396 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:26.732396 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:26.732396 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:26.732396 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:26.732396 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:26.732396 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:07:26.732396 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:07:26.732396 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:07:26.732396 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:07:26.733805 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:07:26.733805 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:07:26.733805 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:07:26.733805 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:07:26.733805 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:26.733805 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:26.733805 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:26.733805 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:26.733805 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:26.733805 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:26.733805 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:26.733805 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:26.733805 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:26.733805 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:26.733805 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:26.733805 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:26.736410 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:26.736410 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:26.736410 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:26.736410 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:26.736410 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:07:26.736410 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:07:26.736410 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:07:26.736410 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:07:26.736410 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:07:26.736410 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:07:26.736410 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:07:26.736410 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 31 00:07:26.736410 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 305/631] 10.222.0.47 () {56 vars in 1102 bytes} [Wed Aug 31 00:07:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:07:26.737803 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bdfa7f-b013-478f-801d-0eceb4ceb4f9 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:26.745321 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fed36b-3005-465f-8eac-d9b5ec585ce8 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:26.808367 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77a0473-c18e-4ba5-9e29-4e694e45771d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:26.809536 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77a0473-c18e-4ba5-9e29-4e694e45771d None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:26.810047 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77a0473-c18e-4ba5-9e29-4e694e45771d None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:26.810520 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77a0473-c18e-4ba5-9e29-4e694e45771d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:26.903269 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:26.913979 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bdfa7f-b013-478f-801d-0eceb4ceb4f9 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:26.938630 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77a0473-c18e-4ba5-9e29-4e694e45771d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:26.940494 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77a0473-c18e-4ba5-9e29-4e694e45771d None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:26.975583 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cd9c0e-7d31-48cd-a9ad-f19ae0a13fe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:26.976116 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cd9c0e-7d31-48cd-a9ad-f19ae0a13fe2 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:26.976474 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cd9c0e-7d31-48cd-a9ad-f19ae0a13fe2 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:26.976658 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cd9c0e-7d31-48cd-a9ad-f19ae0a13fe2 None admin] PATH_INFO: `/v3/projects` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:26.977368 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cd9c0e-7d31-48cd-a9ad-f19ae0a13fe2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:26.977668 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cd9c0e-7d31-48cd-a9ad-f19ae0a13fe2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:26.978651 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:26.979153 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cd9c0e-7d31-48cd-a9ad-f19ae0a13fe2 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:27.001778 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 306/632] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Aug 31 00:07:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:27.003452 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dd7bdf-bf39-4201-8dd8-468f498c55a8 None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:27.003934 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dd7bdf-bf39-4201-8dd8-468f498c55a8 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:27.004437 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dd7bdf-bf39-4201-8dd8-468f498c55a8 None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:27.007732 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 307/633] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 00:07:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:07:27.008839 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dd7bdf-bf39-4201-8dd8-468f498c55a8 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:27.093287 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 327/634] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 31 00:07:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 539 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 00:07:27.094687 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77a0473-c18e-4ba5-9e29-4e694e45771d None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:27.144899 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dd7bdf-bf39-4201-8dd8-468f498c55a8 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:27.184020 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c807d1-9777-4f29-b01a-f0eb3aeb8382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:27.184661 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c807d1-9777-4f29-b01a-f0eb3aeb8382 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:27.184943 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c807d1-9777-4f29-b01a-f0eb3aeb8382 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:27.185216 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c807d1-9777-4f29-b01a-f0eb3aeb8382 None admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:27.185891 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c807d1-9777-4f29-b01a-f0eb3aeb8382 None admin] RBAC: Adding query filter params (name=service) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:27.186194 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c807d1-9777-4f29-b01a-f0eb3aeb8382 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:27.187600 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c807d1-9777-4f29-b01a-f0eb3aeb8382 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:27.202012 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 308/635] 10.222.0.47 () {56 vars in 1103 bytes} [Wed Aug 31 00:07:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:27.202012 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c807d1-9777-4f29-b01a-f0eb3aeb8382 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:27.219750 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:27.222629 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77a0473-c18e-4ba5-9e29-4e694e45771d None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:27.247227 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:27.261828 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbdc612-5e81-4ab6-a615-f6a0dff36d78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:27.262468 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbdc612-5e81-4ab6-a615-f6a0dff36d78 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:27.262748 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbdc612-5e81-4ab6-a615-f6a0dff36d78 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:27.263025 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbdc612-5e81-4ab6-a615-f6a0dff36d78 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:27.274781 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbdc612-5e81-4ab6-a615-f6a0dff36d78 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:07:27.280412 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-5bbdc612-5e81-4ab6-a615-f6a0dff36d78 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:07:27.280412 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:27.280412 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:27.280412 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:27.280412 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:27.280412 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:27.280412 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:27.280412 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:27.280412 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:27.280412 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:27.280412 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:27.280412 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:27.280412 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:07:27.280412 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:07:27.280412 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:07:27.280412 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:07:27.282173 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:07:27.282173 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:07:27.282173 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:07:27.282173 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:07:27.282173 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:27.282173 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:27.282173 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:27.282173 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:27.282173 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:27.282173 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:27.282173 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:27.282173 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:27.282173 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:27.282173 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:27.282173 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:27.282173 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:27.283797 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:27.283797 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:27.283797 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:27.283797 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:27.283797 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:07:27.283797 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:07:27.283797 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:07:27.283797 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:07:27.283797 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:07:27.283797 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:07:27.283797 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:07:27.283797 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Aug 31 00:07:27.283797 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 328/636] 10.222.0.47 () {56 vars in 1102 bytes} [Wed Aug 31 00:07:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:07:27.283797 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed549f7-02b1-400c-8f85-45a296a0c69a None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:27.286345 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed549f7-02b1-400c-8f85-45a296a0c69a None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:27.286345 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed549f7-02b1-400c-8f85-45a296a0c69a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:27.303991 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-5ed549f7-02b1-400c-8f85-45a296a0c69a None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:07:27.305244 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-5ed549f7-02b1-400c-8f85-45a296a0c69a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:07:27.314557 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c807d1-9777-4f29-b01a-f0eb3aeb8382 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:27.352892 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335b357f-c4f6-46a6-a8ed-1628f3f26b96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:27.353658 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335b357f-c4f6-46a6-a8ed-1628f3f26b96 None admin] REQUEST_METHOD: `PUT` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:27.353934 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335b357f-c4f6-46a6-a8ed-1628f3f26b96 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:27.354207 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335b357f-c4f6-46a6-a8ed-1628f3f26b96 None admin] PATH_INFO: `/v3/projects/1b647cccb30a427193fc62dbebe0c6f1/users/ffbfbf19509645f49dbf9566e447c8c5/roles/1e6d7ecde4b0415bb944f25eda475f9c` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:27.371639 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335b357f-c4f6-46a6-a8ed-1628f3f26b96 None admin] RBAC: Authorizing `identity:create_grant(project_id=1b647cccb30a427193fc62dbebe0c6f1, user_id=ffbfbf19509645f49dbf9566e447c8c5, role_id=1e6d7ecde4b0415bb944f25eda475f9c)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:27.373151 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335b357f-c4f6-46a6-a8ed-1628f3f26b96 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:27.379863 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 329/637] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 00:07:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:07:27.381009 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed549f7-02b1-400c-8f85-45a296a0c69a None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:27.394568 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 309/638] 10.222.0.47 () {58 vars in 1439 bytes} [Wed Aug 31 00:07:27 2022] PUT /identity/v3/projects/1b647cccb30a427193fc62dbebe0c6f1/users/ffbfbf19509645f49dbf9566e447c8c5/roles/1e6d7ecde4b0415bb944f25eda475f9c => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:07:27.396531 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335b357f-c4f6-46a6-a8ed-1628f3f26b96 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:27.544287 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:27.581342 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed549f7-02b1-400c-8f85-45a296a0c69a None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:27.584736 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335b357f-c4f6-46a6-a8ed-1628f3f26b96 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:27.611002 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:27.656114 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33487d4e-e8c4-44d8-b7de-416071be6634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:27.656114 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33487d4e-e8c4-44d8-b7de-416071be6634 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:27.656114 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33487d4e-e8c4-44d8-b7de-416071be6634 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:27.656114 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33487d4e-e8c4-44d8-b7de-416071be6634 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:27.656800 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e2ab7d-f0ef-4b75-a9f4-c62a5568cb89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:27.656800 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e2ab7d-f0ef-4b75-a9f4-c62a5568cb89 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:27.656800 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e2ab7d-f0ef-4b75-a9f4-c62a5568cb89 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:27.656800 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e2ab7d-f0ef-4b75-a9f4-c62a5568cb89 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:27.671595 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33487d4e-e8c4-44d8-b7de-416071be6634 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:27.673803 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33487d4e-e8c4-44d8-b7de-416071be6634 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:27.674061 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e2ab7d-f0ef-4b75-a9f4-c62a5568cb89 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:27.675891 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e2ab7d-f0ef-4b75-a9f4-c62a5568cb89 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:27.694709 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-33487d4e-e8c4-44d8-b7de-416071be6634 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:07:27.694709 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:27.694709 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:27.694709 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:27.694709 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:27.694709 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:27.694709 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:27.694709 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:27.694709 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:27.694709 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:27.694709 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:27.694709 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:27.694709 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:07:27.694709 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:07:27.694709 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:07:27.694709 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:07:27.696991 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:27.696991 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:27.696991 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:27.696991 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:27.696991 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:27.696991 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:27.696991 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:27.696991 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:27.696991 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:27.696991 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:27.696991 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:27.696991 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:27.696991 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:27.696991 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:27.696991 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:27.696991 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:27.696991 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:07:27.699776 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:07:27.699776 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:07:27.699776 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Aug 31 00:07:27.700075 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-09e2ab7d-f0ef-4b75-a9f4-c62a5568cb89 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:07:27.700075 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:27.700075 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:27.700075 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:27.700075 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:27.700075 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:27.700075 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:27.700075 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:27.700075 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:27.700075 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:27.700075 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:27.700075 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:27.700075 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:07:27.700075 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:07:27.700075 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:07:27.700075 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:07:27.702168 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:27.702168 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:27.702168 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:27.702168 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:27.702168 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:27.702168 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:27.702168 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:27.702168 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:27.702168 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:27.702168 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:27.702168 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:27.702168 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:27.702168 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:27.702168 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:27.702168 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:27.702168 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:27.702168 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:07:27.703418 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:07:27.703418 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:07:27.703418 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 31 00:07:27.703720 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 330/639] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 00:07:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:07:27.703720 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33487d4e-e8c4-44d8-b7de-416071be6634 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:27.703890 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 310/640] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 00:07:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:07:27.703890 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e2ab7d-f0ef-4b75-a9f4-c62a5568cb89 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:27.855999 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e2ab7d-f0ef-4b75-a9f4-c62a5568cb89 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:27.875666 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33487d4e-e8c4-44d8-b7de-416071be6634 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:27.898286 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:27.918853 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eba293a-1c9b-49e7-ba43-e91ba930e229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:27.919502 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eba293a-1c9b-49e7-ba43-e91ba930e229 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:27.919783 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eba293a-1c9b-49e7-ba43-e91ba930e229 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:27.920049 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eba293a-1c9b-49e7-ba43-e91ba930e229 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:27.932022 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eba293a-1c9b-49e7-ba43-e91ba930e229 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:07:27.937716 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-0eba293a-1c9b-49e7-ba43-e91ba930e229 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:07:27.937716 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:27.937716 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:27.937716 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:27.937716 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:27.937716 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:27.937716 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:27.937716 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:27.937716 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:27.937716 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:27.937716 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:27.937716 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:27.937716 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:07:27.937716 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:07:27.937716 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:07:27.937716 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:07:27.939119 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:07:27.939119 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:07:27.939119 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:07:27.939119 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:07:27.939119 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:27.939119 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:27.939119 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:27.939119 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:27.939119 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:27.939119 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:27.939119 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:27.939119 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:27.939119 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:27.939119 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:27.939119 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:27.939119 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:27.940030 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:27.940030 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:27.940030 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:27.940030 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:27.940030 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:07:27.940030 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:07:27.940030 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:07:27.940030 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:07:27.940030 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:07:27.940030 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:07:27.940030 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:07:27.940030 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 31 00:07:27.940030 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 311/641] 10.222.0.47 () {56 vars in 1102 bytes} [Wed Aug 31 00:07:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:07:27.940030 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eba293a-1c9b-49e7-ba43-e91ba930e229 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:27.940895 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26a94e1-b9d3-4857-b8e0-da5607e0e0a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:27.941900 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26a94e1-b9d3-4857-b8e0-da5607e0e0a3 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:27.944098 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26a94e1-b9d3-4857-b8e0-da5607e0e0a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:27.944098 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26a94e1-b9d3-4857-b8e0-da5607e0e0a3 None admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:27.944098 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26a94e1-b9d3-4857-b8e0-da5607e0e0a3 None admin] RBAC: Adding query filter params (name=service) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:27.944666 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26a94e1-b9d3-4857-b8e0-da5607e0e0a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:27.947062 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26a94e1-b9d3-4857-b8e0-da5607e0e0a3 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:27.968724 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 331/642] 10.222.0.47 () {56 vars in 1103 bytes} [Wed Aug 31 00:07:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:27.968724 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26a94e1-b9d3-4857-b8e0-da5607e0e0a3 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:28.010876 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:28.074739 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eba293a-1c9b-49e7-ba43-e91ba930e229 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:28.109990 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26a94e1-b9d3-4857-b8e0-da5607e0e0a3 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:28.114769 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1efcad-d2af-48cf-9892-9ffe4e351b78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:28.115390 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1efcad-d2af-48cf-9892-9ffe4e351b78 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:28.115668 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1efcad-d2af-48cf-9892-9ffe4e351b78 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:28.115940 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1efcad-d2af-48cf-9892-9ffe4e351b78 None admin] PATH_INFO: `/v3/domains` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:28.116625 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1efcad-d2af-48cf-9892-9ffe4e351b78 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:28.116928 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1efcad-d2af-48cf-9892-9ffe4e351b78 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:28.118345 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1efcad-d2af-48cf-9892-9ffe4e351b78 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:28.139945 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 312/643] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 31 00:07:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:28.139945 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1efcad-d2af-48cf-9892-9ffe4e351b78 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:28.151300 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b384d4e2-7e88-4111-a8d7-02c1ef54f66a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:28.152067 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b384d4e2-7e88-4111-a8d7-02c1ef54f66a None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:28.152376 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b384d4e2-7e88-4111-a8d7-02c1ef54f66a None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:28.152769 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b384d4e2-7e88-4111-a8d7-02c1ef54f66a None admin] PATH_INFO: `/v3/domains` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:28.153440 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b384d4e2-7e88-4111-a8d7-02c1ef54f66a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:28.153748 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b384d4e2-7e88-4111-a8d7-02c1ef54f66a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:28.155314 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b384d4e2-7e88-4111-a8d7-02c1ef54f66a None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:28.179592 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 332/644] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 31 00:07:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:28.179592 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b384d4e2-7e88-4111-a8d7-02c1ef54f66a None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:28.203689 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:28.275323 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1efcad-d2af-48cf-9892-9ffe4e351b78 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:28.321881 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acbdfda-4714-42e0-af8b-addcb193ab56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:28.323301 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acbdfda-4714-42e0-af8b-addcb193ab56 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:28.323301 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acbdfda-4714-42e0-af8b-addcb193ab56 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:28.323667 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acbdfda-4714-42e0-af8b-addcb193ab56 None admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:28.324430 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acbdfda-4714-42e0-af8b-addcb193ab56 None admin] RBAC: Adding query filter params (name=service) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:28.324953 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acbdfda-4714-42e0-af8b-addcb193ab56 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:28.327341 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acbdfda-4714-42e0-af8b-addcb193ab56 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:28.330146 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:28.343964 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 313/645] 10.222.0.47 () {56 vars in 1103 bytes} [Wed Aug 31 00:07:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:28.346147 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acbdfda-4714-42e0-af8b-addcb193ab56 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:28.356445 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b384d4e2-7e88-4111-a8d7-02c1ef54f66a None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:28.413034 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c80a828-b8da-4d32-887d-b1108d3291e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:28.414029 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c80a828-b8da-4d32-887d-b1108d3291e5 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:28.414490 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c80a828-b8da-4d32-887d-b1108d3291e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:28.414938 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c80a828-b8da-4d32-887d-b1108d3291e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:28.434612 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c80a828-b8da-4d32-887d-b1108d3291e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:28.437108 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c80a828-b8da-4d32-887d-b1108d3291e5 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:28.463464 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-7c80a828-b8da-4d32-887d-b1108d3291e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:07:28.463464 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:28.463464 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:28.463464 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:28.463464 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:28.463464 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:28.463464 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:28.463464 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:28.463464 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:28.463464 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:28.463464 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:28.463464 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:28.463464 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:07:28.463464 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:07:28.463464 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:07:28.463464 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:07:28.466141 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:28.466141 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:28.466141 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:28.466141 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:28.466141 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:28.466141 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:28.466141 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:28.466141 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:28.466141 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:28.466141 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:28.466141 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:28.466141 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:28.466141 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:28.466141 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:28.466141 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:28.466141 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:28.466141 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:07:28.469695 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:07:28.469695 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:07:28.469695 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Aug 31 00:07:28.469695 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 333/646] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 00:07:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:07:28.470142 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c80a828-b8da-4d32-887d-b1108d3291e5 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:28.512609 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acbdfda-4714-42e0-af8b-addcb193ab56 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:28.515641 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:28.571725 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789bbbfd-e4d9-4fb3-a063-94fcbfb4aa0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:28.572428 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789bbbfd-e4d9-4fb3-a063-94fcbfb4aa0c None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:28.572707 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789bbbfd-e4d9-4fb3-a063-94fcbfb4aa0c None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:28.572979 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789bbbfd-e4d9-4fb3-a063-94fcbfb4aa0c None admin] PATH_INFO: `/v3/users/nova` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:28.582050 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789bbbfd-e4d9-4fb3-a063-94fcbfb4aa0c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:28.583827 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789bbbfd-e4d9-4fb3-a063-94fcbfb4aa0c None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:28.600935 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-789bbbfd-e4d9-4fb3-a063-94fcbfb4aa0c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 31 00:07:28.600935 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:28.600935 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:28.600935 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:28.600935 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:28.600935 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:28.600935 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:28.600935 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:28.600935 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:28.600935 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:28.600935 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:28.600935 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:28.600935 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 00:07:28.600935 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 00:07:28.600935 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 00:07:28.600935 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 00:07:28.602008 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:28.602008 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:28.602008 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:07:28.602008 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:07:28.602008 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:07:28.602008 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:07:28.602008 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:28.602008 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:28.602008 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:28.602008 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:28.602008 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:28.602008 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:28.602008 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:28.602008 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:28.602008 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:28.602008 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:28.602008 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:28.602008 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:28.603023 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:28.603023 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:28.603023 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 00:07:28.603023 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 00:07:28.603023 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 00:07:28.603023 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 00:07:28.603023 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 00:07:28.603023 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 00:07:28.603023 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 31 00:07:28.603023 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 31 00:07:28.603023 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 314/647] 10.222.0.47 () {56 vars in 1093 bytes} [Wed Aug 31 00:07:28 2022] GET /identity/v3/users/nova => generated 82 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:07:28.603023 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789bbbfd-e4d9-4fb3-a063-94fcbfb4aa0c None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:28.646855 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c80a828-b8da-4d32-887d-b1108d3291e5 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:28.706999 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0e7c5f-4062-4520-b0e0-b55c3e67c6c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:28.708197 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0e7c5f-4062-4520-b0e0-b55c3e67c6c6 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:28.708377 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0e7c5f-4062-4520-b0e0-b55c3e67c6c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:28.708810 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0e7c5f-4062-4520-b0e0-b55c3e67c6c6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:28.718697 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0e7c5f-4062-4520-b0e0-b55c3e67c6c6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:28.721720 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0e7c5f-4062-4520-b0e0-b55c3e67c6c6 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:28.724552 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:28.739392 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789bbbfd-e4d9-4fb3-a063-94fcbfb4aa0c None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:28.747139 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-5f0e7c5f-4062-4520-b0e0-b55c3e67c6c6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:07:28.747139 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:28.747139 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:28.747139 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:28.747139 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:28.747139 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:28.747139 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:28.747139 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:28.747139 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:28.747139 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:28.747139 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:28.747139 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:28.747139 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 00:07:28.747139 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 00:07:28.747139 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 00:07:28.748444 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 00:07:28.748444 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:28.748444 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:28.748444 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:28.748444 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:28.748444 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:28.748444 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:28.748444 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:28.748444 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:28.748444 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:28.748444 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:28.748444 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:28.748444 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:28.748444 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:28.748444 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:28.748444 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:28.748444 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:28.749529 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 00:07:28.749529 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 00:07:28.749529 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:07:28.749529 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:07:28.749529 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:07:28.749529 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:07:28.749529 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:07:28.749529 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Aug 31 00:07:28.752520 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 334/648] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 31 00:07:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:07:28.754100 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0e7c5f-4062-4520-b0e0-b55c3e67c6c6 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:28.791862 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0311b8-712a-47cb-9a94-77697adffa13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:28.793101 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0311b8-712a-47cb-9a94-77697adffa13 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:28.793431 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0311b8-712a-47cb-9a94-77697adffa13 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:28.793703 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0311b8-712a-47cb-9a94-77697adffa13 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:28.807088 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0311b8-712a-47cb-9a94-77697adffa13 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:28.809407 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0311b8-712a-47cb-9a94-77697adffa13 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:28.825997 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-fd0311b8-712a-47cb-9a94-77697adffa13 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:07:28.825997 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:28.825997 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:28.825997 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:28.825997 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:28.825997 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:28.825997 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:28.825997 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:28.825997 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:28.825997 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:28.825997 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:28.825997 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:28.825997 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:07:28.825997 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:07:28.825997 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:07:28.825997 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:07:28.828192 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:28.828192 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:28.828192 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:28.828192 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:28.828192 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:28.828192 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:28.828192 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:28.828192 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:28.828192 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:28.828192 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:28.828192 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:28.828192 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:28.828192 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:28.828192 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:28.828192 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:28.828192 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:28.828192 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:07:28.830709 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:07:28.830709 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:07:28.830709 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 31 00:07:28.830709 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 315/649] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 00:07:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:07:28.830709 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0311b8-712a-47cb-9a94-77697adffa13 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:28.847931 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:28.928348 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0e7c5f-4062-4520-b0e0-b55c3e67c6c6 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:28.972807 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b374911-086e-4f51-8e80-098a0fc70e62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:28.973322 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b374911-086e-4f51-8e80-098a0fc70e62 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:28.973600 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b374911-086e-4f51-8e80-098a0fc70e62 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:28.973876 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b374911-086e-4f51-8e80-098a0fc70e62 None admin] PATH_INFO: `/v3/domains` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:28.974524 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b374911-086e-4f51-8e80-098a0fc70e62 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:28.974827 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b374911-086e-4f51-8e80-098a0fc70e62 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:28.976220 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b374911-086e-4f51-8e80-098a0fc70e62 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:28.977141 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0311b8-712a-47cb-9a94-77697adffa13 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:28.991495 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 335/650] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 31 00:07:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:28.992908 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b374911-086e-4f51-8e80-098a0fc70e62 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:29.032679 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53c1075-5b60-483d-8b29-829aa689c7f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:29.033298 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53c1075-5b60-483d-8b29-829aa689c7f6 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:29.033733 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53c1075-5b60-483d-8b29-829aa689c7f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:29.034061 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53c1075-5b60-483d-8b29-829aa689c7f6 None admin] PATH_INFO: `/v3/users` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:29.035725 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53c1075-5b60-483d-8b29-829aa689c7f6 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:29.036041 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53c1075-5b60-483d-8b29-829aa689c7f6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:29.037509 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53c1075-5b60-483d-8b29-829aa689c7f6 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:29.063912 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 316/651] 10.222.0.47 () {56 vars in 1133 bytes} [Wed Aug 31 00:07:28 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:29.064788 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53c1075-5b60-483d-8b29-829aa689c7f6 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:29.079674 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:29.133851 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b374911-086e-4f51-8e80-098a0fc70e62 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:29.166066 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:29.183988 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae23710-725d-40c1-8efb-75d80dbe5ef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:29.184648 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae23710-725d-40c1-8efb-75d80dbe5ef1 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:29.184925 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae23710-725d-40c1-8efb-75d80dbe5ef1 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:29.185199 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae23710-725d-40c1-8efb-75d80dbe5ef1 None admin] PATH_INFO: `/v3/projects` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:29.185902 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae23710-725d-40c1-8efb-75d80dbe5ef1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:29.186199 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae23710-725d-40c1-8efb-75d80dbe5ef1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:29.187629 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae23710-725d-40c1-8efb-75d80dbe5ef1 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:29.200531 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 336/652] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Aug 31 00:07:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:29.206001 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae23710-725d-40c1-8efb-75d80dbe5ef1 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:29.217903 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53c1075-5b60-483d-8b29-829aa689c7f6 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:29.282725 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30da2d13-f1e4-4e01-875f-93885d119afe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:29.283681 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30da2d13-f1e4-4e01-875f-93885d119afe None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:29.284209 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30da2d13-f1e4-4e01-875f-93885d119afe None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:29.284956 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30da2d13-f1e4-4e01-875f-93885d119afe None admin] PATH_INFO: `/v3/domains` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:29.286145 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30da2d13-f1e4-4e01-875f-93885d119afe None admin] RBAC: Adding query filter params (name=Default) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:29.286709 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30da2d13-f1e4-4e01-875f-93885d119afe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:29.289360 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30da2d13-f1e4-4e01-875f-93885d119afe None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:29.318806 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 317/653] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 31 00:07:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:29.318806 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30da2d13-f1e4-4e01-875f-93885d119afe None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:29.330504 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae23710-725d-40c1-8efb-75d80dbe5ef1 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:29.370096 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:29.400081 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8778dd7a-b778-4344-a15f-b5fa66dda869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:29.402305 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8778dd7a-b778-4344-a15f-b5fa66dda869 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:29.402716 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8778dd7a-b778-4344-a15f-b5fa66dda869 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:29.403078 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8778dd7a-b778-4344-a15f-b5fa66dda869 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:29.413914 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8778dd7a-b778-4344-a15f-b5fa66dda869 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:29.415376 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8778dd7a-b778-4344-a15f-b5fa66dda869 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:29.428617 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-8778dd7a-b778-4344-a15f-b5fa66dda869 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 31 00:07:29.428617 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:29.428617 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:29.428617 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:29.428617 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:29.428617 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:29.428617 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:29.428617 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:29.428617 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:29.428617 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:29.428617 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:29.428617 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:29.428617 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 00:07:29.428617 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 00:07:29.428617 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 00:07:29.428617 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 00:07:29.430124 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:29.430124 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:29.430124 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:07:29.430124 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:07:29.430124 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:07:29.430124 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:07:29.430124 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:29.430124 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:29.430124 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:29.430124 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:29.430124 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:29.430124 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:29.430124 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:29.430124 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:29.430124 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:29.430124 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:29.430124 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:29.430124 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:29.434558 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:29.434558 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:29.434558 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 00:07:29.434558 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 00:07:29.434558 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 00:07:29.434558 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 00:07:29.434558 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 00:07:29.434558 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 00:07:29.434558 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 31 00:07:29.434558 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Aug 31 00:07:29.434558 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 337/654] 10.222.0.47 () {56 vars in 1102 bytes} [Wed Aug 31 00:07:29 2022] GET /identity/v3/users/neutron => generated 85 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:07:29.436597 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8778dd7a-b778-4344-a15f-b5fa66dda869 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:29.493822 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30da2d13-f1e4-4e01-875f-93885d119afe None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:29.557327 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:29.569544 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41666e0b-7f5f-4bca-88fe-66c8fad26102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:29.570882 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41666e0b-7f5f-4bca-88fe-66c8fad26102 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:29.571542 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41666e0b-7f5f-4bca-88fe-66c8fad26102 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:29.572144 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41666e0b-7f5f-4bca-88fe-66c8fad26102 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:29.572637 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8778dd7a-b778-4344-a15f-b5fa66dda869 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:29.620827 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f9d564-eafb-4f70-a729-1d94b53f9cf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:29.621488 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f9d564-eafb-4f70-a729-1d94b53f9cf5 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:29.621772 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f9d564-eafb-4f70-a729-1d94b53f9cf5 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:29.622080 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f9d564-eafb-4f70-a729-1d94b53f9cf5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:29.622782 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f9d564-eafb-4f70-a729-1d94b53f9cf5 None admin] RBAC: Adding query filter params (role.id=1e6d7ecde4b0415bb944f25eda475f9c, scope.project.id=1b647cccb30a427193fc62dbebe0c6f1, user.id=cc025521e1dc4c91ab50a8718a87754f) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:29.623095 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f9d564-eafb-4f70-a729-1d94b53f9cf5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:29.624606 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f9d564-eafb-4f70-a729-1d94b53f9cf5 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:29.641292 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 338/655] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 31 00:07:29 2022] GET /identity/v3/role_assignments?user.id=cc025521e1dc4c91ab50a8718a87754f&scope.project.id=1b647cccb30a427193fc62dbebe0c6f1&role.id=1e6d7ecde4b0415bb944f25eda475f9c => generated 608 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:29.641292 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f9d564-eafb-4f70-a729-1d94b53f9cf5 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:29.706278 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41666e0b-7f5f-4bca-88fe-66c8fad26102 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:29.707911 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41666e0b-7f5f-4bca-88fe-66c8fad26102 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:29.735280 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:29.824080 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f9d564-eafb-4f70-a729-1d94b53f9cf5 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:29.861584 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 318/656] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 31 00:07:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 548 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 00:07:29.864411 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41666e0b-7f5f-4bca-88fe-66c8fad26102 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:29.880290 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb92d74-8ebe-4f2c-aa7c-d1aa6c201eaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:29.881094 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb92d74-8ebe-4f2c-aa7c-d1aa6c201eaa None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:29.881993 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb92d74-8ebe-4f2c-aa7c-d1aa6c201eaa None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:29.881993 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb92d74-8ebe-4f2c-aa7c-d1aa6c201eaa None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:29.890746 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb92d74-8ebe-4f2c-aa7c-d1aa6c201eaa None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:29.892376 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb92d74-8ebe-4f2c-aa7c-d1aa6c201eaa None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:29.906052 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-3eb92d74-8ebe-4f2c-aa7c-d1aa6c201eaa None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 31 00:07:29.906052 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:29.906052 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:29.906052 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:29.906052 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:29.906052 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:29.906052 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:29.906052 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:29.906052 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:29.906052 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:29.906052 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:29.906052 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:29.906052 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 00:07:29.906052 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 00:07:29.906052 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 00:07:29.906052 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 00:07:29.908029 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:29.908029 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:29.908029 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:07:29.908029 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:07:29.908029 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:07:29.908029 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:07:29.908029 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:29.908029 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:29.908029 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:29.908029 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:29.908029 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:29.908029 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:29.908029 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:29.908029 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:29.908029 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:29.908029 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:29.908029 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:29.908029 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:29.910444 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:29.910444 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:29.910444 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 00:07:29.910444 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 00:07:29.910444 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 00:07:29.910444 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 00:07:29.910444 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 00:07:29.910444 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 00:07:29.910444 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 31 00:07:29.910444 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Aug 31 00:07:29.910444 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 339/657] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 31 00:07:29 2022] GET /identity/v3/users/cinder => generated 84 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:07:29.910444 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca88a690-dd2d-4461-b295-7ddcff25ba0b None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:29.910444 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca88a690-dd2d-4461-b295-7ddcff25ba0b None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:29.912039 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca88a690-dd2d-4461-b295-7ddcff25ba0b None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:29.912039 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 340/658] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 00:07:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:07:29.912039 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca88a690-dd2d-4461-b295-7ddcff25ba0b None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:29.919921 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:30.016638 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41666e0b-7f5f-4bca-88fe-66c8fad26102 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:30.057398 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774ad7d2-84a8-4afd-b4ea-2d7384de9f1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:30.058876 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774ad7d2-84a8-4afd-b4ea-2d7384de9f1d None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:30.059437 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774ad7d2-84a8-4afd-b4ea-2d7384de9f1d None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:30.059890 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774ad7d2-84a8-4afd-b4ea-2d7384de9f1d None admin] PATH_INFO: `/v3/users` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:30.060994 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774ad7d2-84a8-4afd-b4ea-2d7384de9f1d None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:30.061567 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774ad7d2-84a8-4afd-b4ea-2d7384de9f1d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:30.063106 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774ad7d2-84a8-4afd-b4ea-2d7384de9f1d None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:30.078540 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca88a690-dd2d-4461-b295-7ddcff25ba0b None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:30.081309 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:30.083941 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 319/659] 10.222.0.47 () {56 vars in 1139 bytes} [Wed Aug 31 00:07:29 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:30.085507 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774ad7d2-84a8-4afd-b4ea-2d7384de9f1d None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:30.143867 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b911b932-dff1-4427-b61c-04b634ad4cd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:30.145441 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b911b932-dff1-4427-b61c-04b634ad4cd2 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:30.146205 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b911b932-dff1-4427-b61c-04b634ad4cd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:30.146895 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b911b932-dff1-4427-b61c-04b634ad4cd2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:30.163778 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b911b932-dff1-4427-b61c-04b634ad4cd2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:30.166370 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b911b932-dff1-4427-b61c-04b634ad4cd2 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:30.191196 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-b911b932-dff1-4427-b61c-04b634ad4cd2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:07:30.191196 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:30.191196 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:30.191196 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:30.191196 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:30.191196 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:30.191196 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:30.191196 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:30.191196 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:30.191196 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:30.191196 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:30.191196 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:30.191196 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:07:30.191196 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:07:30.191196 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:07:30.191196 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:07:30.192318 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:30.192318 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:30.192318 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:30.192318 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:30.192318 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:30.192318 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:30.192318 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:30.192318 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:30.192318 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:30.192318 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:30.192318 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:30.192318 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:30.192318 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:30.192318 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:30.192318 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:30.192318 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:30.192318 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:07:30.193840 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:07:30.193840 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:07:30.193840 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Aug 31 00:07:30.193840 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 341/660] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 00:07:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:07:30.195330 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2305536e-9288-4286-8356-67c1cafd4789 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:30.195458 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2305536e-9288-4286-8356-67c1cafd4789 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:30.195934 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2305536e-9288-4286-8356-67c1cafd4789 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:30.216084 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:30.219914 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-2305536e-9288-4286-8356-67c1cafd4789 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:07:30.221656 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-2305536e-9288-4286-8356-67c1cafd4789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:07:30.229324 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774ad7d2-84a8-4afd-b4ea-2d7384de9f1d None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:30.278319 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff11b71-3562-47a8-a854-3dfd4a48985f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:30.279275 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff11b71-3562-47a8-a854-3dfd4a48985f None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:30.279715 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff11b71-3562-47a8-a854-3dfd4a48985f None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:30.280144 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff11b71-3562-47a8-a854-3dfd4a48985f None admin] PATH_INFO: `/v3/users` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:30.281437 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff11b71-3562-47a8-a854-3dfd4a48985f None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:30.281918 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff11b71-3562-47a8-a854-3dfd4a48985f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:30.284717 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff11b71-3562-47a8-a854-3dfd4a48985f None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:30.313650 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 320/661] 10.222.0.47 () {56 vars in 1137 bytes} [Wed Aug 31 00:07:30 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:30.315084 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff11b71-3562-47a8-a854-3dfd4a48985f None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:30.325682 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 342/662] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 00:07:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:07:30.327698 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2305536e-9288-4286-8356-67c1cafd4789 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:30.493428 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff11b71-3562-47a8-a854-3dfd4a48985f None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:30.499321 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:30.528251 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2305536e-9288-4286-8356-67c1cafd4789 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:30.549639 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8588ed90-6f4b-4414-96f8-d959ec0fbd2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:30.551145 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8588ed90-6f4b-4414-96f8-d959ec0fbd2b None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:30.551660 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8588ed90-6f4b-4414-96f8-d959ec0fbd2b None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:30.552263 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8588ed90-6f4b-4414-96f8-d959ec0fbd2b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:30.590005 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:30.596569 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093ed94c-0f81-43ca-8add-28bf5693cbff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:30.599192 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093ed94c-0f81-43ca-8add-28bf5693cbff None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:30.600298 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093ed94c-0f81-43ca-8add-28bf5693cbff None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:30.601044 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093ed94c-0f81-43ca-8add-28bf5693cbff None admin] PATH_INFO: `/v3/domains` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:30.602516 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093ed94c-0f81-43ca-8add-28bf5693cbff None admin] RBAC: Adding query filter params (name=Default) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:30.603417 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093ed94c-0f81-43ca-8add-28bf5693cbff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:30.606304 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093ed94c-0f81-43ca-8add-28bf5693cbff None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:30.632690 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 343/663] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 31 00:07:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:30.634718 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093ed94c-0f81-43ca-8add-28bf5693cbff None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:30.684916 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8588ed90-6f4b-4414-96f8-d959ec0fbd2b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:30.687598 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8588ed90-6f4b-4414-96f8-d959ec0fbd2b None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:30.832338 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093ed94c-0f81-43ca-8add-28bf5693cbff None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:30.874049 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 321/664] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 31 00:07:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 559 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 00:07:30.875070 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8588ed90-6f4b-4414-96f8-d959ec0fbd2b None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:30.896014 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67721d87-672f-4207-a9fb-1cdc9cb6c86f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:30.897213 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67721d87-672f-4207-a9fb-1cdc9cb6c86f None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:30.897710 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67721d87-672f-4207-a9fb-1cdc9cb6c86f None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:30.898193 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67721d87-672f-4207-a9fb-1cdc9cb6c86f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:30.926739 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:30.950410 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:31.033279 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8588ed90-6f4b-4414-96f8-d959ec0fbd2b None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:31.047736 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67721d87-672f-4207-a9fb-1cdc9cb6c86f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:31.050458 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67721d87-672f-4207-a9fb-1cdc9cb6c86f None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:31.078628 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74b93da-6cea-483e-987e-2006e1a98720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:31.079577 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74b93da-6cea-483e-987e-2006e1a98720 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:31.079577 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74b93da-6cea-483e-987e-2006e1a98720 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:31.079858 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74b93da-6cea-483e-987e-2006e1a98720 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:31.087600 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74b93da-6cea-483e-987e-2006e1a98720 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:31.089070 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74b93da-6cea-483e-987e-2006e1a98720 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:31.102210 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-f74b93da-6cea-483e-987e-2006e1a98720 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:07:31.102210 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:31.102210 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:31.102210 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:31.102210 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:31.102210 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:31.102210 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:31.102210 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:31.102210 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:31.102210 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:31.102210 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:31.102210 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:31.102210 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 00:07:31.102210 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 00:07:31.102210 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 00:07:31.103933 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 00:07:31.103933 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:31.103933 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:31.103933 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:31.103933 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:31.103933 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:31.103933 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:31.103933 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:31.103933 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:31.103933 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:31.103933 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:31.103933 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:31.103933 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:31.103933 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:31.103933 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:31.103933 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:31.103933 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:31.105753 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 00:07:31.105753 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 00:07:31.105753 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:07:31.105753 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:07:31.105753 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:07:31.105753 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:07:31.105753 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:07:31.105753 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 31 00:07:31.105753 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 322/665] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 31 00:07:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:07:31.105753 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74b93da-6cea-483e-987e-2006e1a98720 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:31.252774 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 344/666] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 31 00:07:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 619 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 00:07:31.253721 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74b93da-6cea-483e-987e-2006e1a98720 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:31.254271 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67721d87-672f-4207-a9fb-1cdc9cb6c86f None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:31.264923 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:31.303097 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdd91ea-c850-4bad-a187-131e1a6768bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:31.303729 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdd91ea-c850-4bad-a187-131e1a6768bb None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:31.304363 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdd91ea-c850-4bad-a187-131e1a6768bb None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:31.304363 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdd91ea-c850-4bad-a187-131e1a6768bb None admin] PATH_INFO: `/v3/roles/service` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:31.316900 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdd91ea-c850-4bad-a187-131e1a6768bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:07:31.322854 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-1fdd91ea-c850-4bad-a187-131e1a6768bb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:07:31.322854 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:31.322854 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:31.322854 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:31.322854 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:31.322854 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:31.322854 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:31.322854 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:31.322854 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:31.322854 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:31.322854 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:31.322854 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:31.322854 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:07:31.322854 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:07:31.322854 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:07:31.322854 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:07:31.324958 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:07:31.324958 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:07:31.324958 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:07:31.324958 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:07:31.324958 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:31.324958 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:31.324958 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:31.324958 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:31.324958 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:31.324958 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:31.324958 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:31.324958 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:31.324958 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:31.324958 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:31.324958 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:31.324958 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:31.326214 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:31.326214 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:31.326214 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:31.326214 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:31.326214 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:07:31.326214 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:07:31.326214 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:07:31.326214 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:07:31.326214 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:07:31.326214 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:07:31.326214 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:07:31.326214 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 31 00:07:31.326214 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 323/667] 10.222.0.47 () {56 vars in 1102 bytes} [Wed Aug 31 00:07:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:07:31.326214 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdd91ea-c850-4bad-a187-131e1a6768bb None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:31.338750 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:31.433420 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67721d87-672f-4207-a9fb-1cdc9cb6c86f None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:31.466979 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdd91ea-c850-4bad-a187-131e1a6768bb None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:31.476715 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb119e0-ef77-4320-ac5e-fc54dac6136d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:31.477717 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb119e0-ef77-4320-ac5e-fc54dac6136d None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:31.478201 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb119e0-ef77-4320-ac5e-fc54dac6136d None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:31.478676 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb119e0-ef77-4320-ac5e-fc54dac6136d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:31.493311 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb119e0-ef77-4320-ac5e-fc54dac6136d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:31.497064 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb119e0-ef77-4320-ac5e-fc54dac6136d None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:31.519639 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1410d34-d6d4-4ad9-9c7d-3386fd623d51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:31.520299 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1410d34-d6d4-4ad9-9c7d-3386fd623d51 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:31.520587 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1410d34-d6d4-4ad9-9c7d-3386fd623d51 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:31.520859 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1410d34-d6d4-4ad9-9c7d-3386fd623d51 None admin] PATH_INFO: `/v3/projects` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:31.521566 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1410d34-d6d4-4ad9-9c7d-3386fd623d51 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:31.521874 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1410d34-d6d4-4ad9-9c7d-3386fd623d51 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:31.522629 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-beb119e0-ef77-4320-ac5e-fc54dac6136d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:07:31.522629 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:31.522629 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:31.522629 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:31.522629 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:31.522629 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:31.522629 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:31.522629 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:31.522629 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:31.522629 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:31.522629 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:31.522629 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:31.522629 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:07:31.522629 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:07:31.522629 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:07:31.522629 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:07:31.523832 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:31.523832 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:31.523832 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:31.523832 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:31.523832 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:31.523832 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:31.523832 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:31.523832 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:31.523832 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:31.523832 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:31.523832 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:31.523832 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:31.523832 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:31.523832 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:31.523832 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:31.523832 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:31.523832 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:07:31.532694 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:07:31.532694 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:07:31.532694 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Aug 31 00:07:31.532926 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1410d34-d6d4-4ad9-9c7d-3386fd623d51 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:31.533059 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 345/668] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 00:07:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:07:31.533059 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb119e0-ef77-4320-ac5e-fc54dac6136d None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:31.550929 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 324/669] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Aug 31 00:07:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:31.552461 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1410d34-d6d4-4ad9-9c7d-3386fd623d51 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:31.595244 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:31.661492 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:31.669280 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb119e0-ef77-4320-ac5e-fc54dac6136d None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:31.698370 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1410d34-d6d4-4ad9-9c7d-3386fd623d51 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:31.713530 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366c5e78-bb88-415f-bb32-4ffc9a35584b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:31.714736 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366c5e78-bb88-415f-bb32-4ffc9a35584b None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:31.715021 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366c5e78-bb88-415f-bb32-4ffc9a35584b None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:31.715338 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366c5e78-bb88-415f-bb32-4ffc9a35584b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:31.728912 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366c5e78-bb88-415f-bb32-4ffc9a35584b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:31.731056 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366c5e78-bb88-415f-bb32-4ffc9a35584b None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:31.743758 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5499de7f-23e9-41e2-9896-d1c75544d195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:31.744770 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5499de7f-23e9-41e2-9896-d1c75544d195 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:31.745747 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5499de7f-23e9-41e2-9896-d1c75544d195 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:31.746173 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5499de7f-23e9-41e2-9896-d1c75544d195 None admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:31.747093 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5499de7f-23e9-41e2-9896-d1c75544d195 None admin] RBAC: Adding query filter params (name=service) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:31.747585 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5499de7f-23e9-41e2-9896-d1c75544d195 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:31.748496 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-366c5e78-bb88-415f-bb32-4ffc9a35584b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:07:31.748496 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:31.748496 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:31.748496 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:31.748496 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:31.748496 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:31.748496 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:31.748496 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:31.748496 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:31.748496 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:31.748496 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:31.748496 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:31.748496 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:07:31.748496 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:07:31.748496 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:07:31.748496 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:07:31.749615 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:31.749615 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:31.749615 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:31.749615 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:31.749615 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:31.749615 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:31.749615 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:31.749615 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:31.749615 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:31.749615 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:31.749615 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:31.749615 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:31.749615 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:31.749615 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:31.749615 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:31.749615 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:31.749615 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:07:31.750651 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:07:31.750651 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:07:31.750651 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Aug 31 00:07:31.751871 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5499de7f-23e9-41e2-9896-d1c75544d195 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:31.754663 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 346/670] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 00:07:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:07:31.755665 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366c5e78-bb88-415f-bb32-4ffc9a35584b None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:31.763213 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 325/671] 10.222.0.47 () {56 vars in 1103 bytes} [Wed Aug 31 00:07:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:31.764381 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5499de7f-23e9-41e2-9896-d1c75544d195 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:31.878214 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366c5e78-bb88-415f-bb32-4ffc9a35584b None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:31.883997 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:31.902409 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5499de7f-23e9-41e2-9896-d1c75544d195 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:31.920870 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d3cd59-4622-4118-ac3a-672971a8b1ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:31.921492 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d3cd59-4622-4118-ac3a-672971a8b1ae None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:31.921768 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d3cd59-4622-4118-ac3a-672971a8b1ae None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:31.922046 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d3cd59-4622-4118-ac3a-672971a8b1ae None admin] PATH_INFO: `/v3/domains` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:31.922695 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d3cd59-4622-4118-ac3a-672971a8b1ae None admin] RBAC: Adding query filter params (name=Default) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:31.922995 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d3cd59-4622-4118-ac3a-672971a8b1ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:31.924413 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d3cd59-4622-4118-ac3a-672971a8b1ae None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:31.937838 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 347/672] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 31 00:07:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:31.938704 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d3cd59-4622-4118-ac3a-672971a8b1ae None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:31.952213 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:31.955409 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41aea2af-a977-4cc3-8040-63260713d531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:31.956360 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aea2af-a977-4cc3-8040-63260713d531 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:31.956829 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aea2af-a977-4cc3-8040-63260713d531 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:31.957241 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aea2af-a977-4cc3-8040-63260713d531 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:31.958231 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41aea2af-a977-4cc3-8040-63260713d531 None admin] RBAC: Adding query filter params (role.id=1e6d7ecde4b0415bb944f25eda475f9c, scope.project.id=1b647cccb30a427193fc62dbebe0c6f1, user.id=9ea002bf49c248dbae7147665fa10fd1) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:31.958714 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41aea2af-a977-4cc3-8040-63260713d531 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:31.960590 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41aea2af-a977-4cc3-8040-63260713d531 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:31.968108 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 326/673] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 31 00:07:31 2022] GET /identity/v3/role_assignments?user.id=9ea002bf49c248dbae7147665fa10fd1&scope.project.id=1b647cccb30a427193fc62dbebe0c6f1&role.id=1e6d7ecde4b0415bb944f25eda475f9c => generated 608 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:31.969253 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41aea2af-a977-4cc3-8040-63260713d531 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:32.124771 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d3cd59-4622-4118-ac3a-672971a8b1ae None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:32.141164 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41aea2af-a977-4cc3-8040-63260713d531 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:32.189617 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8e3107-8a57-48dc-998f-3b4ef9805866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:32.190247 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8e3107-8a57-48dc-998f-3b4ef9805866 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:32.190530 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8e3107-8a57-48dc-998f-3b4ef9805866 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:32.190802 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8e3107-8a57-48dc-998f-3b4ef9805866 None admin] PATH_INFO: `/v3/domains` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:32.191472 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8e3107-8a57-48dc-998f-3b4ef9805866 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:32.191773 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8e3107-8a57-48dc-998f-3b4ef9805866 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:32.193190 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8e3107-8a57-48dc-998f-3b4ef9805866 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:32.199847 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ddb127-c472-4b4b-bf17-e7cafe886887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:32.200864 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ddb127-c472-4b4b-bf17-e7cafe886887 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:32.201285 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ddb127-c472-4b4b-bf17-e7cafe886887 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:32.201697 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ddb127-c472-4b4b-bf17-e7cafe886887 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:32.207925 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 348/674] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 31 00:07:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:32.209266 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9b4b53-da4a-462e-b32c-75b189ecf02a None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:32.209550 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9b4b53-da4a-462e-b32c-75b189ecf02a None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:32.209833 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9b4b53-da4a-462e-b32c-75b189ecf02a None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:32.211097 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 349/675] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 00:07:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:07:32.211822 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9b4b53-da4a-462e-b32c-75b189ecf02a None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:32.220173 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ddb127-c472-4b4b-bf17-e7cafe886887 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:32.222220 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ddb127-c472-4b4b-bf17-e7cafe886887 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:32.241766 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-37ddb127-c472-4b4b-bf17-e7cafe886887 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:07:32.241766 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:32.241766 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:32.241766 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:32.241766 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:32.241766 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:32.241766 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:32.241766 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:32.241766 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:32.241766 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:32.241766 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:32.241766 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:32.241766 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:07:32.241766 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:07:32.241766 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:07:32.241766 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:07:32.242805 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:32.242805 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:32.242805 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:32.242805 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:32.242805 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:32.242805 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:32.242805 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:32.242805 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:32.242805 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:32.242805 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:32.242805 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:32.242805 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:32.242805 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:32.242805 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:32.242805 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:32.242805 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:32.242805 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:07:32.243751 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:07:32.243751 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:07:32.243751 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 31 00:07:32.243751 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 327/676] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 00:07:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:07:32.243995 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ddb127-c472-4b4b-bf17-e7cafe886887 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:32.257840 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:32.329978 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:32.390267 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9b4b53-da4a-462e-b32c-75b189ecf02a None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:32.397141 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ddb127-c472-4b4b-bf17-e7cafe886887 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:32.438587 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d2effd-114b-410b-92a0-ae481899fc2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:32.439240 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d2effd-114b-410b-92a0-ae481899fc2d None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:32.439518 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d2effd-114b-410b-92a0-ae481899fc2d None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:32.439853 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d2effd-114b-410b-92a0-ae481899fc2d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:32.449519 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d2effd-114b-410b-92a0-ae481899fc2d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:32.450595 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d2effd-114b-410b-92a0-ae481899fc2d None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:32.465405 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-15d2effd-114b-410b-92a0-ae481899fc2d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:07:32.465405 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:32.465405 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:32.465405 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:32.465405 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:32.465405 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:32.465405 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:32.465405 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:32.465405 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:32.465405 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:32.465405 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:32.465405 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:32.465405 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 00:07:32.465405 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 00:07:32.465405 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 00:07:32.466944 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 00:07:32.466944 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:32.466944 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:32.466944 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:32.466944 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:32.466944 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:32.466944 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:32.466944 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:32.466944 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:32.466944 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:32.466944 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:32.466944 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:32.466944 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:32.466944 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:32.466944 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:32.466944 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:32.466944 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:32.467891 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 00:07:32.467891 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 00:07:32.467891 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:07:32.467891 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:07:32.467891 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:07:32.467891 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:07:32.467891 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:07:32.467891 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Aug 31 00:07:32.467891 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 350/677] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 31 00:07:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:07:32.469003 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28ec21d-c75a-42f8-972b-75187b1a652c None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:32.469003 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28ec21d-c75a-42f8-972b-75187b1a652c None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:32.469003 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28ec21d-c75a-42f8-972b-75187b1a652c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:32.478178 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1d85b1-ee32-437f-9f0d-e3b809ddd913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:32.479165 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1d85b1-ee32-437f-9f0d-e3b809ddd913 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:32.480293 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1d85b1-ee32-437f-9f0d-e3b809ddd913 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:32.480764 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1d85b1-ee32-437f-9f0d-e3b809ddd913 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:32.490635 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-f28ec21d-c75a-42f8-972b-75187b1a652c None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:07:32.491854 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-f28ec21d-c75a-42f8-972b-75187b1a652c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:07:32.493359 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1d85b1-ee32-437f-9f0d-e3b809ddd913 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:32.496495 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1d85b1-ee32-437f-9f0d-e3b809ddd913 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:32.517845 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-fb1d85b1-ee32-437f-9f0d-e3b809ddd913 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:07:32.517845 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:32.517845 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:32.517845 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:32.517845 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:32.517845 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:32.517845 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:32.517845 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:32.517845 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:32.517845 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:32.517845 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:32.517845 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:32.517845 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 00:07:32.517845 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 00:07:32.517845 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 00:07:32.518997 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 00:07:32.518997 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:32.518997 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:32.518997 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:32.518997 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:32.518997 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:32.518997 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:32.518997 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:32.518997 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:32.518997 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:32.518997 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:32.518997 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:32.518997 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:32.518997 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:32.518997 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:32.518997 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:32.518997 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:32.520076 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 00:07:32.520076 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 00:07:32.520076 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:07:32.520076 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:07:32.520076 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:07:32.520076 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:07:32.520076 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:07:32.520076 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 31 00:07:32.527651 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 328/678] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 31 00:07:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:07:32.529209 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1d85b1-ee32-437f-9f0d-e3b809ddd913 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:32.589563 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 351/679] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 00:07:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:07:32.591230 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28ec21d-c75a-42f8-972b-75187b1a652c None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:32.657999 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:32.712318 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:32.727470 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1d85b1-ee32-437f-9f0d-e3b809ddd913 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:32.772115 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28ec21d-c75a-42f8-972b-75187b1a652c None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:32.801540 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6740870c-e6d2-4cb5-9b4e-79425c943ee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:32.802920 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6740870c-e6d2-4cb5-9b4e-79425c943ee6 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:32.803420 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6740870c-e6d2-4cb5-9b4e-79425c943ee6 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:32.803920 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6740870c-e6d2-4cb5-9b4e-79425c943ee6 None admin] PATH_INFO: `/v3/domains` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:32.805174 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6740870c-e6d2-4cb5-9b4e-79425c943ee6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:32.805731 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6740870c-e6d2-4cb5-9b4e-79425c943ee6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:32.810263 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6740870c-e6d2-4cb5-9b4e-79425c943ee6 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:32.821629 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e42e6a-67c1-40f4-a5d5-ce5ed7f155f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:32.822672 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e42e6a-67c1-40f4-a5d5-ce5ed7f155f1 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:32.823183 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e42e6a-67c1-40f4-a5d5-ce5ed7f155f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:32.824299 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e42e6a-67c1-40f4-a5d5-ce5ed7f155f1 None admin] PATH_INFO: `/v3/projects` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:32.825284 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e42e6a-67c1-40f4-a5d5-ce5ed7f155f1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:32.825830 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e42e6a-67c1-40f4-a5d5-ce5ed7f155f1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:32.828471 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e42e6a-67c1-40f4-a5d5-ce5ed7f155f1 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:32.833693 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 329/680] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 31 00:07:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:32.835448 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6740870c-e6d2-4cb5-9b4e-79425c943ee6 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:32.858656 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 352/681] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Aug 31 00:07:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:32.860388 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e42e6a-67c1-40f4-a5d5-ce5ed7f155f1 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:32.971652 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6740870c-e6d2-4cb5-9b4e-79425c943ee6 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:33.009589 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:33.019913 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f42720-4297-4bc7-baf7-ca70bda7f6c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:33.020595 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f42720-4297-4bc7-baf7-ca70bda7f6c3 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:33.020870 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f42720-4297-4bc7-baf7-ca70bda7f6c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:33.021137 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f42720-4297-4bc7-baf7-ca70bda7f6c3 None admin] PATH_INFO: `/v3/projects` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:33.021749 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e42e6a-67c1-40f4-a5d5-ce5ed7f155f1 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:33.022446 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f42720-4297-4bc7-baf7-ca70bda7f6c3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:33.022446 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f42720-4297-4bc7-baf7-ca70bda7f6c3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:33.023579 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f42720-4297-4bc7-baf7-ca70bda7f6c3 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:33.036553 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 330/682] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Aug 31 00:07:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:33.037224 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f42720-4297-4bc7-baf7-ca70bda7f6c3 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:33.046641 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:33.069629 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7861203b-2d09-40a1-9d55-7efae495c788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:33.070250 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7861203b-2d09-40a1-9d55-7efae495c788 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:33.070530 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7861203b-2d09-40a1-9d55-7efae495c788 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:33.070803 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7861203b-2d09-40a1-9d55-7efae495c788 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:33.079397 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7861203b-2d09-40a1-9d55-7efae495c788 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:33.080912 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7861203b-2d09-40a1-9d55-7efae495c788 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:33.093356 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-7861203b-2d09-40a1-9d55-7efae495c788 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 31 00:07:33.093356 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:33.093356 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:33.093356 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:33.093356 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:33.093356 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:33.093356 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:33.093356 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:33.093356 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:33.093356 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:33.093356 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:33.093356 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:33.093356 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 00:07:33.093356 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 00:07:33.093356 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 00:07:33.093356 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 00:07:33.094447 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:33.094447 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:33.094447 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:07:33.094447 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:07:33.094447 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:07:33.094447 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:07:33.094447 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:33.094447 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:33.094447 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:33.094447 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:33.094447 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:33.094447 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:33.094447 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:33.094447 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:33.094447 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:33.094447 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:33.094447 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:33.094447 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:33.095468 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:33.095468 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:33.095468 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 00:07:33.095468 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 00:07:33.095468 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 00:07:33.095468 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 00:07:33.095468 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 00:07:33.095468 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 00:07:33.095468 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 31 00:07:33.095468 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Aug 31 00:07:33.099137 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 353/683] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Aug 31 00:07:32 2022] GET /identity/v3/users/swift => generated 83 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:07:33.100058 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7861203b-2d09-40a1-9d55-7efae495c788 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:33.169722 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f42720-4297-4bc7-baf7-ca70bda7f6c3 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:33.211092 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b332dd-1c76-455f-a0fe-b5e82ba057c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:33.211708 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b332dd-1c76-455f-a0fe-b5e82ba057c5 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:33.211994 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b332dd-1c76-455f-a0fe-b5e82ba057c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:33.212392 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b332dd-1c76-455f-a0fe-b5e82ba057c5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:33.213142 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b332dd-1c76-455f-a0fe-b5e82ba057c5 None admin] RBAC: Adding query filter params (role.id=1e6d7ecde4b0415bb944f25eda475f9c, scope.project.id=1b647cccb30a427193fc62dbebe0c6f1, user.id=daae792cd11d4c4ca7aae0558998aced) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:33.213448 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b332dd-1c76-455f-a0fe-b5e82ba057c5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:33.215929 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b332dd-1c76-455f-a0fe-b5e82ba057c5 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:33.224384 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7861203b-2d09-40a1-9d55-7efae495c788 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:33.236375 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 331/684] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 31 00:07:33 2022] GET /identity/v3/role_assignments?user.id=daae792cd11d4c4ca7aae0558998aced&scope.project.id=1b647cccb30a427193fc62dbebe0c6f1&role.id=1e6d7ecde4b0415bb944f25eda475f9c => generated 608 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:33.237397 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b332dd-1c76-455f-a0fe-b5e82ba057c5 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:33.281675 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279d83cf-8501-4d7c-b756-39f61efdd4c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:33.283524 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279d83cf-8501-4d7c-b756-39f61efdd4c1 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:33.284051 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279d83cf-8501-4d7c-b756-39f61efdd4c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:33.284829 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279d83cf-8501-4d7c-b756-39f61efdd4c1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:33.302417 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279d83cf-8501-4d7c-b756-39f61efdd4c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:33.304237 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279d83cf-8501-4d7c-b756-39f61efdd4c1 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:33.320990 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:33.343335 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-279d83cf-8501-4d7c-b756-39f61efdd4c1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:07:33.343335 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:33.343335 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:33.343335 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:33.343335 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:33.343335 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:33.343335 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:33.343335 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:33.343335 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:33.343335 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:33.343335 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:33.343335 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:33.343335 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:07:33.343335 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:07:33.343335 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:07:33.343335 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:07:33.344506 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:33.344506 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:33.344506 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:33.344506 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:33.344506 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:33.344506 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:33.344506 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:33.344506 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:33.344506 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:33.344506 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:33.344506 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:33.344506 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:33.344506 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:33.344506 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:33.344506 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:33.344506 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:33.344506 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:07:33.345574 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:07:33.345574 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:07:33.345574 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Aug 31 00:07:33.345574 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 354/685] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 00:07:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:07:33.345903 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279d83cf-8501-4d7c-b756-39f61efdd4c1 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:33.387689 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:33.400968 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b332dd-1c76-455f-a0fe-b5e82ba057c5 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:33.455968 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa3872e-32e5-420b-b321-2903f3528a42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:33.456692 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa3872e-32e5-420b-b321-2903f3528a42 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:33.456987 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa3872e-32e5-420b-b321-2903f3528a42 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:33.457551 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa3872e-32e5-420b-b321-2903f3528a42 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:33.458367 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa3872e-32e5-420b-b321-2903f3528a42 None admin] RBAC: Adding query filter params (role.id=1e6d7ecde4b0415bb944f25eda475f9c, scope.project.id=1b647cccb30a427193fc62dbebe0c6f1, user.id=beecda6e9feb400288618745c784989f) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:33.458681 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa3872e-32e5-420b-b321-2903f3528a42 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:33.460590 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa3872e-32e5-420b-b321-2903f3528a42 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:33.474646 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 332/686] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 31 00:07:33 2022] GET /identity/v3/role_assignments?user.id=beecda6e9feb400288618745c784989f&scope.project.id=1b647cccb30a427193fc62dbebe0c6f1&role.id=1e6d7ecde4b0415bb944f25eda475f9c => generated 608 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:33.475836 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa3872e-32e5-420b-b321-2903f3528a42 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:33.497522 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279d83cf-8501-4d7c-b756-39f61efdd4c1 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:33.549366 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249ee835-08e1-4ee3-a85d-9a690241c81c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:33.550060 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249ee835-08e1-4ee3-a85d-9a690241c81c None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:33.550355 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249ee835-08e1-4ee3-a85d-9a690241c81c None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:33.550622 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249ee835-08e1-4ee3-a85d-9a690241c81c None admin] PATH_INFO: `/v3/users` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:33.551406 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249ee835-08e1-4ee3-a85d-9a690241c81c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:33.551706 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249ee835-08e1-4ee3-a85d-9a690241c81c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:33.553292 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249ee835-08e1-4ee3-a85d-9a690241c81c None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:33.587486 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 355/687] 10.222.0.47 () {56 vars in 1135 bytes} [Wed Aug 31 00:07:33 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:33.596194 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249ee835-08e1-4ee3-a85d-9a690241c81c None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:33.619865 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa3872e-32e5-420b-b321-2903f3528a42 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:33.638615 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:33.664870 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c41b33a-81b0-4d55-aca4-d8d8c0dd2c95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:33.665833 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c41b33a-81b0-4d55-aca4-d8d8c0dd2c95 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:33.666299 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c41b33a-81b0-4d55-aca4-d8d8c0dd2c95 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:33.666802 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c41b33a-81b0-4d55-aca4-d8d8c0dd2c95 None admin] PATH_INFO: `/v3/domains` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:33.668408 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c41b33a-81b0-4d55-aca4-d8d8c0dd2c95 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:33.668937 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c41b33a-81b0-4d55-aca4-d8d8c0dd2c95 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:33.670540 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c41b33a-81b0-4d55-aca4-d8d8c0dd2c95 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:33.686785 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 333/688] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 31 00:07:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:33.697813 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c41b33a-81b0-4d55-aca4-d8d8c0dd2c95 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:33.798303 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:33.826147 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249ee835-08e1-4ee3-a85d-9a690241c81c None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:33.905263 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9223dd21-1a59-4031-8168-8289d66c3be7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:33.906349 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9223dd21-1a59-4031-8168-8289d66c3be7 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:33.906961 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9223dd21-1a59-4031-8168-8289d66c3be7 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:33.907443 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9223dd21-1a59-4031-8168-8289d66c3be7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:33.979074 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c41b33a-81b0-4d55-aca4-d8d8c0dd2c95 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:34.058968 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17464abc-c74d-415d-b3bc-2acab6c3f1ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:34.059613 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9223dd21-1a59-4031-8168-8289d66c3be7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:34.060049 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17464abc-c74d-415d-b3bc-2acab6c3f1ed None admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:34.060437 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17464abc-c74d-415d-b3bc-2acab6c3f1ed None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:34.060908 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17464abc-c74d-415d-b3bc-2acab6c3f1ed None admin] PATH_INFO: `/v3/users` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:34.062075 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17464abc-c74d-415d-b3bc-2acab6c3f1ed None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:34.062263 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9223dd21-1a59-4031-8168-8289d66c3be7 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:34.065010 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17464abc-c74d-415d-b3bc-2acab6c3f1ed None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:34.111101 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 334/689] 10.222.0.47 () {60 vars in 1132 bytes} [Wed Aug 31 00:07:33 2022] POST /identity/v3/users => generated 254 bytes in 414 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:07:34.246953 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:34.279135 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 356/690] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 31 00:07:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 684 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 31 00:07:34.289097 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17464abc-c74d-415d-b3bc-2acab6c3f1ed None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:34.369388 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:34.523000 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17464abc-c74d-415d-b3bc-2acab6c3f1ed None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:34.589868 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da880218-c2cd-43bc-8408-676cc65cb7e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:34.590945 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da880218-c2cd-43bc-8408-676cc65cb7e7 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:34.591434 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da880218-c2cd-43bc-8408-676cc65cb7e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:34.591912 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da880218-c2cd-43bc-8408-676cc65cb7e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:34.614785 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da880218-c2cd-43bc-8408-676cc65cb7e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:34.617501 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da880218-c2cd-43bc-8408-676cc65cb7e7 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:34.647030 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-da880218-c2cd-43bc-8408-676cc65cb7e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:07:34.647030 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:34.647030 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:34.647030 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:34.647030 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:34.647030 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:34.647030 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:34.647030 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:34.647030 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:34.647030 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:34.647030 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:34.647030 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:34.647030 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:07:34.647030 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:07:34.647030 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:07:34.647030 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:07:34.649098 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:34.649098 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:34.649098 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:34.649098 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:34.649098 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:34.649098 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:34.649098 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:34.649098 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:34.649098 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:34.649098 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:34.649098 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:34.649098 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:34.649098 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:34.649098 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:34.649098 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:34.649098 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:34.649098 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:07:34.651062 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:07:34.651062 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:07:34.651062 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 31 00:07:34.654909 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 335/691] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 00:07:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 367 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:07:34.663959 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9223dd21-1a59-4031-8168-8289d66c3be7 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:34.817625 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9223dd21-1a59-4031-8168-8289d66c3be7 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:34.845018 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a704fea-e8db-4388-82df-6d277fa00b0b None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:34.845907 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a704fea-e8db-4388-82df-6d277fa00b0b None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:34.846668 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a704fea-e8db-4388-82df-6d277fa00b0b None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:34.849491 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 336/692] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 00:07:34 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 00:07:34.862717 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84722760-8a41-41bb-b8e3-27a358a3579b None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:34.863633 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84722760-8a41-41bb-b8e3-27a358a3579b None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:34.864226 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84722760-8a41-41bb-b8e3-27a358a3579b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:34.868905 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daf8882-0c04-4dd7-9db7-003046b055e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:34.869890 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daf8882-0c04-4dd7-9db7-003046b055e2 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:34.871083 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daf8882-0c04-4dd7-9db7-003046b055e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:34.871532 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daf8882-0c04-4dd7-9db7-003046b055e2 None admin] PATH_INFO: `/v3/domains` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:34.872406 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3daf8882-0c04-4dd7-9db7-003046b055e2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:34.872907 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3daf8882-0c04-4dd7-9db7-003046b055e2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:34.874709 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3daf8882-0c04-4dd7-9db7-003046b055e2 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:34.892273 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 357/693] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 31 00:07:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:34.901353 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daf8882-0c04-4dd7-9db7-003046b055e2 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:34.928998 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-84722760-8a41-41bb-b8e3-27a358a3579b None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:07:34.931626 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-84722760-8a41-41bb-b8e3-27a358a3579b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:07:35.100701 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:35.176401 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 337/694] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 00:07:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 00:07:35.263526 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daf8882-0c04-4dd7-9db7-003046b055e2 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:35.356926 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cf9535-3d42-4e48-99bb-1657df1b5cc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:35.357992 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cf9535-3d42-4e48-99bb-1657df1b5cc7 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:35.358482 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cf9535-3d42-4e48-99bb-1657df1b5cc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:35.358973 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cf9535-3d42-4e48-99bb-1657df1b5cc7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:35.382696 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cf9535-3d42-4e48-99bb-1657df1b5cc7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:35.385420 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cf9535-3d42-4e48-99bb-1657df1b5cc7 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:35.414646 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-22cf9535-3d42-4e48-99bb-1657df1b5cc7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:07:35.414646 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:35.414646 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:35.414646 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:35.414646 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:35.414646 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:35.414646 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:35.414646 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:35.414646 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:35.414646 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:35.414646 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:35.414646 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:35.414646 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 00:07:35.414646 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 00:07:35.414646 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 00:07:35.416447 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 00:07:35.416447 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:35.416447 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:35.416447 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:35.416447 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:35.416447 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:35.416447 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:35.416447 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:35.416447 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:35.416447 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:35.416447 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:35.416447 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:35.416447 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:35.416447 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:35.416447 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:35.416447 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:35.416447 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:35.418772 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 00:07:35.418772 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 00:07:35.418772 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:07:35.418772 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:07:35.418772 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:07:35.418772 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:07:35.418772 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:07:35.418772 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Aug 31 00:07:35.418772 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 358/695] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 31 00:07:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 517 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:07:35.427540 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84722760-8a41-41bb-b8e3-27a358a3579b None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:35.452050 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:35.585852 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84722760-8a41-41bb-b8e3-27a358a3579b None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:35.638683 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4b48d7-664a-440b-b532-6d75bb7fd4dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:35.639312 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4b48d7-664a-440b-b532-6d75bb7fd4dc None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:35.639575 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4b48d7-664a-440b-b532-6d75bb7fd4dc None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:35.639864 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4b48d7-664a-440b-b532-6d75bb7fd4dc None admin] PATH_INFO: `/v3/projects` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:35.640584 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4b48d7-664a-440b-b532-6d75bb7fd4dc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:35.640892 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4b48d7-664a-440b-b532-6d75bb7fd4dc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:35.642382 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4b48d7-664a-440b-b532-6d75bb7fd4dc None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:35.660657 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 338/696] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Aug 31 00:07:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:07:35.670342 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cf9535-3d42-4e48-99bb-1657df1b5cc7 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:35.725592 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4b48d7-664a-440b-b532-6d75bb7fd4dc None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:35.856040 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:35.859961 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cf9535-3d42-4e48-99bb-1657df1b5cc7 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:35.873567 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:35.898592 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c1e058-5a1b-4bff-ac2e-54a6dc5bd184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:35.899319 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c1e058-5a1b-4bff-ac2e-54a6dc5bd184 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:35.899672 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c1e058-5a1b-4bff-ac2e-54a6dc5bd184 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:35.900018 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c1e058-5a1b-4bff-ac2e-54a6dc5bd184 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:35.900856 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c1e058-5a1b-4bff-ac2e-54a6dc5bd184 None admin] RBAC: Adding query filter params (role.id=1e6d7ecde4b0415bb944f25eda475f9c, scope.project.id=1b647cccb30a427193fc62dbebe0c6f1, user.id=ffbfbf19509645f49dbf9566e447c8c5) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:35.901453 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c1e058-5a1b-4bff-ac2e-54a6dc5bd184 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:35.903008 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c1e058-5a1b-4bff-ac2e-54a6dc5bd184 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:35.910439 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 359/697] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 31 00:07:35 2022] GET /identity/v3/role_assignments?user.id=ffbfbf19509645f49dbf9566e447c8c5&scope.project.id=1b647cccb30a427193fc62dbebe0c6f1&role.id=1e6d7ecde4b0415bb944f25eda475f9c => generated 608 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:35.921078 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4b48d7-664a-440b-b532-6d75bb7fd4dc None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:35.961235 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5240e5-9b74-4678-8bd5-7c70f4a6c391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:35.961902 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5240e5-9b74-4678-8bd5-7c70f4a6c391 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:35.962186 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5240e5-9b74-4678-8bd5-7c70f4a6c391 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:35.962461 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5240e5-9b74-4678-8bd5-7c70f4a6c391 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:35.975313 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5240e5-9b74-4678-8bd5-7c70f4a6c391 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:07:35.990334 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-ac5240e5-9b74-4678-8bd5-7c70f4a6c391 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:07:35.990334 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:35.990334 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:35.990334 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:35.990334 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:35.990334 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:35.990334 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:35.990334 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:35.990334 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:35.990334 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:35.990334 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:35.990334 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:35.990334 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:07:35.990334 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:07:35.990334 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:07:35.990334 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:07:35.995079 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:07:35.995079 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:07:35.995079 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:07:35.995079 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:07:35.995079 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:35.995079 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:35.995079 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:35.995079 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:35.995079 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:35.995079 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:35.995079 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:35.995079 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:35.995079 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:35.995079 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:35.995079 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:35.995079 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:36.012044 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:36.012044 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:36.012044 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:36.012044 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:36.012044 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:07:36.012044 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:07:36.012044 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:07:36.012044 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:07:36.012044 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:07:36.012044 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:07:36.012044 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:07:36.012044 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 31 00:07:36.012044 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 339/698] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Aug 31 00:07:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:07:36.014806 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c1e058-5a1b-4bff-ac2e-54a6dc5bd184 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:36.178679 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb18b0b7-a650-4f69-a96d-0ffb678c3e9a None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:36.179627 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb18b0b7-a650-4f69-a96d-0ffb678c3e9a None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:36.179627 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb18b0b7-a650-4f69-a96d-0ffb678c3e9a None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:36.180618 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 340/699] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 00:07:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:07:36.193182 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66bb30b-4dd2-47bb-a7ea-a5a53e54ad9f None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:36.193609 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66bb30b-4dd2-47bb-a7ea-a5a53e54ad9f None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:36.193876 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66bb30b-4dd2-47bb-a7ea-a5a53e54ad9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:36.230839 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-a66bb30b-4dd2-47bb-a7ea-a5a53e54ad9f None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:07:36.232106 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-a66bb30b-4dd2-47bb-a7ea-a5a53e54ad9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:07:36.268326 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c1e058-5a1b-4bff-ac2e-54a6dc5bd184 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:36.367073 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c07527a-c9dd-4cd0-821f-d19344beb645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:36.368037 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c07527a-c9dd-4cd0-821f-d19344beb645 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:36.368538 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c07527a-c9dd-4cd0-821f-d19344beb645 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:36.368988 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c07527a-c9dd-4cd0-821f-d19344beb645 None admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:36.370322 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c07527a-c9dd-4cd0-821f-d19344beb645 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:36.370808 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c07527a-c9dd-4cd0-821f-d19344beb645 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:36.373442 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c07527a-c9dd-4cd0-821f-d19344beb645 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:36.381380 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 341/700] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 00:07:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:07:36.390745 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 360/701] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 31 00:07:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 400 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:36.396332 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66bb30b-4dd2-47bb-a7ea-a5a53e54ad9f None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:36.502772 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:36.577158 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66bb30b-4dd2-47bb-a7ea-a5a53e54ad9f None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:36.649149 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4451bf57-65bd-4b21-97c7-cf53320dcb6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:36.650513 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4451bf57-65bd-4b21-97c7-cf53320dcb6a None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:36.651176 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4451bf57-65bd-4b21-97c7-cf53320dcb6a None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:36.652448 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4451bf57-65bd-4b21-97c7-cf53320dcb6a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:36.678117 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4451bf57-65bd-4b21-97c7-cf53320dcb6a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:36.681026 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4451bf57-65bd-4b21-97c7-cf53320dcb6a None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:36.721544 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-4451bf57-65bd-4b21-97c7-cf53320dcb6a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:07:36.721544 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:36.721544 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:36.721544 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:36.721544 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:36.721544 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:36.721544 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:36.721544 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:36.721544 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:36.721544 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:36.721544 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:36.721544 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:36.721544 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:07:36.721544 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:07:36.721544 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:07:36.721544 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:07:36.723596 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:36.723596 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:36.723596 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:36.723596 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:36.723596 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:36.723596 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:36.723596 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:36.723596 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:36.723596 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:36.723596 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:36.723596 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:36.723596 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:36.723596 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:36.723596 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:36.723596 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:36.723596 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:36.723596 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:07:36.729600 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:07:36.729600 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:07:36.729600 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 31 00:07:36.732584 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 342/702] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 00:07:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:07:36.738220 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c07527a-c9dd-4cd0-821f-d19344beb645 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:36.739230 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4451bf57-65bd-4b21-97c7-cf53320dcb6a None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:36.822161 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:36.979403 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c07527a-c9dd-4cd0-821f-d19344beb645 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:37.054214 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b627767-4836-4590-baa1-22e5410d9085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:37.054885 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b627767-4836-4590-baa1-22e5410d9085 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:37.055218 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b627767-4836-4590-baa1-22e5410d9085 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:37.055497 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b627767-4836-4590-baa1-22e5410d9085 None admin] PATH_INFO: `/v3/services/network` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:37.056103 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b627767-4836-4590-baa1-22e5410d9085 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:37.057886 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b627767-4836-4590-baa1-22e5410d9085 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:37.070726 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-6b627767-4836-4590-baa1-22e5410d9085 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 31 00:07:37.070726 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:37.070726 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 00:07:37.070726 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 00:07:37.070726 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 00:07:37.070726 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 00:07:37.070726 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 00:07:37.070726 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:07:37.070726 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 31 00:07:37.070726 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Aug 31 00:07:37.070726 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 00:07:37.070726 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Aug 31 00:07:37.070726 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:37.070726 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:37.070726 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:37.070726 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:37.070726 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:37.072773 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:37.072773 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:37.072773 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:37.072773 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:37.072773 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:37.072773 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:37.072773 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 00:07:37.072773 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 00:07:37.072773 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 00:07:37.072773 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 00:07:37.072773 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:37.072773 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:37.072773 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:37.072773 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:37.072773 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:37.072773 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:37.074619 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:37.074619 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:37.074619 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:37.074619 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:37.074619 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:37.074619 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:37.074619 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:37.074619 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:37.074619 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:37.074619 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:37.074619 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 00:07:37.074619 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:07:37.074619 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 31 00:07:37.074619 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Aug 31 00:07:37.077267 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 361/703] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 31 00:07:36 2022] GET /identity/v3/services/network => generated 88 bytes in 340 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:07:37.078917 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dce316-b916-4c1f-8b34-dff41e90b83d None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:37.079203 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dce316-b916-4c1f-8b34-dff41e90b83d None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:37.079473 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dce316-b916-4c1f-8b34-dff41e90b83d None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:37.081259 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 362/704] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 00:07:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:07:37.082091 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dce316-b916-4c1f-8b34-dff41e90b83d None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:37.091832 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4451bf57-65bd-4b21-97c7-cf53320dcb6a None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:37.119671 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:37.162958 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608af63f-e084-47f0-8f5d-09eddf768eae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:37.164176 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608af63f-e084-47f0-8f5d-09eddf768eae None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:37.164789 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608af63f-e084-47f0-8f5d-09eddf768eae None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:37.165385 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608af63f-e084-47f0-8f5d-09eddf768eae None admin] PATH_INFO: `/v3/domains` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:37.166624 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608af63f-e084-47f0-8f5d-09eddf768eae None admin] RBAC: Adding query filter params (name=Default) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:37.167941 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608af63f-e084-47f0-8f5d-09eddf768eae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:37.170654 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608af63f-e084-47f0-8f5d-09eddf768eae None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:37.193597 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 343/705] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 31 00:07:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 455 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:37.196757 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45089329-d20b-4bad-be05-ea8054bc5563 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:37.196757 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45089329-d20b-4bad-be05-ea8054bc5563 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:37.197118 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45089329-d20b-4bad-be05-ea8054bc5563 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:37.230679 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-45089329-d20b-4bad-be05-ea8054bc5563 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:07:37.232337 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:37.234284 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-45089329-d20b-4bad-be05-ea8054bc5563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:07:37.240549 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dce316-b916-4c1f-8b34-dff41e90b83d None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:37.284764 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6d5be8-5475-4c29-8b2b-cd65dc72c5eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:37.286725 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6d5be8-5475-4c29-8b2b-cd65dc72c5eb None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:37.287180 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6d5be8-5475-4c29-8b2b-cd65dc72c5eb None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:37.287936 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6d5be8-5475-4c29-8b2b-cd65dc72c5eb None admin] PATH_INFO: `/v3/services` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:37.288934 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6d5be8-5475-4c29-8b2b-cd65dc72c5eb None admin] RBAC: Adding query filter params (name=network) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:37.289396 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6d5be8-5475-4c29-8b2b-cd65dc72c5eb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:37.291223 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6d5be8-5475-4c29-8b2b-cd65dc72c5eb None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:37.298558 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 363/706] 10.222.0.47 () {56 vars in 1112 bytes} [Wed Aug 31 00:07:37 2022] GET /identity/v3/services?name=network => generated 124 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:37.303833 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6d5be8-5475-4c29-8b2b-cd65dc72c5eb None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:37.363009 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 344/707] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 00:07:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:07:37.363009 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45089329-d20b-4bad-be05-ea8054bc5563 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:37.539946 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45089329-d20b-4bad-be05-ea8054bc5563 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:37.543595 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:37.583863 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83756dd-4ab3-4dbc-87eb-edc114e92f29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:37.585604 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83756dd-4ab3-4dbc-87eb-edc114e92f29 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:37.586322 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83756dd-4ab3-4dbc-87eb-edc114e92f29 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:37.586805 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83756dd-4ab3-4dbc-87eb-edc114e92f29 None admin] PATH_INFO: `/v3/services` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:37.587687 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83756dd-4ab3-4dbc-87eb-edc114e92f29 None admin] RBAC: Adding query filter params (type=network) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:37.588245 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83756dd-4ab3-4dbc-87eb-edc114e92f29 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:37.590619 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83756dd-4ab3-4dbc-87eb-edc114e92f29 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:37.598615 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 345/708] 10.222.0.47 () {56 vars in 1112 bytes} [Wed Aug 31 00:07:37 2022] GET /identity/v3/services?type=network => generated 124 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:37.613911 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6d5be8-5475-4c29-8b2b-cd65dc72c5eb None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:37.702664 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9670e6-388e-4c40-b6bb-1876f74f6933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:37.703820 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9670e6-388e-4c40-b6bb-1876f74f6933 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:37.704390 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9670e6-388e-4c40-b6bb-1876f74f6933 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:37.704868 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9670e6-388e-4c40-b6bb-1876f74f6933 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:37.721245 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83756dd-4ab3-4dbc-87eb-edc114e92f29 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:37.728964 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9670e6-388e-4c40-b6bb-1876f74f6933 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:37.732170 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9670e6-388e-4c40-b6bb-1876f74f6933 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:37.756437 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-3f9670e6-388e-4c40-b6bb-1876f74f6933 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 31 00:07:37.756437 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:37.756437 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:37.756437 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:37.756437 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:37.756437 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:37.756437 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:37.756437 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:37.756437 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:37.756437 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:37.756437 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:37.756437 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:37.756437 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 00:07:37.756437 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 00:07:37.756437 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 00:07:37.756437 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 00:07:37.758321 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:37.758321 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:37.758321 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:07:37.758321 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:07:37.758321 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:07:37.758321 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:07:37.758321 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:37.758321 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:37.758321 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:37.758321 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:37.758321 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:37.758321 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:37.758321 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:37.758321 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:37.758321 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:37.758321 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:37.758321 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:37.758321 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:37.759708 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:37.759708 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:37.759708 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 00:07:37.759708 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 00:07:37.759708 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 00:07:37.759708 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 00:07:37.759708 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 00:07:37.759708 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 00:07:37.759708 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 31 00:07:37.759708 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Aug 31 00:07:37.759708 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 364/709] 10.222.0.47 () {56 vars in 1093 bytes} [Wed Aug 31 00:07:37 2022] GET /identity/v3/users/nova => generated 82 bytes in 460 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:07:37.766398 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9670e6-388e-4c40-b6bb-1876f74f6933 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:37.833913 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:37.899011 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83756dd-4ab3-4dbc-87eb-edc114e92f29 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:37.943969 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f1b417-5d83-4897-9374-4eaedd374d2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:37.945158 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f1b417-5d83-4897-9374-4eaedd374d2f None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:37.946106 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f1b417-5d83-4897-9374-4eaedd374d2f None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:37.946527 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f1b417-5d83-4897-9374-4eaedd374d2f None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:37.947894 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f1b417-5d83-4897-9374-4eaedd374d2f None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:37.951763 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f1b417-5d83-4897-9374-4eaedd374d2f None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:37.977230 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9670e6-388e-4c40-b6bb-1876f74f6933 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:37.982993 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-04f1b417-5d83-4897-9374-4eaedd374d2f None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 31 00:07:37.982993 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:37.982993 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 00:07:37.982993 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 00:07:37.982993 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 00:07:37.982993 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 00:07:37.982993 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 00:07:37.982993 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:07:37.982993 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 31 00:07:37.982993 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 31 00:07:37.982993 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 00:07:37.982993 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 31 00:07:37.982993 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:37.982993 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:37.982993 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:37.982993 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:37.982993 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:37.984094 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:37.984094 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:37.984094 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:37.984094 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:37.984094 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:37.984094 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:37.984094 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 00:07:37.984094 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 00:07:37.984094 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 00:07:37.984094 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 00:07:37.984094 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:37.984094 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:37.984094 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:37.984094 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:37.984094 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:37.984094 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:37.986498 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:37.986498 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:37.986498 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:37.986498 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:37.986498 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:37.986498 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:37.986498 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:37.986498 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:37.986498 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:37.986498 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:37.986498 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 00:07:37.986498 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:07:37.986498 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 31 00:07:37.986498 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 31 00:07:37.986498 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 346/710] 10.222.0.47 () {56 vars in 1129 bytes} [Wed Aug 31 00:07:37 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:07:37.998780 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f1b417-5d83-4897-9374-4eaedd374d2f None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:38.036088 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3775e6-8725-4c2e-9522-a46194b421fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:38.039038 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3775e6-8725-4c2e-9522-a46194b421fb None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:38.039544 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3775e6-8725-4c2e-9522-a46194b421fb None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:38.040041 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3775e6-8725-4c2e-9522-a46194b421fb None admin] PATH_INFO: `/v3/users` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:38.044118 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3775e6-8725-4c2e-9522-a46194b421fb None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:38.044702 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3775e6-8725-4c2e-9522-a46194b421fb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:38.054043 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3775e6-8725-4c2e-9522-a46194b421fb None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:38.108132 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:38.130125 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 365/711] 10.222.0.47 () {56 vars in 1133 bytes} [Wed Aug 31 00:07:37 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 365 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:07:38.137613 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3775e6-8725-4c2e-9522-a46194b421fb None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:38.236042 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f1b417-5d83-4897-9374-4eaedd374d2f None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:38.295162 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33166fb-6ffd-48bd-b68b-33e32ed90fd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:38.298051 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33166fb-6ffd-48bd-b68b-33e32ed90fd0 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:38.298375 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33166fb-6ffd-48bd-b68b-33e32ed90fd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:38.298654 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33166fb-6ffd-48bd-b68b-33e32ed90fd0 None admin] PATH_INFO: `/v3/services` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:38.299251 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33166fb-6ffd-48bd-b68b-33e32ed90fd0 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:38.299556 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33166fb-6ffd-48bd-b68b-33e32ed90fd0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:38.301012 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33166fb-6ffd-48bd-b68b-33e32ed90fd0 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:38.311832 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 347/712] 10.222.0.47 () {56 vars in 1124 bytes} [Wed Aug 31 00:07:37 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:38.313398 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270f59df-aaf9-4067-9063-9a405365cbac None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:38.313688 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270f59df-aaf9-4067-9063-9a405365cbac None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:38.313966 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270f59df-aaf9-4067-9063-9a405365cbac None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:38.321685 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 348/713] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 00:07:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:07:38.321685 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270f59df-aaf9-4067-9063-9a405365cbac None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:38.337274 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:38.378391 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3775e6-8725-4c2e-9522-a46194b421fb None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:38.429677 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:38.438775 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270f59df-aaf9-4067-9063-9a405365cbac None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:38.452032 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6033ab36-05de-4ca0-8bd7-872dbb96075b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:38.453893 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6033ab36-05de-4ca0-8bd7-872dbb96075b None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:38.454744 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6033ab36-05de-4ca0-8bd7-872dbb96075b None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:38.455553 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6033ab36-05de-4ca0-8bd7-872dbb96075b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:38.485653 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1e3ab1-2f08-456e-9b93-bcba12e3b377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:38.486298 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1e3ab1-2f08-456e-9b93-bcba12e3b377 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:38.486579 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1e3ab1-2f08-456e-9b93-bcba12e3b377 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:38.486901 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1e3ab1-2f08-456e-9b93-bcba12e3b377 None admin] PATH_INFO: `/v3/services` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:38.487509 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1e3ab1-2f08-456e-9b93-bcba12e3b377 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:38.487816 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1e3ab1-2f08-456e-9b93-bcba12e3b377 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:38.489308 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1e3ab1-2f08-456e-9b93-bcba12e3b377 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:38.496072 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 349/714] 10.222.0.47 () {56 vars in 1124 bytes} [Wed Aug 31 00:07:38 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:38.501850 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05ea569-763f-4329-9628-9cdbff3509c7 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:38.502967 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05ea569-763f-4329-9628-9cdbff3509c7 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:38.503862 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05ea569-763f-4329-9628-9cdbff3509c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:38.576806 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-d05ea569-763f-4329-9628-9cdbff3509c7 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:07:38.586853 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-d05ea569-763f-4329-9628-9cdbff3509c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:07:38.690681 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6033ab36-05de-4ca0-8bd7-872dbb96075b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:38.693268 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6033ab36-05de-4ca0-8bd7-872dbb96075b None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:38.787475 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 350/715] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 00:07:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:07:38.800131 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:38.826346 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 366/716] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 31 00:07:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 690 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 00:07:38.835489 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05ea569-763f-4329-9628-9cdbff3509c7 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:39.054421 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:39.072112 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05ea569-763f-4329-9628-9cdbff3509c7 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:39.137511 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607cf704-8083-44b7-8e2d-8898b2e087fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:39.138436 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607cf704-8083-44b7-8e2d-8898b2e087fb None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:39.138923 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607cf704-8083-44b7-8e2d-8898b2e087fb None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:39.139392 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607cf704-8083-44b7-8e2d-8898b2e087fb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:39.158423 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607cf704-8083-44b7-8e2d-8898b2e087fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:39.161475 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607cf704-8083-44b7-8e2d-8898b2e087fb None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:39.191036 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-607cf704-8083-44b7-8e2d-8898b2e087fb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:07:39.191036 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:39.191036 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:39.191036 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:39.191036 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:39.191036 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:39.191036 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:39.191036 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:39.191036 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:39.191036 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:39.191036 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:39.191036 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:39.191036 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:07:39.191036 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:07:39.191036 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:07:39.191036 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:07:39.192941 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:39.192941 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:39.192941 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:39.192941 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:39.192941 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:39.192941 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:39.192941 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:39.192941 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:39.192941 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:39.192941 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:39.192941 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:39.192941 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:39.192941 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:39.192941 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:39.192941 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:39.192941 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:39.192941 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:07:39.194659 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:07:39.194659 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:07:39.194659 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 31 00:07:39.200310 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 351/717] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 00:07:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 359 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:07:39.205316 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6033ab36-05de-4ca0-8bd7-872dbb96075b None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:39.333569 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607cf704-8083-44b7-8e2d-8898b2e087fb None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:39.415120 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6033ab36-05de-4ca0-8bd7-872dbb96075b None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:39.496965 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607cf704-8083-44b7-8e2d-8898b2e087fb None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:39.534163 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dc4862-e446-4400-a678-cab0f90876ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:39.535071 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dc4862-e446-4400-a678-cab0f90876ca None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:39.535370 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dc4862-e446-4400-a678-cab0f90876ca None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:39.535615 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dc4862-e446-4400-a678-cab0f90876ca None admin] PATH_INFO: `/v3/roles/service` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:39.548549 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dc4862-e446-4400-a678-cab0f90876ca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:07:39.554774 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-62dc4862-e446-4400-a678-cab0f90876ca None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:07:39.554774 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:39.554774 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:39.554774 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:39.554774 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:39.554774 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:39.554774 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:39.554774 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:39.554774 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:39.554774 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:39.554774 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:39.554774 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:39.554774 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:07:39.554774 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:07:39.554774 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:07:39.554774 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:07:39.556513 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:07:39.556513 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:07:39.556513 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:07:39.556513 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:07:39.556513 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:39.556513 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:39.556513 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:39.556513 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:39.556513 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:39.556513 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:39.556513 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:39.556513 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:39.556513 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:39.556513 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:39.556513 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:39.556513 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:39.558867 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:39.558867 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:39.558867 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:39.558867 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:39.558867 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:07:39.558867 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:07:39.558867 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:07:39.558867 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:07:39.558867 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:07:39.558867 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:07:39.558867 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:07:39.558867 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 31 00:07:39.560996 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 352/718] 10.222.0.47 () {56 vars in 1102 bytes} [Wed Aug 31 00:07:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:07:39.563227 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dc4862-e446-4400-a678-cab0f90876ca None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:39.566326 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:39.576917 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed40bc80-8974-4294-b6e8-8c76c880b3f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:39.577553 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed40bc80-8974-4294-b6e8-8c76c880b3f7 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:39.577993 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed40bc80-8974-4294-b6e8-8c76c880b3f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:39.578151 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed40bc80-8974-4294-b6e8-8c76c880b3f7 None admin] PATH_INFO: `/v3/domains` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:39.578772 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed40bc80-8974-4294-b6e8-8c76c880b3f7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:39.579214 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed40bc80-8974-4294-b6e8-8c76c880b3f7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:39.580657 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed40bc80-8974-4294-b6e8-8c76c880b3f7 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:39.620012 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 367/719] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 31 00:07:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 411 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:39.633259 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed40bc80-8974-4294-b6e8-8c76c880b3f7 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:39.690536 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dc4862-e446-4400-a678-cab0f90876ca None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:39.724506 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:39.740227 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaa23b3-a8c4-40d2-bfce-bcb7f86f5ad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:39.741890 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaa23b3-a8c4-40d2-bfce-bcb7f86f5ad7 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:39.743354 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaa23b3-a8c4-40d2-bfce-bcb7f86f5ad7 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:39.744145 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaa23b3-a8c4-40d2-bfce-bcb7f86f5ad7 None admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:39.746241 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aaa23b3-a8c4-40d2-bfce-bcb7f86f5ad7 None admin] RBAC: Adding query filter params (name=service) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:39.747056 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aaa23b3-a8c4-40d2-bfce-bcb7f86f5ad7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:39.750835 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aaa23b3-a8c4-40d2-bfce-bcb7f86f5ad7 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:39.769641 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 353/720] 10.222.0.47 () {56 vars in 1103 bytes} [Wed Aug 31 00:07:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:07:39.770707 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f18abec-3c76-49dc-8b98-3af25d67adca None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:39.771202 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f18abec-3c76-49dc-8b98-3af25d67adca None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:39.771688 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f18abec-3c76-49dc-8b98-3af25d67adca None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:39.774607 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 354/721] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 00:07:39 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:07:39.776050 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f18abec-3c76-49dc-8b98-3af25d67adca None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:39.832045 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed40bc80-8974-4294-b6e8-8c76c880b3f7 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:39.882003 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b7e4d8-84dc-44cf-8c0b-41af345eafb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:39.883071 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b7e4d8-84dc-44cf-8c0b-41af345eafb2 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:39.883640 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b7e4d8-84dc-44cf-8c0b-41af345eafb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:39.884127 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b7e4d8-84dc-44cf-8c0b-41af345eafb2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:39.894698 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b7e4d8-84dc-44cf-8c0b-41af345eafb2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:39.896996 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b7e4d8-84dc-44cf-8c0b-41af345eafb2 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:39.905833 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:39.916447 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-54b7e4d8-84dc-44cf-8c0b-41af345eafb2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:07:39.916447 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:39.916447 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:39.916447 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:39.916447 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:39.916447 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:39.916447 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:39.916447 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:39.916447 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:39.916447 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:39.916447 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:39.916447 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:39.916447 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 00:07:39.916447 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 00:07:39.916447 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 00:07:39.918074 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 00:07:39.918074 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:39.918074 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:39.918074 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:39.918074 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:39.918074 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:39.918074 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:39.918074 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:39.918074 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:39.918074 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:39.918074 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:39.918074 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:39.918074 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:39.918074 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:39.918074 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:39.918074 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:39.918074 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:39.919104 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 00:07:39.919104 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 00:07:39.919104 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:07:39.919104 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:07:39.919104 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:07:39.919104 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:07:39.919104 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:07:39.919104 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Aug 31 00:07:39.926419 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 368/722] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 31 00:07:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:07:39.926602 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc98e48e-35ea-4088-902a-587250288413 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:39.927329 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc98e48e-35ea-4088-902a-587250288413 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:39.927508 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc98e48e-35ea-4088-902a-587250288413 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:39.959628 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-fc98e48e-35ea-4088-902a-587250288413 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:07:39.961691 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-fc98e48e-35ea-4088-902a-587250288413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:07:39.969013 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f18abec-3c76-49dc-8b98-3af25d67adca None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:40.015756 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb06a0cb-b1d6-4704-8370-2c02cc4d8176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:40.017087 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb06a0cb-b1d6-4704-8370-2c02cc4d8176 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:40.018085 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb06a0cb-b1d6-4704-8370-2c02cc4d8176 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:40.018571 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb06a0cb-b1d6-4704-8370-2c02cc4d8176 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:40.036585 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb06a0cb-b1d6-4704-8370-2c02cc4d8176 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:40.038274 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb06a0cb-b1d6-4704-8370-2c02cc4d8176 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:40.055846 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-eb06a0cb-b1d6-4704-8370-2c02cc4d8176 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:07:40.055846 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:40.055846 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:40.055846 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:40.055846 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:40.055846 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:40.055846 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:40.055846 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:40.055846 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:40.055846 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:40.055846 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:40.055846 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:40.055846 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:07:40.055846 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:07:40.055846 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:07:40.055846 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:07:40.056928 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:40.056928 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:40.056928 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:40.056928 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:40.056928 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:40.056928 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:40.056928 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:40.056928 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:40.056928 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:40.056928 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:40.056928 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:40.056928 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:40.056928 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:40.056928 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:40.056928 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:40.056928 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:40.056928 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:07:40.058585 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:07:40.058585 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:07:40.058585 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 31 00:07:40.062162 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 355/723] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 00:07:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:07:40.063430 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb06a0cb-b1d6-4704-8370-2c02cc4d8176 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:40.085159 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 369/724] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 00:07:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:07:40.086476 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc98e48e-35ea-4088-902a-587250288413 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:40.126848 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:40.227850 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc98e48e-35ea-4088-902a-587250288413 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:40.277351 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87982009-b484-4f28-b914-a6e68ba4daa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:40.278334 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87982009-b484-4f28-b914-a6e68ba4daa7 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:40.278816 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87982009-b484-4f28-b914-a6e68ba4daa7 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:40.279283 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87982009-b484-4f28-b914-a6e68ba4daa7 None admin] PATH_INFO: `/v3/domains` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:40.280501 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87982009-b484-4f28-b914-a6e68ba4daa7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:40.281031 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87982009-b484-4f28-b914-a6e68ba4daa7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:40.283259 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87982009-b484-4f28-b914-a6e68ba4daa7 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:40.303237 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 370/725] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 31 00:07:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:40.313987 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87982009-b484-4f28-b914-a6e68ba4daa7 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:40.314246 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb06a0cb-b1d6-4704-8370-2c02cc4d8176 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:40.357772 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:40.411652 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c073df3c-22e1-45fe-99f0-18ff708e7c1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:40.416208 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c073df3c-22e1-45fe-99f0-18ff708e7c1e None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:40.416208 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c073df3c-22e1-45fe-99f0-18ff708e7c1e None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:40.416208 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c073df3c-22e1-45fe-99f0-18ff708e7c1e None admin] PATH_INFO: `/v3/projects` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:40.416208 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c073df3c-22e1-45fe-99f0-18ff708e7c1e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:40.416208 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c073df3c-22e1-45fe-99f0-18ff708e7c1e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:40.416208 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c073df3c-22e1-45fe-99f0-18ff708e7c1e None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:40.447683 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 356/726] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Aug 31 00:07:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 381 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:40.480672 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c073df3c-22e1-45fe-99f0-18ff708e7c1e None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:40.525909 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:40.541285 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87982009-b484-4f28-b914-a6e68ba4daa7 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:40.599744 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7564ac-70ac-4d73-8b71-fa74fd217039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:40.602300 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7564ac-70ac-4d73-8b71-fa74fd217039 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:40.602813 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7564ac-70ac-4d73-8b71-fa74fd217039 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:40.603405 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7564ac-70ac-4d73-8b71-fa74fd217039 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:40.617218 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7564ac-70ac-4d73-8b71-fa74fd217039 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:40.619719 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7564ac-70ac-4d73-8b71-fa74fd217039 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:40.638373 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-ed7564ac-70ac-4d73-8b71-fa74fd217039 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 00:07:40.638373 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:40.638373 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:40.638373 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:40.638373 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:40.638373 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:40.638373 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:40.638373 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:40.638373 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:40.638373 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:40.638373 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:40.638373 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:40.638373 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 00:07:40.638373 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 00:07:40.638373 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 00:07:40.638373 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 00:07:40.639414 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:40.639414 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:40.639414 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:07:40.639414 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:07:40.639414 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:07:40.639414 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:07:40.639414 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:40.639414 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:40.639414 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:40.639414 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:40.639414 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:40.639414 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:40.639414 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:40.639414 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:40.639414 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:40.639414 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:40.639414 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:40.639414 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:40.640999 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:40.640999 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:40.640999 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 00:07:40.640999 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 00:07:40.640999 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 00:07:40.640999 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 00:07:40.640999 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 00:07:40.640999 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 00:07:40.640999 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 00:07:40.640999 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Aug 31 00:07:40.642748 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 371/727] 10.222.0.47 () {56 vars in 1117 bytes} [Wed Aug 31 00:07:40 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 330 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:07:40.647641 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7564ac-70ac-4d73-8b71-fa74fd217039 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:40.721398 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c073df3c-22e1-45fe-99f0-18ff708e7c1e None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:40.782308 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7564ac-70ac-4d73-8b71-fa74fd217039 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:40.789897 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bfab55-ed6c-496b-8a2b-dd7884e23d72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:40.790902 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bfab55-ed6c-496b-8a2b-dd7884e23d72 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:40.791369 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bfab55-ed6c-496b-8a2b-dd7884e23d72 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:40.791873 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bfab55-ed6c-496b-8a2b-dd7884e23d72 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:40.793631 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bfab55-ed6c-496b-8a2b-dd7884e23d72 None admin] RBAC: Adding query filter params (role.id=12f6817f9aaa4e2bb477095a6bed5d0f, scope.project.id=1b647cccb30a427193fc62dbebe0c6f1, user.id=9ea002bf49c248dbae7147665fa10fd1) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:40.794181 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bfab55-ed6c-496b-8a2b-dd7884e23d72 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:40.796342 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bfab55-ed6c-496b-8a2b-dd7884e23d72 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:40.803604 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 357/728] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 31 00:07:40 2022] GET /identity/v3/role_assignments?user.id=9ea002bf49c248dbae7147665fa10fd1&scope.project.id=1b647cccb30a427193fc62dbebe0c6f1&role.id=12f6817f9aaa4e2bb477095a6bed5d0f => generated 259 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:40.805025 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bfab55-ed6c-496b-8a2b-dd7884e23d72 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:40.830420 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a11a8f-d7b5-4463-abad-672d4f9c5f8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:40.831629 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a11a8f-d7b5-4463-abad-672d4f9c5f8e None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:40.832184 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a11a8f-d7b5-4463-abad-672d4f9c5f8e None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:40.832791 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a11a8f-d7b5-4463-abad-672d4f9c5f8e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:40.846668 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a11a8f-d7b5-4463-abad-672d4f9c5f8e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:07:40.853046 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-71a11a8f-d7b5-4463-abad-672d4f9c5f8e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:07:40.853046 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:40.853046 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:40.853046 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:40.853046 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:40.853046 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:40.853046 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:40.853046 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:40.853046 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:40.853046 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:40.853046 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:40.853046 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:40.853046 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:07:40.853046 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:07:40.853046 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:07:40.853046 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:07:40.854482 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:07:40.854482 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:07:40.854482 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:07:40.854482 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:07:40.854482 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:40.854482 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:40.854482 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:40.854482 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:40.854482 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:40.854482 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:40.854482 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:40.854482 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:40.854482 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:40.854482 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:40.854482 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:40.854482 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:40.855902 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:40.855902 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:40.855902 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:40.855902 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:40.855902 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:07:40.855902 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:07:40.855902 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:07:40.855902 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:07:40.855902 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:07:40.855902 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:07:40.855902 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:07:40.855902 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Aug 31 00:07:40.855902 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 372/729] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Aug 31 00:07:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:07:40.857739 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb04acb-ae7e-4ad2-8c1c-2dca0aaee42a None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:40.857739 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb04acb-ae7e-4ad2-8c1c-2dca0aaee42a None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:40.857739 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb04acb-ae7e-4ad2-8c1c-2dca0aaee42a None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:40.858729 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 373/730] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 00:07:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:07:40.862645 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb04acb-ae7e-4ad2-8c1c-2dca0aaee42a None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:40.886820 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:40.888879 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:40.966399 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bfab55-ed6c-496b-8a2b-dd7884e23d72 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:41.010143 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f667c2-1695-4671-9633-a7f85e14eb2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:41.011239 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f667c2-1695-4671-9633-a7f85e14eb2f None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:41.011888 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f667c2-1695-4671-9633-a7f85e14eb2f None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:41.012400 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f667c2-1695-4671-9633-a7f85e14eb2f None admin] PATH_INFO: `/v3/users` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:41.013359 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f667c2-1695-4671-9633-a7f85e14eb2f None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:41.013942 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f667c2-1695-4671-9633-a7f85e14eb2f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:41.015662 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f667c2-1695-4671-9633-a7f85e14eb2f None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:41.037207 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 358/731] 10.222.0.47 () {56 vars in 1149 bytes} [Wed Aug 31 00:07:40 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:41.039096 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f9eb62-08ed-4fba-8333-d33915e70a35 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:41.039668 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f9eb62-08ed-4fba-8333-d33915e70a35 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:41.040230 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f9eb62-08ed-4fba-8333-d33915e70a35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:41.062559 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-c6f9eb62-08ed-4fba-8333-d33915e70a35 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:07:41.064144 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-c6f9eb62-08ed-4fba-8333-d33915e70a35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:07:41.077150 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb04acb-ae7e-4ad2-8c1c-2dca0aaee42a None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:41.140428 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a32c94-842f-4c43-9833-cb3ab3dac0ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:41.141144 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a32c94-842f-4c43-9833-cb3ab3dac0ae None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:41.141447 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a32c94-842f-4c43-9833-cb3ab3dac0ae None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:41.141870 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a32c94-842f-4c43-9833-cb3ab3dac0ae None admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:41.143020 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a32c94-842f-4c43-9833-cb3ab3dac0ae None admin] RBAC: Adding query filter params (name=admin) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:41.143616 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a32c94-842f-4c43-9833-cb3ab3dac0ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:41.146401 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a32c94-842f-4c43-9833-cb3ab3dac0ae None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:41.156615 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 359/732] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 00:07:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:07:41.157859 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f9eb62-08ed-4fba-8333-d33915e70a35 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:41.180249 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 374/733] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 31 00:07:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:07:41.180249 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c1cdcf-97f8-465b-a2a9-491538e193e8 None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:41.180249 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c1cdcf-97f8-465b-a2a9-491538e193e8 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:41.180249 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c1cdcf-97f8-465b-a2a9-491538e193e8 None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:41.180249 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 375/734] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 00:07:41 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:07:41.187275 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c1cdcf-97f8-465b-a2a9-491538e193e8 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:41.235394 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:41.331039 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:41.381547 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f9eb62-08ed-4fba-8333-d33915e70a35 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:41.404577 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c1cdcf-97f8-465b-a2a9-491538e193e8 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:41.432710 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86676f3-cf12-4e66-8a4a-b58d0f4ee1b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:41.434007 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86676f3-cf12-4e66-8a4a-b58d0f4ee1b4 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:41.434007 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86676f3-cf12-4e66-8a4a-b58d0f4ee1b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:41.434461 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86676f3-cf12-4e66-8a4a-b58d0f4ee1b4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:41.473507 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bca9488-482a-412d-8c0b-51be45190a78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:41.475114 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bca9488-482a-412d-8c0b-51be45190a78 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:41.475830 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bca9488-482a-412d-8c0b-51be45190a78 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:41.476664 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bca9488-482a-412d-8c0b-51be45190a78 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:41.539862 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86676f3-cf12-4e66-8a4a-b58d0f4ee1b4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:41.541501 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86676f3-cf12-4e66-8a4a-b58d0f4ee1b4 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:41.587241 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:41.643265 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bca9488-482a-412d-8c0b-51be45190a78 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:41.644799 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bca9488-482a-412d-8c0b-51be45190a78 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:41.666063 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-0bca9488-482a-412d-8c0b-51be45190a78 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:07:41.666063 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:41.666063 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:41.666063 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:41.666063 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:41.666063 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:41.666063 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:41.666063 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:41.666063 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:41.666063 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:41.666063 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:41.666063 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:41.666063 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:07:41.666063 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:07:41.666063 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:07:41.666063 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:07:41.667852 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:41.667852 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:41.667852 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:41.667852 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:41.667852 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:41.667852 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:41.667852 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:41.667852 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:41.667852 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:41.667852 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:41.667852 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:41.667852 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:41.667852 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:41.667852 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:41.667852 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:41.667852 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:41.667852 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:07:41.669498 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:07:41.669498 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:07:41.669498 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Aug 31 00:07:41.676550 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 376/735] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 00:07:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 490 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:07:41.678100 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7112be4-243b-4f83-b7a1-5645ac76e825 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:41.678396 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7112be4-243b-4f83-b7a1-5645ac76e825 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:41.678666 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7112be4-243b-4f83-b7a1-5645ac76e825 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:41.702401 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-b7112be4-243b-4f83-b7a1-5645ac76e825 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:07:41.703534 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-b7112be4-243b-4f83-b7a1-5645ac76e825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:07:41.735087 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 360/736] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 31 00:07:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 570 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 00:07:41.735087 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86676f3-cf12-4e66-8a4a-b58d0f4ee1b4 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:41.815309 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 377/737] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 00:07:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:07:41.816598 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7112be4-243b-4f83-b7a1-5645ac76e825 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:41.912924 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86676f3-cf12-4e66-8a4a-b58d0f4ee1b4 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:41.920366 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:41.963613 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:41.981494 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcd203b-55ae-41c5-8448-102bd4ad7ac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:41.982757 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcd203b-55ae-41c5-8448-102bd4ad7ac4 None admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:41.983219 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcd203b-55ae-41c5-8448-102bd4ad7ac4 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:41.983657 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcd203b-55ae-41c5-8448-102bd4ad7ac4 None admin] PATH_INFO: `/v3/services` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:41.985169 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcd203b-55ae-41c5-8448-102bd4ad7ac4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:41.986826 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcd203b-55ae-41c5-8448-102bd4ad7ac4 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:42.010423 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7112be4-243b-4f83-b7a1-5645ac76e825 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:42.017654 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 361/738] 10.222.0.47 () {60 vars in 1141 bytes} [Wed Aug 31 00:07:41 2022] POST /identity/v3/services => generated 240 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:07:42.023224 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcd203b-55ae-41c5-8448-102bd4ad7ac4 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:42.200708 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150333f8-d1d2-4745-8f64-7b9970790cb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:42.201730 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150333f8-d1d2-4745-8f64-7b9970790cb5 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:42.202211 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150333f8-d1d2-4745-8f64-7b9970790cb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:42.202683 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150333f8-d1d2-4745-8f64-7b9970790cb5 None admin] PATH_INFO: `/v3/domains` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:42.203817 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150333f8-d1d2-4745-8f64-7b9970790cb5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:42.204368 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150333f8-d1d2-4745-8f64-7b9970790cb5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:42.206952 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150333f8-d1d2-4745-8f64-7b9970790cb5 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:42.232405 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 378/739] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 31 00:07:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 416 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:42.246018 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150333f8-d1d2-4745-8f64-7b9970790cb5 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:42.317096 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcd203b-55ae-41c5-8448-102bd4ad7ac4 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:42.378915 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcae2e1e-6b6d-4e4e-b94c-7a0d58590bc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:42.380236 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcae2e1e-6b6d-4e4e-b94c-7a0d58590bc4 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:42.380874 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcae2e1e-6b6d-4e4e-b94c-7a0d58590bc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:42.381470 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcae2e1e-6b6d-4e4e-b94c-7a0d58590bc4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:42.398643 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcae2e1e-6b6d-4e4e-b94c-7a0d58590bc4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:42.402289 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcae2e1e-6b6d-4e4e-b94c-7a0d58590bc4 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:42.425265 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-dcae2e1e-6b6d-4e4e-b94c-7a0d58590bc4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:07:42.425265 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:42.425265 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:42.425265 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:42.425265 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:42.425265 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:42.425265 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:42.425265 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:42.425265 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:42.425265 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:42.425265 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:42.425265 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:42.425265 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:07:42.425265 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:07:42.425265 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:07:42.425265 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:07:42.426755 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:42.426755 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:42.426755 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:42.426755 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:42.426755 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:42.426755 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:42.426755 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:42.426755 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:42.426755 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:42.426755 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:42.426755 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:42.426755 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:42.426755 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:42.426755 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:42.426755 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:42.426755 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:42.426755 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:07:42.428737 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:07:42.428737 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:07:42.428737 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 31 00:07:42.431287 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 362/740] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 00:07:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 413 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:07:42.438617 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcae2e1e-6b6d-4e4e-b94c-7a0d58590bc4 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:42.445511 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150333f8-d1d2-4745-8f64-7b9970790cb5 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:42.460269 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:42.497448 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36affa2-0615-4aaf-9926-60cb72d64b8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:42.498849 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36affa2-0615-4aaf-9926-60cb72d64b8f None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:42.499537 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36affa2-0615-4aaf-9926-60cb72d64b8f None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:42.500224 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36affa2-0615-4aaf-9926-60cb72d64b8f None admin] PATH_INFO: `/v3/users/swift` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:42.507771 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:42.516277 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36affa2-0615-4aaf-9926-60cb72d64b8f None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:42.520059 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36affa2-0615-4aaf-9926-60cb72d64b8f None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:42.540437 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-c36affa2-0615-4aaf-9926-60cb72d64b8f None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 31 00:07:42.540437 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:42.540437 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:42.540437 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:42.540437 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:42.540437 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:42.540437 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:42.540437 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:42.540437 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:42.540437 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:42.540437 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:42.540437 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:42.540437 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 00:07:42.540437 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 00:07:42.540437 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 00:07:42.540437 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 00:07:42.542001 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:42.542001 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:42.542001 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:07:42.542001 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:07:42.542001 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:07:42.542001 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:07:42.542001 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:42.542001 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:42.542001 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:42.542001 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:42.542001 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:42.542001 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:42.542001 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:42.542001 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:42.542001 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:42.542001 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:42.542001 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:42.542001 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:42.543383 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:42.543383 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:42.543383 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 00:07:42.543383 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 00:07:42.543383 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 00:07:42.543383 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 00:07:42.543383 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 00:07:42.543383 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 00:07:42.543383 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 31 00:07:42.543383 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Aug 31 00:07:42.552074 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 379/741] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Aug 31 00:07:42 2022] GET /identity/v3/users/swift => generated 83 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:07:42.553808 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36affa2-0615-4aaf-9926-60cb72d64b8f None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:42.582156 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcae2e1e-6b6d-4e4e-b94c-7a0d58590bc4 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:42.628248 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed7d139-a14e-4ae0-a292-4cce2a2c328a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:42.628917 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed7d139-a14e-4ae0-a292-4cce2a2c328a None admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:42.629199 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed7d139-a14e-4ae0-a292-4cce2a2c328a None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:42.629475 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed7d139-a14e-4ae0-a292-4cce2a2c328a None admin] PATH_INFO: `/v3/services` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:42.630155 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed7d139-a14e-4ae0-a292-4cce2a2c328a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:42.632281 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed7d139-a14e-4ae0-a292-4cce2a2c328a None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:42.653884 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 363/742] 10.222.0.47 () {60 vars in 1141 bytes} [Wed Aug 31 00:07:42 2022] POST /identity/v3/services => generated 251 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:07:42.655340 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed7d139-a14e-4ae0-a292-4cce2a2c328a None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:42.715437 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36affa2-0615-4aaf-9926-60cb72d64b8f None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:42.785885 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045c084f-7aeb-4d3a-98f2-b76401cb5aae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:42.786533 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045c084f-7aeb-4d3a-98f2-b76401cb5aae None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:42.786814 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045c084f-7aeb-4d3a-98f2-b76401cb5aae None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:42.787092 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045c084f-7aeb-4d3a-98f2-b76401cb5aae None admin] PATH_INFO: `/v3/domains` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:42.787781 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045c084f-7aeb-4d3a-98f2-b76401cb5aae None admin] RBAC: Adding query filter params (name=Default) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:42.788076 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045c084f-7aeb-4d3a-98f2-b76401cb5aae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:42.789549 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045c084f-7aeb-4d3a-98f2-b76401cb5aae None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:42.822899 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 380/743] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 31 00:07:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:42.835481 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045c084f-7aeb-4d3a-98f2-b76401cb5aae None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:42.843422 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:42.850088 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed7d139-a14e-4ae0-a292-4cce2a2c328a None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:42.900310 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:42.908980 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53ffeee-31f8-4d08-969f-b443ae5db52d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:42.910871 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53ffeee-31f8-4d08-969f-b443ae5db52d None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:42.912621 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53ffeee-31f8-4d08-969f-b443ae5db52d None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:42.913395 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53ffeee-31f8-4d08-969f-b443ae5db52d None admin] PATH_INFO: `/v3/users` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:42.914783 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53ffeee-31f8-4d08-969f-b443ae5db52d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:42.915487 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53ffeee-31f8-4d08-969f-b443ae5db52d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:42.918570 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53ffeee-31f8-4d08-969f-b443ae5db52d None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:42.958181 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 364/744] 10.222.0.47 () {56 vars in 1135 bytes} [Wed Aug 31 00:07:42 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:42.965910 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53ffeee-31f8-4d08-969f-b443ae5db52d None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:43.007076 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045c084f-7aeb-4d3a-98f2-b76401cb5aae None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:43.063769 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bb64df-10bc-4d70-9d07-c8889d2f683e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:43.064856 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bb64df-10bc-4d70-9d07-c8889d2f683e None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:43.065334 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bb64df-10bc-4d70-9d07-c8889d2f683e None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:43.065814 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bb64df-10bc-4d70-9d07-c8889d2f683e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:43.078383 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bb64df-10bc-4d70-9d07-c8889d2f683e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:43.081099 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bb64df-10bc-4d70-9d07-c8889d2f683e None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:43.103582 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-61bb64df-10bc-4d70-9d07-c8889d2f683e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:07:43.103582 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:43.103582 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:43.103582 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:43.103582 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:43.103582 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:43.103582 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:43.103582 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:43.103582 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:43.103582 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:43.103582 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:43.103582 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:43.103582 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 00:07:43.103582 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 00:07:43.103582 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 00:07:43.106571 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 00:07:43.106571 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:43.106571 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:43.106571 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:43.106571 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:43.106571 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:43.106571 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:43.106571 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:43.106571 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:43.106571 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:43.106571 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:43.106571 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:43.106571 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:43.106571 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:43.106571 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:43.106571 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:43.106571 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:43.108409 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 00:07:43.108409 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 00:07:43.108409 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:07:43.108409 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:07:43.108409 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:07:43.108409 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:07:43.108409 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:07:43.108409 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Aug 31 00:07:43.108409 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 381/745] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 31 00:07:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:07:43.109437 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5986429e-43cf-4051-95aa-596eb2a0cb30 None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:43.109437 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5986429e-43cf-4051-95aa-596eb2a0cb30 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:43.109687 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5986429e-43cf-4051-95aa-596eb2a0cb30 None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:43.116348 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 382/746] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 00:07:43 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:07:43.120439 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5986429e-43cf-4051-95aa-596eb2a0cb30 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:43.161021 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53ffeee-31f8-4d08-969f-b443ae5db52d None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:43.238888 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68aa7aa0-4259-4781-bb44-29f637cefbb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:43.239628 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68aa7aa0-4259-4781-bb44-29f637cefbb2 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:43.239968 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68aa7aa0-4259-4781-bb44-29f637cefbb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:43.240381 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68aa7aa0-4259-4781-bb44-29f637cefbb2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:43.300538 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:43.309952 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:43.335889 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5986429e-43cf-4051-95aa-596eb2a0cb30 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:43.355942 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68aa7aa0-4259-4781-bb44-29f637cefbb2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:43.358753 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68aa7aa0-4259-4781-bb44-29f637cefbb2 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:43.390796 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7acdcf-196c-43c7-8e6f-6dbc260223ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:43.391430 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7acdcf-196c-43c7-8e6f-6dbc260223ad None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:43.391720 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7acdcf-196c-43c7-8e6f-6dbc260223ad None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:43.391998 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7acdcf-196c-43c7-8e6f-6dbc260223ad None admin] PATH_INFO: `/v3/projects` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:43.392747 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7acdcf-196c-43c7-8e6f-6dbc260223ad None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:43.393057 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7acdcf-196c-43c7-8e6f-6dbc260223ad None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:43.394798 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7acdcf-196c-43c7-8e6f-6dbc260223ad None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:43.409784 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 383/747] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Aug 31 00:07:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:43.411644 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aceb7b-3df3-4f76-a302-94e2694431ec None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:43.411939 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aceb7b-3df3-4f76-a302-94e2694431ec None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:43.412244 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aceb7b-3df3-4f76-a302-94e2694431ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:43.434626 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-45aceb7b-3df3-4f76-a302-94e2694431ec None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:07:43.435847 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-45aceb7b-3df3-4f76-a302-94e2694431ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:07:43.520678 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 384/748] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 00:07:43 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:07:43.521558 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45aceb7b-3df3-4f76-a302-94e2694431ec None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:43.522438 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 365/749] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 31 00:07:42 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 557 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 31 00:07:43.533795 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68aa7aa0-4259-4781-bb44-29f637cefbb2 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:43.637216 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:43.729837 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68aa7aa0-4259-4781-bb44-29f637cefbb2 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:43.738988 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:43.799233 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45aceb7b-3df3-4f76-a302-94e2694431ec None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:43.819264 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793487a4-b76c-49d6-8707-561c27f7d34c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:43.820461 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793487a4-b76c-49d6-8707-561c27f7d34c None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:43.820974 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793487a4-b76c-49d6-8707-561c27f7d34c None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:43.821477 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793487a4-b76c-49d6-8707-561c27f7d34c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:43.845803 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793487a4-b76c-49d6-8707-561c27f7d34c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:43.856374 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793487a4-b76c-49d6-8707-561c27f7d34c None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:43.873821 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-793487a4-b76c-49d6-8707-561c27f7d34c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:07:43.873821 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:43.873821 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:43.873821 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:43.873821 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:43.873821 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:43.873821 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:43.873821 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:43.873821 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:43.873821 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:43.873821 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:43.873821 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:43.873821 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:07:43.873821 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:07:43.873821 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:07:43.873821 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:07:43.875288 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:43.875288 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:43.875288 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:43.875288 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:43.875288 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:43.875288 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:43.875288 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:43.875288 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:43.875288 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:43.875288 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:43.875288 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:43.875288 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:43.875288 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:43.875288 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:43.875288 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:43.875288 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:43.875288 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:07:43.877816 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:07:43.877816 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:07:43.877816 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 31 00:07:43.877816 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 366/750] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 00:07:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 342 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:07:43.884179 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793487a4-b76c-49d6-8707-561c27f7d34c None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:43.904189 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127254e8-2e96-49db-9a74-4dc8ecf69e68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:43.904189 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127254e8-2e96-49db-9a74-4dc8ecf69e68 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:43.904189 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127254e8-2e96-49db-9a74-4dc8ecf69e68 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:43.904189 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127254e8-2e96-49db-9a74-4dc8ecf69e68 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:43.908182 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127254e8-2e96-49db-9a74-4dc8ecf69e68 None admin] RBAC: Adding query filter params (role.id=1e6d7ecde4b0415bb944f25eda475f9c, scope.project.id=1b647cccb30a427193fc62dbebe0c6f1, user.id=601aa9e547aa4d42bef6753b26f48eaa) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:43.908182 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127254e8-2e96-49db-9a74-4dc8ecf69e68 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:43.920187 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127254e8-2e96-49db-9a74-4dc8ecf69e68 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:43.940198 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 385/751] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 31 00:07:43 2022] GET /identity/v3/role_assignments?user.id=601aa9e547aa4d42bef6753b26f48eaa&scope.project.id=1b647cccb30a427193fc62dbebe0c6f1&role.id=1e6d7ecde4b0415bb944f25eda475f9c => generated 259 bytes in 418 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:43.946074 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127254e8-2e96-49db-9a74-4dc8ecf69e68 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:44.017653 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793487a4-b76c-49d6-8707-561c27f7d34c None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:44.031139 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:44.065768 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161c62d1-d507-49db-8c83-e08cd7bc0f6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:44.066329 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161c62d1-d507-49db-8c83-e08cd7bc0f6e None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:44.066652 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161c62d1-d507-49db-8c83-e08cd7bc0f6e None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:44.066907 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161c62d1-d507-49db-8c83-e08cd7bc0f6e None admin] PATH_INFO: `/v3/domains` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:44.067584 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161c62d1-d507-49db-8c83-e08cd7bc0f6e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:44.067911 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161c62d1-d507-49db-8c83-e08cd7bc0f6e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:44.069428 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161c62d1-d507-49db-8c83-e08cd7bc0f6e None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:44.085235 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 367/752] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 31 00:07:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:44.092442 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161c62d1-d507-49db-8c83-e08cd7bc0f6e None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:44.249814 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127254e8-2e96-49db-9a74-4dc8ecf69e68 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:44.256272 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161c62d1-d507-49db-8c83-e08cd7bc0f6e None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:44.318820 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd15ddf0-8021-474b-a20b-4db0ad290679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:44.319824 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd15ddf0-8021-474b-a20b-4db0ad290679 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:44.320425 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd15ddf0-8021-474b-a20b-4db0ad290679 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:44.320955 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd15ddf0-8021-474b-a20b-4db0ad290679 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:44.334530 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971a745d-42d0-4df8-aff3-59e553e1d7f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:44.335800 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971a745d-42d0-4df8-aff3-59e553e1d7f9 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:44.336343 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971a745d-42d0-4df8-aff3-59e553e1d7f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:44.336818 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971a745d-42d0-4df8-aff3-59e553e1d7f9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:44.337506 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:44.360530 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd15ddf0-8021-474b-a20b-4db0ad290679 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:07:44.367897 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-fd15ddf0-8021-474b-a20b-4db0ad290679 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:07:44.367897 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:44.367897 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:44.367897 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:44.367897 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:44.367897 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:44.367897 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:44.367897 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:44.367897 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:44.367897 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:44.367897 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:44.367897 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:44.367897 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:07:44.367897 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:07:44.367897 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:07:44.367897 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:07:44.369632 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:07:44.369632 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:07:44.369632 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:07:44.369632 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:07:44.369632 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:44.369632 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:44.369632 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:44.369632 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:44.369632 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:44.369632 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:44.369632 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:44.369632 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:44.369632 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:44.369632 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:44.369632 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:44.369632 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:44.371718 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:44.371718 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:44.371718 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:44.371718 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:44.371718 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:07:44.371718 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:07:44.371718 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:07:44.371718 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:07:44.371718 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:07:44.371718 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:07:44.371718 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:07:44.371718 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Aug 31 00:07:44.371718 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 386/753] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Aug 31 00:07:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 425 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:07:44.374707 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971a745d-42d0-4df8-aff3-59e553e1d7f9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:44.374707 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971a745d-42d0-4df8-aff3-59e553e1d7f9 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:44.382097 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd15ddf0-8021-474b-a20b-4db0ad290679 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:44.417994 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-971a745d-42d0-4df8-aff3-59e553e1d7f9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:07:44.417994 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:44.417994 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:44.417994 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:44.417994 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:44.417994 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:44.417994 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:44.417994 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:44.417994 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:44.417994 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:44.417994 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:44.417994 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:44.417994 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 00:07:44.417994 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 00:07:44.417994 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 00:07:44.421311 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 00:07:44.421311 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:44.421311 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:44.421311 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:44.421311 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:44.421311 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:44.421311 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:44.421311 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:44.421311 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:44.421311 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:44.421311 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:44.421311 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:44.421311 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:44.421311 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:44.421311 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:44.421311 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:44.421311 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:44.424929 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 00:07:44.424929 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 00:07:44.424929 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:07:44.424929 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:07:44.424929 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:07:44.424929 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:07:44.424929 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:07:44.424929 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 31 00:07:44.424929 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 368/754] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 31 00:07:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 329 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:07:44.432915 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971a745d-42d0-4df8-aff3-59e553e1d7f9 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:44.481061 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:44.562658 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd15ddf0-8021-474b-a20b-4db0ad290679 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:44.601831 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632225a3-2d57-4025-92ae-166d8e3f66ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:44.602761 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632225a3-2d57-4025-92ae-166d8e3f66ef None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:44.603232 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632225a3-2d57-4025-92ae-166d8e3f66ef None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:44.603810 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632225a3-2d57-4025-92ae-166d8e3f66ef None admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:44.605288 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632225a3-2d57-4025-92ae-166d8e3f66ef None admin] RBAC: Adding query filter params (name=admin) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:44.605866 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632225a3-2d57-4025-92ae-166d8e3f66ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:44.607467 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632225a3-2d57-4025-92ae-166d8e3f66ef None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:44.610375 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971a745d-42d0-4df8-aff3-59e553e1d7f9 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:44.618249 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 387/755] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 31 00:07:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:07:44.619960 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b335317-aab2-4fc6-9688-165766f231aa None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:44.620511 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b335317-aab2-4fc6-9688-165766f231aa None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:44.621000 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b335317-aab2-4fc6-9688-165766f231aa None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:44.622884 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 388/756] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 00:07:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:07:44.632205 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a87d53-f738-4c56-9035-4be69930b7b6 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:44.632205 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a87d53-f738-4c56-9035-4be69930b7b6 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:44.632205 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a87d53-f738-4c56-9035-4be69930b7b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:44.655635 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-73a87d53-f738-4c56-9035-4be69930b7b6 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:07:44.656910 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-73a87d53-f738-4c56-9035-4be69930b7b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:07:44.666171 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a9c9e0-c18d-4346-a1f8-68f0b29a5247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:44.667853 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a9c9e0-c18d-4346-a1f8-68f0b29a5247 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:44.668282 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a9c9e0-c18d-4346-a1f8-68f0b29a5247 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:44.668655 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a9c9e0-c18d-4346-a1f8-68f0b29a5247 None admin] PATH_INFO: `/v3/projects` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:44.669733 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a9c9e0-c18d-4346-a1f8-68f0b29a5247 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:44.670153 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a9c9e0-c18d-4346-a1f8-68f0b29a5247 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:44.672318 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a9c9e0-c18d-4346-a1f8-68f0b29a5247 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:44.698700 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 369/757] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Aug 31 00:07:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:44.698700 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a9c9e0-c18d-4346-a1f8-68f0b29a5247 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:44.748576 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:44.765828 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 389/758] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 00:07:44 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 00:07:44.767151 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a87d53-f738-4c56-9035-4be69930b7b6 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:44.934927 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:44.961370 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a9c9e0-c18d-4346-a1f8-68f0b29a5247 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:45.060552 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a87d53-f738-4c56-9035-4be69930b7b6 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:45.076992 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ca6e14-e3a3-460c-9624-b299a59640cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:45.077665 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ca6e14-e3a3-460c-9624-b299a59640cd None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:45.077949 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ca6e14-e3a3-460c-9624-b299a59640cd None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:45.078206 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ca6e14-e3a3-460c-9624-b299a59640cd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:45.092462 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ca6e14-e3a3-460c-9624-b299a59640cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:45.094000 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ca6e14-e3a3-460c-9624-b299a59640cd None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:45.103955 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f950cc87-848e-4758-8751-3552ed19e718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:45.104820 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f950cc87-848e-4758-8751-3552ed19e718 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:45.105339 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f950cc87-848e-4758-8751-3552ed19e718 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:45.105673 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f950cc87-848e-4758-8751-3552ed19e718 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:45.106436 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f950cc87-848e-4758-8751-3552ed19e718 None admin] RBAC: Adding query filter params (role.id=12f6817f9aaa4e2bb477095a6bed5d0f, scope.project.id=1b647cccb30a427193fc62dbebe0c6f1, user.id=ffbfbf19509645f49dbf9566e447c8c5) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:45.106746 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f950cc87-848e-4758-8751-3552ed19e718 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:45.108328 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f950cc87-848e-4758-8751-3552ed19e718 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:45.112911 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-35ca6e14-e3a3-460c-9624-b299a59640cd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:07:45.112911 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:45.112911 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:45.112911 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:45.112911 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:45.112911 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:45.112911 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:45.112911 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:45.112911 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:45.112911 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:45.112911 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:45.112911 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:45.112911 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:07:45.112911 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:07:45.112911 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:07:45.112911 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:07:45.114639 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:45.114639 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:45.114639 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:45.114639 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:45.114639 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:45.114639 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:45.114639 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:45.114639 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:45.114639 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:45.114639 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:45.114639 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:45.114639 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:45.114639 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:45.114639 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:45.114639 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:45.114639 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:45.114639 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:07:45.117348 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:07:45.117348 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:07:45.117348 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 31 00:07:45.117968 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 390/760] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 31 00:07:44 2022] GET /identity/v3/role_assignments?user.id=ffbfbf19509645f49dbf9566e447c8c5&scope.project.id=1b647cccb30a427193fc62dbebe0c6f1&role.id=12f6817f9aaa4e2bb477095a6bed5d0f => generated 259 bytes in 349 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:45.117968 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f950cc87-848e-4758-8751-3552ed19e718 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:45.121851 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 370/760] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 00:07:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 421 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:07:45.121851 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ca6e14-e3a3-460c-9624-b299a59640cd None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:45.225420 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:45.285011 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f950cc87-848e-4758-8751-3552ed19e718 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:45.333573 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603c9b66-361b-48a6-a0f0-69ac95ec2573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:45.334244 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603c9b66-361b-48a6-a0f0-69ac95ec2573 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:45.334537 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603c9b66-361b-48a6-a0f0-69ac95ec2573 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:45.334813 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603c9b66-361b-48a6-a0f0-69ac95ec2573 None admin] PATH_INFO: `/v3/services/network` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:45.335495 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603c9b66-361b-48a6-a0f0-69ac95ec2573 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:45.340197 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603c9b66-361b-48a6-a0f0-69ac95ec2573 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:45.373873 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-603c9b66-361b-48a6-a0f0-69ac95ec2573 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 31 00:07:45.373873 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:45.373873 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 00:07:45.373873 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 00:07:45.373873 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 00:07:45.373873 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 00:07:45.373873 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 00:07:45.373873 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:07:45.373873 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 31 00:07:45.373873 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Aug 31 00:07:45.373873 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 00:07:45.373873 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Aug 31 00:07:45.373873 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:45.373873 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:45.373873 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:45.373873 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:45.373873 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:45.375599 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:45.375599 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:45.375599 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:45.375599 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:45.375599 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:45.375599 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:45.375599 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 00:07:45.375599 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 00:07:45.375599 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 00:07:45.375599 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 00:07:45.375599 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:45.375599 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:45.375599 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:45.375599 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:45.375599 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:45.375599 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:45.376997 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:45.376997 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:45.376997 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:45.376997 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:45.376997 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:45.376997 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:45.376997 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:45.376997 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:45.376997 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:45.376997 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:45.376997 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 00:07:45.376997 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:07:45.376997 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 31 00:07:45.376997 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Aug 31 00:07:45.380592 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 391/761] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 31 00:07:45 2022] GET /identity/v3/services/network => generated 88 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:07:45.388140 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603c9b66-361b-48a6-a0f0-69ac95ec2573 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:45.438483 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ca6e14-e3a3-460c-9624-b299a59640cd None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:45.510247 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b85b6d-c3ad-447c-a184-1be33c2ef284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:45.511424 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b85b6d-c3ad-447c-a184-1be33c2ef284 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:45.511924 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b85b6d-c3ad-447c-a184-1be33c2ef284 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:45.512439 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b85b6d-c3ad-447c-a184-1be33c2ef284 None admin] PATH_INFO: `/v3/domains` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:45.513313 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b85b6d-c3ad-447c-a184-1be33c2ef284 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:45.513923 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b85b6d-c3ad-447c-a184-1be33c2ef284 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:45.515672 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b85b6d-c3ad-447c-a184-1be33c2ef284 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:45.531621 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 371/762] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 31 00:07:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 411 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:45.533308 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f09a27-6b9b-4611-994b-afbc577dcab6 None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:45.533802 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f09a27-6b9b-4611-994b-afbc577dcab6 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:45.534533 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f09a27-6b9b-4611-994b-afbc577dcab6 None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:45.540746 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 372/763] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 00:07:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:07:45.542612 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f09a27-6b9b-4611-994b-afbc577dcab6 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:45.546351 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:45.629703 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603c9b66-361b-48a6-a0f0-69ac95ec2573 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:45.657311 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:45.676958 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1732cc91-0eeb-425a-a0f6-d4b1154677bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:45.678173 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1732cc91-0eeb-425a-a0f6-d4b1154677bb None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:45.678780 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1732cc91-0eeb-425a-a0f6-d4b1154677bb None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:45.679294 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1732cc91-0eeb-425a-a0f6-d4b1154677bb None admin] PATH_INFO: `/v3/services` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:45.680333 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1732cc91-0eeb-425a-a0f6-d4b1154677bb None admin] RBAC: Adding query filter params (name=network) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:45.680872 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1732cc91-0eeb-425a-a0f6-d4b1154677bb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:45.683357 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1732cc91-0eeb-425a-a0f6-d4b1154677bb None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:45.684475 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f09a27-6b9b-4611-994b-afbc577dcab6 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:45.690492 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 392/764] 10.222.0.47 () {56 vars in 1112 bytes} [Wed Aug 31 00:07:45 2022] GET /identity/v3/services?name=network => generated 124 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:45.692210 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13f620c-265c-4444-906d-25a89ccbf30c None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:45.692700 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13f620c-265c-4444-906d-25a89ccbf30c None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:45.693291 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13f620c-265c-4444-906d-25a89ccbf30c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:45.715623 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-b13f620c-265c-4444-906d-25a89ccbf30c None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:07:45.717272 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-b13f620c-265c-4444-906d-25a89ccbf30c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:07:45.722110 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5c0d84-5d70-4aed-8c2d-dce1901f796d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:45.722612 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5c0d84-5d70-4aed-8c2d-dce1901f796d None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:45.722895 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5c0d84-5d70-4aed-8c2d-dce1901f796d None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:45.723164 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5c0d84-5d70-4aed-8c2d-dce1901f796d None admin] PATH_INFO: `/v3/users/nova` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:45.731774 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5c0d84-5d70-4aed-8c2d-dce1901f796d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:45.733286 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5c0d84-5d70-4aed-8c2d-dce1901f796d None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:45.746832 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-fe5c0d84-5d70-4aed-8c2d-dce1901f796d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 31 00:07:45.746832 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:45.746832 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:45.746832 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:45.746832 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:45.746832 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:45.746832 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:45.746832 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:45.746832 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:45.746832 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:45.746832 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:45.746832 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:45.746832 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 00:07:45.746832 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 00:07:45.746832 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 00:07:45.746832 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 00:07:45.747871 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:45.747871 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:45.747871 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:07:45.747871 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:07:45.747871 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:07:45.747871 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:07:45.747871 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:45.747871 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:45.747871 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:45.747871 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:45.747871 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:45.747871 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:45.747871 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:45.747871 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:45.747871 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:45.747871 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:45.747871 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:45.747871 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:45.748976 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:45.748976 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:45.748976 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 00:07:45.748976 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 00:07:45.748976 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 00:07:45.748976 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 00:07:45.748976 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 00:07:45.748976 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 00:07:45.748976 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 31 00:07:45.748976 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 31 00:07:45.748976 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 373/765] 10.222.0.47 () {56 vars in 1093 bytes} [Wed Aug 31 00:07:45 2022] GET /identity/v3/users/nova => generated 82 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:07:45.748976 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5c0d84-5d70-4aed-8c2d-dce1901f796d None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:45.808377 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 393/766] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 00:07:45 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:07:45.809869 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13f620c-265c-4444-906d-25a89ccbf30c None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:45.824178 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:45.861548 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5c0d84-5d70-4aed-8c2d-dce1901f796d None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:45.904028 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0858f138-87d9-4c58-b910-dde4945cfd66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:45.904714 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0858f138-87d9-4c58-b910-dde4945cfd66 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:45.904990 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0858f138-87d9-4c58-b910-dde4945cfd66 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:45.905309 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0858f138-87d9-4c58-b910-dde4945cfd66 None admin] PATH_INFO: `/v3/services` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:45.905954 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0858f138-87d9-4c58-b910-dde4945cfd66 None admin] RBAC: Adding query filter params (type=network) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:45.906255 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0858f138-87d9-4c58-b910-dde4945cfd66 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:45.907657 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0858f138-87d9-4c58-b910-dde4945cfd66 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:45.914068 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 374/767] 10.222.0.47 () {56 vars in 1112 bytes} [Wed Aug 31 00:07:45 2022] GET /identity/v3/services?type=network => generated 350 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:45.920306 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0858f138-87d9-4c58-b910-dde4945cfd66 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:46.018748 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13f620c-265c-4444-906d-25a89ccbf30c None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:46.042359 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:46.072587 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f68f75e-8eb0-488a-bc4f-9a388a086548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:46.073391 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f68f75e-8eb0-488a-bc4f-9a388a086548 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:46.073703 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f68f75e-8eb0-488a-bc4f-9a388a086548 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:46.076545 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f68f75e-8eb0-488a-bc4f-9a388a086548 None admin] PATH_INFO: `/v3/users` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:46.077396 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f68f75e-8eb0-488a-bc4f-9a388a086548 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:46.077712 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f68f75e-8eb0-488a-bc4f-9a388a086548 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:46.079190 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f68f75e-8eb0-488a-bc4f-9a388a086548 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:46.124598 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 394/768] 10.222.0.47 () {56 vars in 1133 bytes} [Wed Aug 31 00:07:45 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:46.130114 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f68f75e-8eb0-488a-bc4f-9a388a086548 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:46.131214 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0858f138-87d9-4c58-b910-dde4945cfd66 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:46.162037 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:46.189024 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f496099-bcac-4aea-844b-138e63e79b10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:46.190042 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f496099-bcac-4aea-844b-138e63e79b10 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:46.190530 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f496099-bcac-4aea-844b-138e63e79b10 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:46.190998 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f496099-bcac-4aea-844b-138e63e79b10 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:46.192341 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f496099-bcac-4aea-844b-138e63e79b10 None admin] RBAC: Adding query filter params (interface=public, service_id=882c34fa3503473faa78d7ad06760a1f, region_id=RegionOne) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:46.192902 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f496099-bcac-4aea-844b-138e63e79b10 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:46.195551 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f496099-bcac-4aea-844b-138e63e79b10 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:46.238729 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 375/769] 10.222.0.47 () {56 vars in 1251 bytes} [Wed Aug 31 00:07:45 2022] GET /identity/v3/endpoints?service_id=882c34fa3503473faa78d7ad06760a1f&interface=public®ion_id=RegionOne => generated 194 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:46.247741 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f496099-bcac-4aea-844b-138e63e79b10 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:46.365479 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f68f75e-8eb0-488a-bc4f-9a388a086548 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:46.377090 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f496099-bcac-4aea-844b-138e63e79b10 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:46.421410 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029b30d1-4712-4308-b46a-eb0fc8ebdf91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:46.422483 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029b30d1-4712-4308-b46a-eb0fc8ebdf91 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:46.422970 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029b30d1-4712-4308-b46a-eb0fc8ebdf91 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:46.423433 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029b30d1-4712-4308-b46a-eb0fc8ebdf91 None admin] PATH_INFO: `/v3/services` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:46.424276 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029b30d1-4712-4308-b46a-eb0fc8ebdf91 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:46.425911 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029b30d1-4712-4308-b46a-eb0fc8ebdf91 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:46.432860 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 376/770] 10.222.0.47 () {56 vars in 1087 bytes} [Wed Aug 31 00:07:46 2022] GET /identity/v3/services => generated 772 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:46.441514 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029b30d1-4712-4308-b46a-eb0fc8ebdf91 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:46.457066 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3642a9ee-00b2-4d72-9704-21316ae09349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:46.457746 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3642a9ee-00b2-4d72-9704-21316ae09349 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:46.458047 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3642a9ee-00b2-4d72-9704-21316ae09349 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:46.458293 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3642a9ee-00b2-4d72-9704-21316ae09349 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:46.481343 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3642a9ee-00b2-4d72-9704-21316ae09349 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:46.483257 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3642a9ee-00b2-4d72-9704-21316ae09349 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:46.514476 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-3642a9ee-00b2-4d72-9704-21316ae09349 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:07:46.514476 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:46.514476 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:46.514476 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:46.514476 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:46.514476 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:46.514476 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:46.514476 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:46.514476 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:46.514476 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:46.514476 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:46.514476 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:46.514476 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:07:46.514476 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:07:46.514476 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:07:46.514476 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:07:46.516358 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:46.516358 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:46.516358 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:46.516358 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:46.516358 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:46.516358 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:46.516358 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:46.516358 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:46.516358 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:46.516358 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:46.516358 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:46.516358 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:46.516358 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:46.516358 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:46.516358 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:46.516358 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:46.516358 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:07:46.518107 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:07:46.518107 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:07:46.518107 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Aug 31 00:07:46.518107 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 395/771] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 00:07:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 387 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:07:46.531248 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3642a9ee-00b2-4d72-9704-21316ae09349 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:46.570948 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:46.594927 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:46.674030 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029b30d1-4712-4308-b46a-eb0fc8ebdf91 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:46.717926 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3642a9ee-00b2-4d72-9704-21316ae09349 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:46.741096 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84c47e2-b71d-4940-993c-31999759d454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:46.742512 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84c47e2-b71d-4940-993c-31999759d454 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:46.742819 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84c47e2-b71d-4940-993c-31999759d454 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:46.743099 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84c47e2-b71d-4940-993c-31999759d454 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:46.743697 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84c47e2-b71d-4940-993c-31999759d454 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:46.747077 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84c47e2-b71d-4940-993c-31999759d454 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:46.757008 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-e84c47e2-b71d-4940-993c-31999759d454 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 31 00:07:46.757008 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:46.757008 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 00:07:46.757008 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 00:07:46.757008 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 00:07:46.757008 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 00:07:46.757008 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 00:07:46.757008 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:07:46.757008 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 31 00:07:46.757008 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 31 00:07:46.757008 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 00:07:46.757008 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 31 00:07:46.757008 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:46.757008 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:46.757008 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:46.757008 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:46.757008 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:46.758093 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:46.758093 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:46.758093 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:46.758093 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:46.758093 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:46.758093 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:46.758093 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 00:07:46.758093 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 00:07:46.758093 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 00:07:46.758093 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 00:07:46.758093 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:46.758093 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:46.758093 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:46.758093 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:46.758093 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:46.758093 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:46.758966 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:46.758966 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:46.758966 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:46.758966 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:46.758966 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:46.758966 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:46.758966 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:46.758966 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:46.758966 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:46.758966 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:46.758966 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 00:07:46.758966 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:07:46.758966 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 31 00:07:46.758966 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 31 00:07:46.758966 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 377/772] 10.222.0.47 () {56 vars in 1129 bytes} [Wed Aug 31 00:07:46 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:07:46.760002 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c296760c-8351-494e-903b-972090b998d7 None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:46.761331 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c296760c-8351-494e-903b-972090b998d7 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:46.761331 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c296760c-8351-494e-903b-972090b998d7 None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:46.762611 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 378/773] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 00:07:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:07:46.772421 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c861f155-053c-4ed9-98e5-2c9f5f55571a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:46.772421 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c861f155-053c-4ed9-98e5-2c9f5f55571a None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:46.772421 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c861f155-053c-4ed9-98e5-2c9f5f55571a None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:46.772421 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c861f155-053c-4ed9-98e5-2c9f5f55571a None admin] PATH_INFO: `/v3/domains` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:46.772963 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c861f155-053c-4ed9-98e5-2c9f5f55571a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:46.772963 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c861f155-053c-4ed9-98e5-2c9f5f55571a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:46.773098 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c296760c-8351-494e-903b-972090b998d7 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:46.773173 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c861f155-053c-4ed9-98e5-2c9f5f55571a None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:46.784220 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 396/774] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 31 00:07:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:46.784220 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc089a41-799d-4621-8f94-52bb573386c3 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:46.784220 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc089a41-799d-4621-8f94-52bb573386c3 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:46.784220 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc089a41-799d-4621-8f94-52bb573386c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:46.808191 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-cc089a41-799d-4621-8f94-52bb573386c3 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:07:46.809731 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-cc089a41-799d-4621-8f94-52bb573386c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:07:46.884203 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 397/775] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 00:07:46 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:07:46.885063 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc089a41-799d-4621-8f94-52bb573386c3 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:46.902322 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:46.923070 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c296760c-8351-494e-903b-972090b998d7 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:46.956710 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:46.991418 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c371c61-d351-4a68-96e7-8c4cb16ff81b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:46.991982 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c371c61-d351-4a68-96e7-8c4cb16ff81b None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:46.992290 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c371c61-d351-4a68-96e7-8c4cb16ff81b None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:46.992568 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c371c61-d351-4a68-96e7-8c4cb16ff81b None admin] PATH_INFO: `/v3/services` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:46.993218 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c371c61-d351-4a68-96e7-8c4cb16ff81b None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:46.993526 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c371c61-d351-4a68-96e7-8c4cb16ff81b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:46.994985 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c371c61-d351-4a68-96e7-8c4cb16ff81b None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:47.008820 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 379/776] 10.222.0.47 () {56 vars in 1124 bytes} [Wed Aug 31 00:07:46 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:47.009493 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc089a41-799d-4621-8f94-52bb573386c3 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:47.014923 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c371c61-d351-4a68-96e7-8c4cb16ff81b None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:47.048920 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4b94c0-927a-4283-bfdd-dc767c746455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:47.049844 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4b94c0-927a-4283-bfdd-dc767c746455 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:47.050277 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4b94c0-927a-4283-bfdd-dc767c746455 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:47.050702 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4b94c0-927a-4283-bfdd-dc767c746455 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:47.063966 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4b94c0-927a-4283-bfdd-dc767c746455 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:47.065722 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4b94c0-927a-4283-bfdd-dc767c746455 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:47.078578 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-8a4b94c0-927a-4283-bfdd-dc767c746455 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:07:47.078578 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:47.078578 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:47.078578 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:47.078578 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:47.078578 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:47.078578 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:47.078578 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:47.078578 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:47.078578 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:47.078578 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:47.078578 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:47.078578 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 00:07:47.078578 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 00:07:47.078578 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 00:07:47.079538 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 00:07:47.079538 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:47.079538 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:47.079538 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:47.079538 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:47.079538 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:47.079538 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:47.079538 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:47.079538 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:47.079538 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:47.079538 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:47.079538 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:47.079538 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:47.079538 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:47.079538 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:47.079538 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:47.079538 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:47.080502 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 00:07:47.080502 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 00:07:47.080502 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:07:47.080502 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:07:47.080502 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:07:47.080502 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:07:47.080502 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:07:47.080502 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Aug 31 00:07:47.082917 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 398/777] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 31 00:07:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:07:47.090509 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4b94c0-927a-4283-bfdd-dc767c746455 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:47.210602 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:47.223991 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c371c61-d351-4a68-96e7-8c4cb16ff81b None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:47.246842 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4b94c0-927a-4283-bfdd-dc767c746455 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:47.291979 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cea6b55-8a24-45f9-a492-7c17e78a11e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:47.292642 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cea6b55-8a24-45f9-a492-7c17e78a11e7 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:47.293151 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cea6b55-8a24-45f9-a492-7c17e78a11e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:47.293424 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cea6b55-8a24-45f9-a492-7c17e78a11e7 None admin] PATH_INFO: `/v3/services` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:47.294065 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cea6b55-8a24-45f9-a492-7c17e78a11e7 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:47.294370 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cea6b55-8a24-45f9-a492-7c17e78a11e7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:47.295927 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cea6b55-8a24-45f9-a492-7c17e78a11e7 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:47.298077 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b560762-f860-4036-8a1d-8a168c62cb29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:47.299087 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b560762-f860-4036-8a1d-8a168c62cb29 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:47.299697 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b560762-f860-4036-8a1d-8a168c62cb29 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:47.300116 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b560762-f860-4036-8a1d-8a168c62cb29 None admin] PATH_INFO: `/v3/projects` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:47.301186 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b560762-f860-4036-8a1d-8a168c62cb29 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:47.301638 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b560762-f860-4036-8a1d-8a168c62cb29 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:47.301880 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 380/778] 10.222.0.47 () {56 vars in 1124 bytes} [Wed Aug 31 00:07:47 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:07:47.302715 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cea6b55-8a24-45f9-a492-7c17e78a11e7 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:47.308834 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b560762-f860-4036-8a1d-8a168c62cb29 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:47.325678 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 399/779] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Aug 31 00:07:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:47.326844 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b560762-f860-4036-8a1d-8a168c62cb29 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:47.359266 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:47.418647 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cea6b55-8a24-45f9-a492-7c17e78a11e7 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:47.454418 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b560762-f860-4036-8a1d-8a168c62cb29 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:47.457651 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea344ac-fb38-4c05-b879-7c963ff1b69e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:47.458297 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea344ac-fb38-4c05-b879-7c963ff1b69e None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:47.458574 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea344ac-fb38-4c05-b879-7c963ff1b69e None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:47.458852 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea344ac-fb38-4c05-b879-7c963ff1b69e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:47.475969 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea344ac-fb38-4c05-b879-7c963ff1b69e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:07:47.481678 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-dea344ac-fb38-4c05-b879-7c963ff1b69e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:07:47.481678 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:47.481678 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:47.481678 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:47.481678 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:47.481678 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:47.481678 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:47.481678 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:47.481678 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:47.481678 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:47.481678 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:47.481678 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:47.481678 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:07:47.481678 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:07:47.481678 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:07:47.481678 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:07:47.482820 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:07:47.482820 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:07:47.482820 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:07:47.482820 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:07:47.482820 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:47.482820 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:47.482820 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:47.482820 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:47.482820 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:47.482820 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:47.482820 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:47.482820 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:47.482820 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:47.482820 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:47.482820 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:47.482820 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:47.483805 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:47.483805 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:47.483805 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:47.483805 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:47.483805 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:07:47.483805 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:07:47.483805 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:07:47.483805 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:07:47.483805 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:07:47.483805 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:07:47.483805 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:07:47.483805 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 31 00:07:47.483805 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 381/780] 10.222.0.47 () {56 vars in 1102 bytes} [Wed Aug 31 00:07:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:07:47.484670 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea344ac-fb38-4c05-b879-7c963ff1b69e None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:47.503539 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94045a70-62fb-499e-aa62-5667187a9ed6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:47.504173 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94045a70-62fb-499e-aa62-5667187a9ed6 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:47.504477 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94045a70-62fb-499e-aa62-5667187a9ed6 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:47.504740 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94045a70-62fb-499e-aa62-5667187a9ed6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:47.505447 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94045a70-62fb-499e-aa62-5667187a9ed6 None admin] RBAC: Adding query filter params (interface=public, service_id=af5660b8cc794e10881e3be98e5f10a9, region_id=RegionOne) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:47.505761 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94045a70-62fb-499e-aa62-5667187a9ed6 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:47.507137 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94045a70-62fb-499e-aa62-5667187a9ed6 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:47.509108 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:47.521353 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 400/781] 10.222.0.47 () {56 vars in 1251 bytes} [Wed Aug 31 00:07:47 2022] GET /identity/v3/endpoints?service_id=af5660b8cc794e10881e3be98e5f10a9&interface=public®ion_id=RegionOne => generated 194 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:47.521353 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16e5b65-b780-4a76-b9d2-7a7f38bc4f8b None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:47.521353 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16e5b65-b780-4a76-b9d2-7a7f38bc4f8b None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:47.521353 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16e5b65-b780-4a76-b9d2-7a7f38bc4f8b None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:47.521353 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 401/782] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 00:07:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:07:47.521353 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16e5b65-b780-4a76-b9d2-7a7f38bc4f8b None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:47.618675 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea344ac-fb38-4c05-b879-7c963ff1b69e None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:47.627553 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:47.653235 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16e5b65-b780-4a76-b9d2-7a7f38bc4f8b None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:47.658601 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6345445f-6277-4153-b1ce-850e340dc5d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:47.659554 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6345445f-6277-4153-b1ce-850e340dc5d7 None admin] REQUEST_METHOD: `PUT` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:47.659930 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6345445f-6277-4153-b1ce-850e340dc5d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:47.660226 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6345445f-6277-4153-b1ce-850e340dc5d7 None admin] PATH_INFO: `/v3/projects/1b647cccb30a427193fc62dbebe0c6f1/users/9ea002bf49c248dbae7147665fa10fd1/roles/12f6817f9aaa4e2bb477095a6bed5d0f` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:47.662668 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6345445f-6277-4153-b1ce-850e340dc5d7 None admin] RBAC: Authorizing `identity:create_grant(project_id=1b647cccb30a427193fc62dbebe0c6f1, user_id=9ea002bf49c248dbae7147665fa10fd1, role_id=12f6817f9aaa4e2bb477095a6bed5d0f)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:47.663963 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6345445f-6277-4153-b1ce-850e340dc5d7 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:47.688188 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 382/783] 10.222.0.47 () {58 vars in 1439 bytes} [Wed Aug 31 00:07:47 2022] PUT /identity/v3/projects/1b647cccb30a427193fc62dbebe0c6f1/users/9ea002bf49c248dbae7147665fa10fd1/roles/12f6817f9aaa4e2bb477095a6bed5d0f => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:07:47.688188 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6345445f-6277-4153-b1ce-850e340dc5d7 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:47.717106 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3505a8-9618-4b49-8890-550734113a75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:47.718149 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3505a8-9618-4b49-8890-550734113a75 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:47.719015 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3505a8-9618-4b49-8890-550734113a75 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:47.719379 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3505a8-9618-4b49-8890-550734113a75 None admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:47.720447 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3505a8-9618-4b49-8890-550734113a75 None admin] RBAC: Adding query filter params (name=service) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:47.720780 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3505a8-9618-4b49-8890-550734113a75 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:47.722623 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3505a8-9618-4b49-8890-550734113a75 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:47.737021 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 402/784] 10.222.0.47 () {56 vars in 1103 bytes} [Wed Aug 31 00:07:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:47.738421 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7950e350-52ff-40b1-b9c4-f6b0100bf8c3 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:47.738714 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7950e350-52ff-40b1-b9c4-f6b0100bf8c3 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:47.738994 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7950e350-52ff-40b1-b9c4-f6b0100bf8c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:47.765188 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-7950e350-52ff-40b1-b9c4-f6b0100bf8c3 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:07:47.766748 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-7950e350-52ff-40b1-b9c4-f6b0100bf8c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:07:47.842484 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6345445f-6277-4153-b1ce-850e340dc5d7 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:47.843841 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:47.864928 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 403/785] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 00:07:47 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:07:47.866127 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7950e350-52ff-40b1-b9c4-f6b0100bf8c3 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:47.899200 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb1c966-ceb0-4a71-8f17-3a317cbff6ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:47.901746 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb1c966-ceb0-4a71-8f17-3a317cbff6ad None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:47.902536 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb1c966-ceb0-4a71-8f17-3a317cbff6ad None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:47.903267 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb1c966-ceb0-4a71-8f17-3a317cbff6ad None admin] PATH_INFO: `/v3/services` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:47.904641 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb1c966-ceb0-4a71-8f17-3a317cbff6ad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:47.908033 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb1c966-ceb0-4a71-8f17-3a317cbff6ad None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:47.920998 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 383/786] 10.222.0.47 () {56 vars in 1087 bytes} [Wed Aug 31 00:07:47 2022] GET /identity/v3/services => generated 772 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:48.097579 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7950e350-52ff-40b1-b9c4-f6b0100bf8c3 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:48.143654 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcc02d0-8d9b-40f7-8bfa-09b315675e56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:48.144342 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcc02d0-8d9b-40f7-8bfa-09b315675e56 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:48.144636 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcc02d0-8d9b-40f7-8bfa-09b315675e56 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:48.144912 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcc02d0-8d9b-40f7-8bfa-09b315675e56 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:48.164586 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcc02d0-8d9b-40f7-8bfa-09b315675e56 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:48.166093 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcc02d0-8d9b-40f7-8bfa-09b315675e56 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:48.167980 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb1c966-ceb0-4a71-8f17-3a317cbff6ad None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:48.196397 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-cfcc02d0-8d9b-40f7-8bfa-09b315675e56 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:07:48.196397 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:48.196397 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:48.196397 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:48.196397 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:48.196397 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:48.196397 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:48.196397 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:48.196397 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:48.196397 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:48.196397 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:48.196397 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:48.196397 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:07:48.196397 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:07:48.196397 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:07:48.196397 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:07:48.197435 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:48.197435 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:48.197435 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:48.197435 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:48.197435 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:48.197435 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:48.197435 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:48.197435 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:48.197435 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:48.197435 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:48.197435 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:48.197435 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:48.197435 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:48.197435 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:48.197435 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:48.197435 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:48.197435 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:07:48.198922 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:07:48.198922 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:07:48.198922 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Aug 31 00:07:48.199708 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 404/787] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 00:07:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:07:48.204509 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcc02d0-8d9b-40f7-8bfa-09b315675e56 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:48.229781 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:48.261695 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:48.333823 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcc02d0-8d9b-40f7-8bfa-09b315675e56 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:48.356586 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb1c966-ceb0-4a71-8f17-3a317cbff6ad None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:48.390320 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd294cf-2772-415e-ad71-303e2586eab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:48.391502 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd294cf-2772-415e-ad71-303e2586eab1 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:48.392077 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd294cf-2772-415e-ad71-303e2586eab1 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:48.392394 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd294cf-2772-415e-ad71-303e2586eab1 None admin] PATH_INFO: `/v3/domains` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:48.393095 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd294cf-2772-415e-ad71-303e2586eab1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:48.393401 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd294cf-2772-415e-ad71-303e2586eab1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:48.395867 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd294cf-2772-415e-ad71-303e2586eab1 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:48.403933 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e35080-584c-4af8-9467-01d2ab413a0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:48.404720 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e35080-584c-4af8-9467-01d2ab413a0f None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:48.405075 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e35080-584c-4af8-9467-01d2ab413a0f None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:48.405415 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e35080-584c-4af8-9467-01d2ab413a0f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:48.412135 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 405/788] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 31 00:07:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:48.419125 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd294cf-2772-415e-ad71-303e2586eab1 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:48.424169 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e35080-584c-4af8-9467-01d2ab413a0f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:07:48.429804 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-c5e35080-584c-4af8-9467-01d2ab413a0f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:07:48.429804 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:48.429804 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:48.429804 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:48.429804 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:48.429804 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:48.429804 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:48.429804 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:48.429804 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:48.429804 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:48.429804 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:48.429804 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:48.429804 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:07:48.429804 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:07:48.429804 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:07:48.429804 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:07:48.430876 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:07:48.430876 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:07:48.430876 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:07:48.430876 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:07:48.430876 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:48.430876 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:48.430876 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:48.430876 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:48.430876 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:48.430876 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:48.430876 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:48.430876 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:48.430876 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:48.430876 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:48.430876 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:48.430876 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:48.431752 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:48.431752 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:48.431752 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:48.431752 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:48.431752 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:07:48.431752 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:07:48.431752 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:07:48.431752 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:07:48.431752 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:07:48.431752 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:07:48.431752 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:07:48.431752 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 31 00:07:48.431752 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 384/789] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Aug 31 00:07:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:07:48.445282 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e35080-584c-4af8-9467-01d2ab413a0f None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:48.571871 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd294cf-2772-415e-ad71-303e2586eab1 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:48.574345 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:48.617832 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09811457-d051-4632-ac4c-f59b0c1a090a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:48.618484 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09811457-d051-4632-ac4c-f59b0c1a090a None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:48.618764 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09811457-d051-4632-ac4c-f59b0c1a090a None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:48.619034 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09811457-d051-4632-ac4c-f59b0c1a090a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:48.628142 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09811457-d051-4632-ac4c-f59b0c1a090a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:48.630180 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09811457-d051-4632-ac4c-f59b0c1a090a None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:48.644929 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-09811457-d051-4632-ac4c-f59b0c1a090a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 00:07:48.644929 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:48.644929 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:48.644929 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:48.644929 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:48.644929 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:48.644929 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:48.644929 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:48.644929 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:48.644929 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:48.644929 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:48.644929 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:48.644929 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 00:07:48.644929 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 00:07:48.644929 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 00:07:48.644929 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 00:07:48.645942 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:48.645942 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:48.645942 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:07:48.645942 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:07:48.645942 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:07:48.645942 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:07:48.645942 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:48.645942 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:48.645942 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:48.645942 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:48.645942 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:48.645942 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:48.645942 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:48.645942 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:48.645942 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:48.645942 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:48.645942 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:48.645942 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:48.646901 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:48.646901 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:48.646901 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 00:07:48.646901 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 00:07:48.646901 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 00:07:48.646901 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 00:07:48.646901 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 00:07:48.646901 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 00:07:48.646901 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 00:07:48.646901 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Aug 31 00:07:48.646901 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 406/790] 10.222.0.47 () {56 vars in 1117 bytes} [Wed Aug 31 00:07:48 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:07:48.657219 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09811457-d051-4632-ac4c-f59b0c1a090a None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:48.677685 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:48.690958 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e35080-584c-4af8-9467-01d2ab413a0f None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:48.736270 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8917bc-3db7-430b-846f-ff9a97b83c97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:48.737250 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8917bc-3db7-430b-846f-ff9a97b83c97 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:48.737724 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8917bc-3db7-430b-846f-ff9a97b83c97 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:48.738236 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8917bc-3db7-430b-846f-ff9a97b83c97 None admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:48.739114 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8917bc-3db7-430b-846f-ff9a97b83c97 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:48.739635 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8917bc-3db7-430b-846f-ff9a97b83c97 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:48.741266 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8917bc-3db7-430b-846f-ff9a97b83c97 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:48.753330 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 385/791] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 31 00:07:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:48.760188 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb0857e-e6e9-448b-a656-81f19c1c8212 None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:48.760536 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb0857e-e6e9-448b-a656-81f19c1c8212 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:48.760790 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb0857e-e6e9-448b-a656-81f19c1c8212 None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:48.762551 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 386/792] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 00:07:48 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:07:48.763432 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb0857e-e6e9-448b-a656-81f19c1c8212 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:48.802405 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09811457-d051-4632-ac4c-f59b0c1a090a None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:48.842396 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cf1b2b-d113-46c9-a47e-1f69c6e65271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:48.842934 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cf1b2b-d113-46c9-a47e-1f69c6e65271 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:48.843218 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cf1b2b-d113-46c9-a47e-1f69c6e65271 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:48.843604 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cf1b2b-d113-46c9-a47e-1f69c6e65271 None admin] PATH_INFO: `/v3/users` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:48.844516 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cf1b2b-d113-46c9-a47e-1f69c6e65271 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:48.845068 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cf1b2b-d113-46c9-a47e-1f69c6e65271 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:48.846278 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cf1b2b-d113-46c9-a47e-1f69c6e65271 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:48.866901 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 407/793] 10.222.0.47 () {56 vars in 1149 bytes} [Wed Aug 31 00:07:48 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:48.868475 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23e3a17-c6a4-4bac-baea-9f0c522c6de8 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:48.868771 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23e3a17-c6a4-4bac-baea-9f0c522c6de8 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:48.869051 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23e3a17-c6a4-4bac-baea-9f0c522c6de8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:48.879270 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb0857e-e6e9-448b-a656-81f19c1c8212 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:48.888603 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-f23e3a17-c6a4-4bac-baea-9f0c522c6de8 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:07:48.889927 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-f23e3a17-c6a4-4bac-baea-9f0c522c6de8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:07:48.906673 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:48.931003 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d674285e-4308-4784-a054-cfd68d72bbac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:48.932335 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d674285e-4308-4784-a054-cfd68d72bbac None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:48.932832 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d674285e-4308-4784-a054-cfd68d72bbac None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:48.933319 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d674285e-4308-4784-a054-cfd68d72bbac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:48.953631 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d674285e-4308-4784-a054-cfd68d72bbac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:48.956589 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d674285e-4308-4784-a054-cfd68d72bbac None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:48.976437 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 408/794] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 00:07:48 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:07:48.977386 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23e3a17-c6a4-4bac-baea-9f0c522c6de8 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:49.002725 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-d674285e-4308-4784-a054-cfd68d72bbac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:07:49.002725 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:49.002725 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:49.002725 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:49.002725 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:49.002725 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:49.002725 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:49.002725 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:49.002725 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:49.002725 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:49.002725 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:49.002725 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:49.002725 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:07:49.002725 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:07:49.002725 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:07:49.002725 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:07:49.003928 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:49.003928 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:49.003928 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:49.003928 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:49.003928 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:49.003928 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:49.003928 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:49.003928 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:49.003928 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:49.003928 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:49.003928 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:49.003928 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:49.003928 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:49.003928 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:49.003928 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:49.003928 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:49.003928 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:07:49.004987 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:07:49.004987 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:07:49.004987 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 31 00:07:49.006804 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 387/795] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 00:07:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:07:49.013200 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d674285e-4308-4784-a054-cfd68d72bbac None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:49.024569 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:49.131242 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d674285e-4308-4784-a054-cfd68d72bbac None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:49.172039 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4e3ae4-3f18-43a9-b941-37456d021302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:49.172982 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4e3ae4-3f18-43a9-b941-37456d021302 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:49.173623 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4e3ae4-3f18-43a9-b941-37456d021302 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:49.174045 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4e3ae4-3f18-43a9-b941-37456d021302 None admin] PATH_INFO: `/v3/domains` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:49.175312 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4e3ae4-3f18-43a9-b941-37456d021302 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:49.175905 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4e3ae4-3f18-43a9-b941-37456d021302 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:49.177811 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4e3ae4-3f18-43a9-b941-37456d021302 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:49.188341 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23e3a17-c6a4-4bac-baea-9f0c522c6de8 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:49.192793 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 388/796] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 31 00:07:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:07:49.198996 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4e3ae4-3f18-43a9-b941-37456d021302 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:49.300538 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:49.316901 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ae2f5c-b707-4385-a158-e54a86d5f9e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:49.317561 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ae2f5c-b707-4385-a158-e54a86d5f9e4 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:49.317847 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ae2f5c-b707-4385-a158-e54a86d5f9e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:49.318127 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ae2f5c-b707-4385-a158-e54a86d5f9e4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:49.345314 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ae2f5c-b707-4385-a158-e54a86d5f9e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:49.346810 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ae2f5c-b707-4385-a158-e54a86d5f9e4 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:49.348076 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4e3ae4-3f18-43a9-b941-37456d021302 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:49.382780 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-85ae2f5c-b707-4385-a158-e54a86d5f9e4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:07:49.382780 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:49.382780 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:49.382780 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:49.382780 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:49.382780 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:49.382780 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:49.382780 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:49.382780 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:49.382780 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:49.382780 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:49.382780 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:49.382780 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:07:49.382780 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:07:49.382780 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:07:49.382780 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:07:49.383979 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:49.383979 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:49.383979 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:49.383979 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:49.383979 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:49.383979 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:49.383979 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:49.383979 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:49.383979 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:49.383979 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:49.383979 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:49.383979 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:49.383979 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:49.383979 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:49.383979 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:49.383979 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:49.383979 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:07:49.385113 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:07:49.385113 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:07:49.385113 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Aug 31 00:07:49.392828 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91d6e2e-5da6-49da-b9cf-66f102a2f0d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:49.393295 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 409/797] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 00:07:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 416 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:07:49.394193 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91d6e2e-5da6-49da-b9cf-66f102a2f0d5 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:49.394626 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91d6e2e-5da6-49da-b9cf-66f102a2f0d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:49.395062 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91d6e2e-5da6-49da-b9cf-66f102a2f0d5 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:49.395207 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ae2f5c-b707-4385-a158-e54a86d5f9e4 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:49.398457 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:49.406202 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91d6e2e-5da6-49da-b9cf-66f102a2f0d5 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:49.408644 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91d6e2e-5da6-49da-b9cf-66f102a2f0d5 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:49.434894 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-e91d6e2e-5da6-49da-b9cf-66f102a2f0d5 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 31 00:07:49.434894 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:49.434894 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:49.434894 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:49.434894 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:49.434894 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:49.434894 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:49.434894 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:49.434894 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:49.434894 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:49.434894 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:49.434894 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:49.434894 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 00:07:49.434894 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 00:07:49.434894 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 00:07:49.434894 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 00:07:49.436829 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:49.436829 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:49.436829 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:07:49.436829 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:07:49.436829 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:07:49.436829 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:07:49.436829 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:49.436829 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:49.436829 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:49.436829 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:49.436829 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:49.436829 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:49.436829 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:49.436829 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:49.436829 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:49.436829 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:49.436829 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:49.436829 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:49.438180 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:49.438180 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:49.438180 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 00:07:49.438180 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 00:07:49.438180 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 00:07:49.438180 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 00:07:49.438180 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 00:07:49.438180 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 00:07:49.438180 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 31 00:07:49.438180 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 31 00:07:49.441589 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 389/798] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Aug 31 00:07:49 2022] GET /identity/v3/users/swift => generated 83 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:07:49.448958 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91d6e2e-5da6-49da-b9cf-66f102a2f0d5 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:49.523946 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ae2f5c-b707-4385-a158-e54a86d5f9e4 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:49.567915 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91d6e2e-5da6-49da-b9cf-66f102a2f0d5 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:49.583159 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7120ded3-1fc8-44ac-bf9e-26a444c4b4ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:49.584332 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7120ded3-1fc8-44ac-bf9e-26a444c4b4ea None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:49.584852 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7120ded3-1fc8-44ac-bf9e-26a444c4b4ea None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:49.585661 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7120ded3-1fc8-44ac-bf9e-26a444c4b4ea None admin] PATH_INFO: `/v3/services/network` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:49.586507 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7120ded3-1fc8-44ac-bf9e-26a444c4b4ea None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:49.590566 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7120ded3-1fc8-44ac-bf9e-26a444c4b4ea None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:49.602239 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:49.608914 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-7120ded3-1fc8-44ac-bf9e-26a444c4b4ea None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 31 00:07:49.608914 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:49.608914 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 00:07:49.608914 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 00:07:49.608914 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 00:07:49.608914 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 00:07:49.608914 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 00:07:49.608914 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:07:49.608914 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 31 00:07:49.608914 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Aug 31 00:07:49.608914 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 00:07:49.608914 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Aug 31 00:07:49.608914 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:49.608914 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:49.608914 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:49.608914 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:49.608914 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:49.609956 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:49.609956 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:49.609956 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:49.609956 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:49.609956 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:49.609956 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:49.609956 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 00:07:49.609956 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 00:07:49.609956 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 00:07:49.609956 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 00:07:49.609956 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:49.609956 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:49.609956 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:49.609956 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:49.609956 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:49.609956 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:49.610797 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:49.610797 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:49.610797 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:49.610797 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:49.610797 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:49.610797 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:49.610797 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:49.610797 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:49.610797 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:49.610797 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:49.610797 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 00:07:49.610797 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:07:49.610797 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 31 00:07:49.610797 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Aug 31 00:07:49.616231 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 410/799] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 31 00:07:49 2022] GET /identity/v3/services/network => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:07:49.617227 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575739cf-b7a3-455d-8bd8-6b1c08aaf8f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:49.618721 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575739cf-b7a3-455d-8bd8-6b1c08aaf8f2 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:49.619218 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7120ded3-1fc8-44ac-bf9e-26a444c4b4ea None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:49.620568 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575739cf-b7a3-455d-8bd8-6b1c08aaf8f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:49.621072 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575739cf-b7a3-455d-8bd8-6b1c08aaf8f2 None admin] PATH_INFO: `/v3/domains` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:49.622005 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575739cf-b7a3-455d-8bd8-6b1c08aaf8f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:49.622483 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575739cf-b7a3-455d-8bd8-6b1c08aaf8f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:49.624101 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575739cf-b7a3-455d-8bd8-6b1c08aaf8f2 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:49.638220 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 390/800] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 31 00:07:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:49.639365 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575739cf-b7a3-455d-8bd8-6b1c08aaf8f2 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:49.730715 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:49.759129 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575739cf-b7a3-455d-8bd8-6b1c08aaf8f2 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:49.771003 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7120ded3-1fc8-44ac-bf9e-26a444c4b4ea None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:49.800808 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc101dec-c171-42de-b6af-65793cd2a82a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:49.801763 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc101dec-c171-42de-b6af-65793cd2a82a None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:49.802333 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc101dec-c171-42de-b6af-65793cd2a82a None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:49.802784 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc101dec-c171-42de-b6af-65793cd2a82a None admin] PATH_INFO: `/v3/services` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:49.803701 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc101dec-c171-42de-b6af-65793cd2a82a None admin] RBAC: Adding query filter params (name=network) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:49.804217 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc101dec-c171-42de-b6af-65793cd2a82a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:49.806101 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc101dec-c171-42de-b6af-65793cd2a82a None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:49.811101 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12082eee-cd7b-4853-9c80-cb7dd6b9b599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:49.811720 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12082eee-cd7b-4853-9c80-cb7dd6b9b599 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:49.812001 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12082eee-cd7b-4853-9c80-cb7dd6b9b599 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:49.812333 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12082eee-cd7b-4853-9c80-cb7dd6b9b599 None admin] PATH_INFO: `/v3/users` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:49.812893 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 391/801] 10.222.0.47 () {56 vars in 1112 bytes} [Wed Aug 31 00:07:49 2022] GET /identity/v3/services?name=network => generated 124 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:49.813077 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12082eee-cd7b-4853-9c80-cb7dd6b9b599 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:49.813389 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12082eee-cd7b-4853-9c80-cb7dd6b9b599 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:49.814266 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc101dec-c171-42de-b6af-65793cd2a82a None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:49.814826 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12082eee-cd7b-4853-9c80-cb7dd6b9b599 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:49.841113 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 411/802] 10.222.0.47 () {56 vars in 1135 bytes} [Wed Aug 31 00:07:49 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:49.841970 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12082eee-cd7b-4853-9c80-cb7dd6b9b599 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:49.873444 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:49.938931 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc101dec-c171-42de-b6af-65793cd2a82a None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:49.962144 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12082eee-cd7b-4853-9c80-cb7dd6b9b599 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:49.988065 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8b1659-f041-43dc-8b4b-422014e974ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:49.988986 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8b1659-f041-43dc-8b4b-422014e974ec None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:49.989458 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8b1659-f041-43dc-8b4b-422014e974ec None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:49.989967 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8b1659-f041-43dc-8b4b-422014e974ec None admin] PATH_INFO: `/v3/projects/service` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:49.990712 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:50.007279 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8b1659-f041-43dc-8b4b-422014e974ec None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:50.009248 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c56c90-e64d-45a5-9365-455c1f6ed8f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:50.009492 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8b1659-f041-43dc-8b4b-422014e974ec None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:50.009942 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c56c90-e64d-45a5-9365-455c1f6ed8f9 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:50.010223 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c56c90-e64d-45a5-9365-455c1f6ed8f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:50.010626 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c56c90-e64d-45a5-9365-455c1f6ed8f9 None admin] PATH_INFO: `/v3/services` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:50.011513 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c56c90-e64d-45a5-9365-455c1f6ed8f9 None admin] RBAC: Adding query filter params (type=network) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:50.011884 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c56c90-e64d-45a5-9365-455c1f6ed8f9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:50.013538 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c56c90-e64d-45a5-9365-455c1f6ed8f9 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:50.024534 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-7f8b1659-f041-43dc-8b4b-422014e974ec None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:07:50.024534 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:50.024534 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:50.024534 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:50.024534 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:50.024534 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:50.024534 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:50.024534 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:50.024534 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:50.024534 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:50.024534 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:50.024534 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:50.024534 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 00:07:50.024534 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 00:07:50.024534 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 00:07:50.025524 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 00:07:50.025524 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:50.025524 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:50.025524 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:50.025524 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:50.025524 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:50.025524 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:50.025524 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:50.025524 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:50.025524 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:50.025524 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:50.025524 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:50.025524 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:50.025524 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:50.025524 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:50.025524 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:50.025524 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:50.026534 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 00:07:50.026534 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 00:07:50.026534 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:07:50.026534 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:07:50.026534 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:07:50.026534 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:07:50.026534 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:07:50.026534 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 31 00:07:50.028626 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 412/803] 10.222.0.47 () {56 vars in 1112 bytes} [Wed Aug 31 00:07:49 2022] GET /identity/v3/services?type=network => generated 350 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:50.029518 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 392/804] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 31 00:07:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:07:50.029800 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c56c90-e64d-45a5-9365-455c1f6ed8f9 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:50.036277 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8b1659-f041-43dc-8b4b-422014e974ec None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:50.173691 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c56c90-e64d-45a5-9365-455c1f6ed8f9 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:50.197724 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8b1659-f041-43dc-8b4b-422014e974ec None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:50.213399 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:50.235886 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c2c6b4-cd5e-4eed-b540-23a4ee788c16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:50.236876 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c2c6b4-cd5e-4eed-b540-23a4ee788c16 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:50.237174 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c2c6b4-cd5e-4eed-b540-23a4ee788c16 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:50.237564 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c2c6b4-cd5e-4eed-b540-23a4ee788c16 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:50.254357 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c2c6b4-cd5e-4eed-b540-23a4ee788c16 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:50.254717 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86555dd4-2ba4-4690-9127-9d3aff3262d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:50.255337 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86555dd4-2ba4-4690-9127-9d3aff3262d1 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:50.255619 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86555dd4-2ba4-4690-9127-9d3aff3262d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:50.255893 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86555dd4-2ba4-4690-9127-9d3aff3262d1 None admin] PATH_INFO: `/v3/projects` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:50.256636 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86555dd4-2ba4-4690-9127-9d3aff3262d1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:50.256939 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86555dd4-2ba4-4690-9127-9d3aff3262d1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:50.257286 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c2c6b4-cd5e-4eed-b540-23a4ee788c16 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:50.258394 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86555dd4-2ba4-4690-9127-9d3aff3262d1 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:50.279328 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 393/805] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Aug 31 00:07:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:50.279328 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86555dd4-2ba4-4690-9127-9d3aff3262d1 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:50.286260 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-b8c2c6b4-cd5e-4eed-b540-23a4ee788c16 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:07:50.286260 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:50.286260 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:50.286260 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:50.286260 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:50.286260 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:50.286260 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:50.286260 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:50.286260 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:50.286260 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:50.286260 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:50.286260 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:50.286260 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:07:50.286260 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:07:50.286260 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:07:50.286260 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:07:50.304561 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:50.304561 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:50.304561 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:50.304561 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:50.304561 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:50.304561 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:50.304561 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:50.304561 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:50.304561 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:50.304561 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:50.304561 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:50.304561 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:50.304561 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:50.304561 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:50.304561 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:50.304561 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:50.304561 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:07:50.306328 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:07:50.306328 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:07:50.306328 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Aug 31 00:07:50.306328 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 413/806] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 00:07:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:07:50.306328 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21de9fa2-83d6-40df-961b-c243b0b58ee0 None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:50.306328 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21de9fa2-83d6-40df-961b-c243b0b58ee0 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:50.306328 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21de9fa2-83d6-40df-961b-c243b0b58ee0 None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:50.306328 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 414/807] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 00:07:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:07:50.306328 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21de9fa2-83d6-40df-961b-c243b0b58ee0 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:50.386829 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:50.435766 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86555dd4-2ba4-4690-9127-9d3aff3262d1 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:50.475367 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ea1e0a-f391-4059-a43b-6d6450b2e753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:50.475809 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21de9fa2-83d6-40df-961b-c243b0b58ee0 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:50.475927 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ea1e0a-f391-4059-a43b-6d6450b2e753 None admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:50.476188 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ea1e0a-f391-4059-a43b-6d6450b2e753 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:50.476456 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ea1e0a-f391-4059-a43b-6d6450b2e753 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:50.477129 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ea1e0a-f391-4059-a43b-6d6450b2e753 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:50.478503 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ea1e0a-f391-4059-a43b-6d6450b2e753 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:50.503360 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 394/808] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 31 00:07:50 2022] POST /identity/v3/endpoints => generated 337 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:07:50.505271 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fa3eff-ad11-46b6-b5cc-b2d9b9557334 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:50.505614 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fa3eff-ad11-46b6-b5cc-b2d9b9557334 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:50.505891 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fa3eff-ad11-46b6-b5cc-b2d9b9557334 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:50.532054 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-30fa3eff-ad11-46b6-b5cc-b2d9b9557334 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:07:50.533576 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-30fa3eff-ad11-46b6-b5cc-b2d9b9557334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:07:50.548760 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f853799-3ea1-4e35-b3de-41fe62f9776e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:50.549499 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f853799-3ea1-4e35-b3de-41fe62f9776e None admin] REQUEST_METHOD: `PUT` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:50.549786 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f853799-3ea1-4e35-b3de-41fe62f9776e None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:50.550062 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f853799-3ea1-4e35-b3de-41fe62f9776e None admin] PATH_INFO: `/v3/projects/1b647cccb30a427193fc62dbebe0c6f1/users/601aa9e547aa4d42bef6753b26f48eaa/roles/1e6d7ecde4b0415bb944f25eda475f9c` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:50.567879 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:50.568095 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f853799-3ea1-4e35-b3de-41fe62f9776e None admin] RBAC: Authorizing `identity:create_grant(project_id=1b647cccb30a427193fc62dbebe0c6f1, user_id=601aa9e547aa4d42bef6753b26f48eaa, role_id=1e6d7ecde4b0415bb944f25eda475f9c)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:50.569899 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f853799-3ea1-4e35-b3de-41fe62f9776e None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:50.587347 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 415/809] 10.222.0.47 () {58 vars in 1439 bytes} [Wed Aug 31 00:07:50 2022] PUT /identity/v3/projects/1b647cccb30a427193fc62dbebe0c6f1/users/601aa9e547aa4d42bef6753b26f48eaa/roles/1e6d7ecde4b0415bb944f25eda475f9c => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:07:50.589082 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f853799-3ea1-4e35-b3de-41fe62f9776e None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:50.684990 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 395/810] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 00:07:50 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:07:50.687174 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898c1ba1-532f-452e-a21e-a6faf59ccf76 None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:50.687663 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898c1ba1-532f-452e-a21e-a6faf59ccf76 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:50.688142 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898c1ba1-532f-452e-a21e-a6faf59ccf76 None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:50.691327 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 396/811] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 00:07:50 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:07:50.702037 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0c1322-deff-41f0-8d71-3b47cec36b19 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:50.702037 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0c1322-deff-41f0-8d71-3b47cec36b19 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:50.702456 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0c1322-deff-41f0-8d71-3b47cec36b19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:50.736606 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-9d0c1322-deff-41f0-8d71-3b47cec36b19 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:07:50.738498 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-9d0c1322-deff-41f0-8d71-3b47cec36b19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:07:50.801896 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:50.829711 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f853799-3ea1-4e35-b3de-41fe62f9776e None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:50.883871 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e284b65d-d2cc-40e4-81cf-1e689b64c7b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:50.884527 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e284b65d-d2cc-40e4-81cf-1e689b64c7b3 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:50.884806 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e284b65d-d2cc-40e4-81cf-1e689b64c7b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:50.885080 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e284b65d-d2cc-40e4-81cf-1e689b64c7b3 None admin] PATH_INFO: `/v3/domains` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:50.891138 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e284b65d-d2cc-40e4-81cf-1e689b64c7b3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:50.891138 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e284b65d-d2cc-40e4-81cf-1e689b64c7b3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:50.891138 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e284b65d-d2cc-40e4-81cf-1e689b64c7b3 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:50.902572 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 397/812] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 00:07:50 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:07:50.908958 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 416/813] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 31 00:07:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:50.914913 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0c1322-deff-41f0-8d71-3b47cec36b19 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:51.043239 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:51.076549 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0c1322-deff-41f0-8d71-3b47cec36b19 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:51.078941 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e284b65d-d2cc-40e4-81cf-1e689b64c7b3 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:51.146902 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41566f31-fc65-44ba-8f1f-d7e793c37893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:51.148027 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41566f31-fc65-44ba-8f1f-d7e793c37893 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:51.148596 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41566f31-fc65-44ba-8f1f-d7e793c37893 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:51.149095 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41566f31-fc65-44ba-8f1f-d7e793c37893 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:51.162281 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41566f31-fc65-44ba-8f1f-d7e793c37893 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:51.165237 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41566f31-fc65-44ba-8f1f-d7e793c37893 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:51.186960 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-41566f31-fc65-44ba-8f1f-d7e793c37893 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:07:51.186960 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:51.186960 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:51.186960 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:51.186960 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:51.186960 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:51.186960 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:51.186960 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:51.186960 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:51.186960 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:51.186960 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:51.186960 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:51.186960 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 00:07:51.186960 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 00:07:51.186960 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 00:07:51.188359 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 00:07:51.188359 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:51.188359 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:51.188359 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:51.188359 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:51.188359 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:51.188359 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:51.188359 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:51.188359 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:51.188359 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:51.188359 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:51.188359 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:51.188359 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:51.188359 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:51.188359 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:51.188359 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:51.188359 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:51.189736 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 00:07:51.189736 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 00:07:51.189736 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:07:51.189736 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:07:51.189736 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:07:51.189736 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:07:51.189736 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:07:51.189736 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 31 00:07:51.189736 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 398/814] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 31 00:07:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:07:51.197675 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41566f31-fc65-44ba-8f1f-d7e793c37893 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:51.236923 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e284b65d-d2cc-40e4-81cf-1e689b64c7b3 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:51.274670 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd3ee0e-8562-4aa2-a4fd-7ce05d09a425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:51.275303 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd3ee0e-8562-4aa2-a4fd-7ce05d09a425 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:51.275582 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd3ee0e-8562-4aa2-a4fd-7ce05d09a425 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:51.275867 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd3ee0e-8562-4aa2-a4fd-7ce05d09a425 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:51.287504 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd3ee0e-8562-4aa2-a4fd-7ce05d09a425 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:07:51.292957 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-cbd3ee0e-8562-4aa2-a4fd-7ce05d09a425 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:07:51.292957 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:51.292957 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:51.292957 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:51.292957 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:51.292957 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:51.292957 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:51.292957 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:51.292957 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:51.292957 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:51.292957 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:51.292957 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:51.292957 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:07:51.292957 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:07:51.292957 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:07:51.292957 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:07:51.293994 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:07:51.293994 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:07:51.293994 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:07:51.293994 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:07:51.293994 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:51.293994 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:51.293994 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:51.293994 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:51.293994 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:51.293994 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:51.293994 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:51.293994 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:51.293994 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:51.293994 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:51.293994 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:51.293994 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:51.295552 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:51.295552 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:51.295552 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:51.295552 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:51.295552 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:07:51.295552 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:07:51.295552 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:07:51.295552 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:07:51.295552 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:07:51.295552 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:07:51.295552 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:07:51.295552 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Aug 31 00:07:51.295552 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 417/815] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Aug 31 00:07:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:07:51.295552 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd3ee0e-8562-4aa2-a4fd-7ce05d09a425 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:51.306664 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:51.434122 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd3ee0e-8562-4aa2-a4fd-7ce05d09a425 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:51.448559 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41566f31-fc65-44ba-8f1f-d7e793c37893 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:51.479929 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58d7c7b-ce85-4190-8e75-eb31fac7bdbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:51.480954 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58d7c7b-ce85-4190-8e75-eb31fac7bdbd None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:51.481234 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58d7c7b-ce85-4190-8e75-eb31fac7bdbd None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:51.482066 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58d7c7b-ce85-4190-8e75-eb31fac7bdbd None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:51.483057 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58d7c7b-ce85-4190-8e75-eb31fac7bdbd None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:51.485447 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58d7c7b-ce85-4190-8e75-eb31fac7bdbd None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:51.486803 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47954653-059c-4bf0-9947-18694c9dc234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:51.487425 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47954653-059c-4bf0-9947-18694c9dc234 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:51.487702 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47954653-059c-4bf0-9947-18694c9dc234 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:51.487970 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47954653-059c-4bf0-9947-18694c9dc234 None admin] PATH_INFO: `/v3/projects` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:51.488715 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47954653-059c-4bf0-9947-18694c9dc234 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:51.489022 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47954653-059c-4bf0-9947-18694c9dc234 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:51.490514 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47954653-059c-4bf0-9947-18694c9dc234 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:51.509050 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 399/816] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Aug 31 00:07:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:51.509239 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-f58d7c7b-ce85-4190-8e75-eb31fac7bdbd None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 31 00:07:51.509239 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:51.509239 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 00:07:51.509239 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 00:07:51.509239 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 00:07:51.509239 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 00:07:51.509239 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 00:07:51.509239 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:07:51.509239 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 31 00:07:51.509239 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Aug 31 00:07:51.509239 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 00:07:51.509239 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Aug 31 00:07:51.509239 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:51.509239 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:51.509239 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:51.509239 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:51.509239 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:51.511138 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:51.511138 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:51.511138 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:51.511138 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:51.511138 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:51.511138 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:51.511138 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 00:07:51.511138 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 00:07:51.511138 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 00:07:51.511138 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 00:07:51.511138 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:51.511138 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:51.511138 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:51.511138 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:51.511138 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:51.511138 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:51.512195 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:51.512195 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:51.512195 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:51.512195 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:51.512195 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:51.512195 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:51.512195 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:51.512195 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:51.512195 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:51.512195 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:51.512195 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 00:07:51.512195 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:07:51.512195 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 31 00:07:51.512195 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Aug 31 00:07:51.512980 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47954653-059c-4bf0-9947-18694c9dc234 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:51.513057 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 418/817] 10.222.0.47 () {56 vars in 1129 bytes} [Wed Aug 31 00:07:51 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:07:51.513057 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58d7c7b-ce85-4190-8e75-eb31fac7bdbd None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:51.517437 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:51.604572 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:51.631196 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47954653-059c-4bf0-9947-18694c9dc234 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:51.643734 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58d7c7b-ce85-4190-8e75-eb31fac7bdbd None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:51.675516 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e2c3e4-d3af-4933-8284-76b44f45d095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:51.676128 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e2c3e4-d3af-4933-8284-76b44f45d095 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:51.676603 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e2c3e4-d3af-4933-8284-76b44f45d095 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:51.676875 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e2c3e4-d3af-4933-8284-76b44f45d095 None admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:51.677544 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e2c3e4-d3af-4933-8284-76b44f45d095 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:51.677841 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e2c3e4-d3af-4933-8284-76b44f45d095 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:51.679209 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e2c3e4-d3af-4933-8284-76b44f45d095 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:51.685896 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e6e0e3-5125-4226-b6ff-e8a97d0f091d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:51.687017 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e6e0e3-5125-4226-b6ff-e8a97d0f091d None admin] REQUEST_METHOD: `PUT` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:51.687428 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e6e0e3-5125-4226-b6ff-e8a97d0f091d None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:51.687834 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e6e0e3-5125-4226-b6ff-e8a97d0f091d None admin] PATH_INFO: `/v3/projects/1b647cccb30a427193fc62dbebe0c6f1/users/ffbfbf19509645f49dbf9566e447c8c5/roles/12f6817f9aaa4e2bb477095a6bed5d0f` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:51.693378 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 400/818] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 31 00:07:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:51.693378 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e2c3e4-d3af-4933-8284-76b44f45d095 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:51.694705 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e6e0e3-5125-4226-b6ff-e8a97d0f091d None admin] RBAC: Authorizing `identity:create_grant(project_id=1b647cccb30a427193fc62dbebe0c6f1, user_id=ffbfbf19509645f49dbf9566e447c8c5, role_id=12f6817f9aaa4e2bb477095a6bed5d0f)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:51.697352 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e6e0e3-5125-4226-b6ff-e8a97d0f091d None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:51.728186 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 419/819] 10.222.0.47 () {58 vars in 1439 bytes} [Wed Aug 31 00:07:51 2022] PUT /identity/v3/projects/1b647cccb30a427193fc62dbebe0c6f1/users/ffbfbf19509645f49dbf9566e447c8c5/roles/12f6817f9aaa4e2bb477095a6bed5d0f => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:07:51.728186 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e6e0e3-5125-4226-b6ff-e8a97d0f091d None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:51.784821 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:51.827766 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e2c3e4-d3af-4933-8284-76b44f45d095 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:51.875273 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601f373b-8bba-4898-973c-413cdf808c80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:51.876228 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601f373b-8bba-4898-973c-413cdf808c80 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:51.876763 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601f373b-8bba-4898-973c-413cdf808c80 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:51.877247 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601f373b-8bba-4898-973c-413cdf808c80 None admin] PATH_INFO: `/v3/services` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:51.878231 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601f373b-8bba-4898-973c-413cdf808c80 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:51.879344 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601f373b-8bba-4898-973c-413cdf808c80 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:51.881213 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601f373b-8bba-4898-973c-413cdf808c80 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:51.884123 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e6e0e3-5125-4226-b6ff-e8a97d0f091d None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:51.887832 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 401/820] 10.222.0.47 () {56 vars in 1124 bytes} [Wed Aug 31 00:07:51 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:51.894002 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601f373b-8bba-4898-973c-413cdf808c80 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:51.920130 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:51.930195 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58793d5b-b8ea-4678-a0d9-9f6da0f91517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:51.931389 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58793d5b-b8ea-4678-a0d9-9f6da0f91517 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:51.931960 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58793d5b-b8ea-4678-a0d9-9f6da0f91517 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:51.933106 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58793d5b-b8ea-4678-a0d9-9f6da0f91517 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:51.949259 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58793d5b-b8ea-4678-a0d9-9f6da0f91517 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:51.951750 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58793d5b-b8ea-4678-a0d9-9f6da0f91517 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:51.972650 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-58793d5b-b8ea-4678-a0d9-9f6da0f91517 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:07:51.972650 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:51.972650 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:51.972650 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:51.972650 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:51.972650 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:51.972650 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:51.972650 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:51.972650 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:51.972650 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:51.972650 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:51.972650 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:51.972650 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:07:51.972650 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:07:51.972650 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:07:51.972650 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:07:51.973761 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:51.973761 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:51.973761 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:51.973761 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:51.973761 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:51.973761 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:51.973761 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:51.973761 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:51.973761 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:51.973761 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:51.973761 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:51.973761 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:51.973761 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:51.973761 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:51.973761 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:51.973761 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:51.973761 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:07:51.974682 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:07:51.974682 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:07:51.974682 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Aug 31 00:07:51.974682 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 420/821] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 00:07:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:07:51.983406 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58793d5b-b8ea-4678-a0d9-9f6da0f91517 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:52.033433 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601f373b-8bba-4898-973c-413cdf808c80 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:52.067505 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:52.076659 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac29ea21-b81b-499f-891c-e482c10decb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:52.077277 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac29ea21-b81b-499f-891c-e482c10decb2 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:52.077555 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac29ea21-b81b-499f-891c-e482c10decb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:52.077825 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac29ea21-b81b-499f-891c-e482c10decb2 None admin] PATH_INFO: `/v3/services` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:52.078460 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac29ea21-b81b-499f-891c-e482c10decb2 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:52.078765 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac29ea21-b81b-499f-891c-e482c10decb2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:52.080202 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac29ea21-b81b-499f-891c-e482c10decb2 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:52.090706 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 402/822] 10.222.0.47 () {56 vars in 1124 bytes} [Wed Aug 31 00:07:51 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:07:52.093306 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac29ea21-b81b-499f-891c-e482c10decb2 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:52.158250 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58793d5b-b8ea-4678-a0d9-9f6da0f91517 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:52.227567 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75a8556-6aae-4309-b052-38fad3baf0fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:52.228741 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75a8556-6aae-4309-b052-38fad3baf0fe None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:52.229814 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75a8556-6aae-4309-b052-38fad3baf0fe None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:52.230370 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75a8556-6aae-4309-b052-38fad3baf0fe None admin] PATH_INFO: `/v3/domains` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:52.231648 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75a8556-6aae-4309-b052-38fad3baf0fe None admin] RBAC: Adding query filter params (name=Default) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:52.232259 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75a8556-6aae-4309-b052-38fad3baf0fe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:52.233161 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac29ea21-b81b-499f-891c-e482c10decb2 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:52.235056 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75a8556-6aae-4309-b052-38fad3baf0fe None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:52.262326 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 421/823] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 31 00:07:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:52.268267 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75a8556-6aae-4309-b052-38fad3baf0fe None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:52.277516 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ece3aa1-9368-468c-bbb4-44554e2771e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:52.278492 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ece3aa1-9368-468c-bbb4-44554e2771e5 None admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:52.278972 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ece3aa1-9368-468c-bbb4-44554e2771e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:52.279466 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ece3aa1-9368-468c-bbb4-44554e2771e5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:52.280382 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ece3aa1-9368-468c-bbb4-44554e2771e5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:52.281844 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ece3aa1-9368-468c-bbb4-44554e2771e5 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:52.308314 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 403/824] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 31 00:07:52 2022] POST /identity/v3/endpoints => generated 346 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:07:52.334531 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:52.422503 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75a8556-6aae-4309-b052-38fad3baf0fe None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:52.475271 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e27b0de-927e-4098-a161-c5672ff6a300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:52.475513 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e27b0de-927e-4098-a161-c5672ff6a300 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:52.475767 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e27b0de-927e-4098-a161-c5672ff6a300 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:52.476132 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e27b0de-927e-4098-a161-c5672ff6a300 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:52.485564 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e27b0de-927e-4098-a161-c5672ff6a300 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:52.487027 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e27b0de-927e-4098-a161-c5672ff6a300 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:52.500812 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-1e27b0de-927e-4098-a161-c5672ff6a300 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 31 00:07:52.500812 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:52.500812 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:52.500812 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:52.500812 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:52.500812 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:52.500812 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:52.500812 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:52.500812 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:52.500812 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:52.500812 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:52.500812 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:52.500812 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 00:07:52.500812 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 00:07:52.500812 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 00:07:52.500812 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 00:07:52.501828 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:52.501828 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:52.501828 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:07:52.501828 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:07:52.501828 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:07:52.501828 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:07:52.501828 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:52.501828 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:52.501828 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:52.501828 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:52.501828 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:52.501828 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:52.501828 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:52.501828 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:52.501828 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:52.501828 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:52.501828 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:52.501828 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:52.502799 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:52.502799 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:52.502799 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 00:07:52.502799 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 00:07:52.502799 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 00:07:52.502799 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 00:07:52.502799 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 00:07:52.502799 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 00:07:52.502799 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 31 00:07:52.502799 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Aug 31 00:07:52.502799 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 422/825] 10.222.0.47 () {56 vars in 1093 bytes} [Wed Aug 31 00:07:52 2022] GET /identity/v3/users/nova => generated 82 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:07:52.507917 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ece3aa1-9368-468c-bbb4-44554e2771e5 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:52.569779 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:52.654496 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ece3aa1-9368-468c-bbb4-44554e2771e5 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:52.719183 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39843e3b-e5c6-42b9-b98f-28dab7a85de2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:52.720566 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39843e3b-e5c6-42b9-b98f-28dab7a85de2 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:52.721649 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39843e3b-e5c6-42b9-b98f-28dab7a85de2 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:52.722351 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39843e3b-e5c6-42b9-b98f-28dab7a85de2 None admin] PATH_INFO: `/v3/users` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:52.723899 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39843e3b-e5c6-42b9-b98f-28dab7a85de2 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:52.724682 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39843e3b-e5c6-42b9-b98f-28dab7a85de2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:52.727565 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39843e3b-e5c6-42b9-b98f-28dab7a85de2 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:52.763720 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 404/826] 10.222.0.47 () {56 vars in 1133 bytes} [Wed Aug 31 00:07:52 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:52.773583 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e27b0de-927e-4098-a161-c5672ff6a300 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:52.971099 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e27b0de-927e-4098-a161-c5672ff6a300 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:52.974156 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:53.032145 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4818be78-915e-4684-91c8-19f3c5ab4c4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:53.032795 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4818be78-915e-4684-91c8-19f3c5ab4c4f None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:53.033074 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4818be78-915e-4684-91c8-19f3c5ab4c4f None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:53.033348 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4818be78-915e-4684-91c8-19f3c5ab4c4f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:53.106154 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4818be78-915e-4684-91c8-19f3c5ab4c4f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:53.107621 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4818be78-915e-4684-91c8-19f3c5ab4c4f None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:53.211851 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:53.218146 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 423/827] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 31 00:07:52 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 00:07:53.225083 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39843e3b-e5c6-42b9-b98f-28dab7a85de2 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:53.375321 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba74079-50b6-42b5-ab26-316ed7eb0cd2 None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:53.375655 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba74079-50b6-42b5-ab26-316ed7eb0cd2 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:53.375879 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba74079-50b6-42b5-ab26-316ed7eb0cd2 None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:53.378694 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 424/828] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 00:07:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:07:53.383223 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b161266a-7b71-4b58-a72e-23a82caedd16 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:53.383514 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b161266a-7b71-4b58-a72e-23a82caedd16 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:53.383795 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b161266a-7b71-4b58-a72e-23a82caedd16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:53.402332 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39843e3b-e5c6-42b9-b98f-28dab7a85de2 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:53.403423 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-b161266a-7b71-4b58-a72e-23a82caedd16 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:07:53.404667 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-b161266a-7b71-4b58-a72e-23a82caedd16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:07:53.415661 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:53.468548 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ab8fa4-552b-4d63-ab65-67576156a0d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:53.470044 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ab8fa4-552b-4d63-ab65-67576156a0d7 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:53.470755 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ab8fa4-552b-4d63-ab65-67576156a0d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:53.471275 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ab8fa4-552b-4d63-ab65-67576156a0d7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:53.488415 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 425/829] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 00:07:53 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 00:07:53.493054 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ab8fa4-552b-4d63-ab65-67576156a0d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:53.496080 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ab8fa4-552b-4d63-ab65-67576156a0d7 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:53.512527 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-09ab8fa4-552b-4d63-ab65-67576156a0d7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:07:53.512527 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:53.512527 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:53.512527 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:53.512527 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:53.512527 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:53.512527 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:53.512527 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:53.512527 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:53.512527 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:53.512527 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:53.512527 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:53.512527 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:07:53.512527 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:07:53.512527 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:07:53.512527 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:07:53.514815 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:53.514815 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:53.514815 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:53.514815 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:53.514815 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:53.514815 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:53.514815 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:53.514815 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:53.514815 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:53.514815 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:53.514815 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:53.514815 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:53.514815 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:53.514815 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:53.514815 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:53.514815 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:53.514815 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:07:53.517062 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:07:53.517062 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:07:53.517062 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 31 00:07:53.517062 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 405/830] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 00:07:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:07:53.521816 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b161266a-7b71-4b58-a72e-23a82caedd16 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:53.630813 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b161266a-7b71-4b58-a72e-23a82caedd16 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:53.660123 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:53.670060 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22e5bc9-7adc-4e8b-ac57-ebac7a9d0bb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:53.671785 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22e5bc9-7adc-4e8b-ac57-ebac7a9d0bb2 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:53.672438 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22e5bc9-7adc-4e8b-ac57-ebac7a9d0bb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:53.673250 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22e5bc9-7adc-4e8b-ac57-ebac7a9d0bb2 None admin] PATH_INFO: `/v3/domains` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:53.674237 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22e5bc9-7adc-4e8b-ac57-ebac7a9d0bb2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:53.674687 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22e5bc9-7adc-4e8b-ac57-ebac7a9d0bb2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:53.676685 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22e5bc9-7adc-4e8b-ac57-ebac7a9d0bb2 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:53.690999 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 426/831] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 31 00:07:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:53.698616 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ab8fa4-552b-4d63-ab65-67576156a0d7 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:53.835422 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22e5bc9-7adc-4e8b-ac57-ebac7a9d0bb2 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:53.861186 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ab8fa4-552b-4d63-ab65-67576156a0d7 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:53.903769 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bdbd91-e735-4f64-ac20-48885ab25c21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:53.904443 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bdbd91-e735-4f64-ac20-48885ab25c21 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:53.904723 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bdbd91-e735-4f64-ac20-48885ab25c21 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:53.904993 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bdbd91-e735-4f64-ac20-48885ab25c21 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:53.913943 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bdbd91-e735-4f64-ac20-48885ab25c21 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:53.915507 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bdbd91-e735-4f64-ac20-48885ab25c21 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:53.929297 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-64bdbd91-e735-4f64-ac20-48885ab25c21 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:07:53.929297 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:53.929297 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:53.929297 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:53.929297 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:53.929297 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:53.929297 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:53.929297 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:53.929297 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:53.929297 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:53.929297 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:53.929297 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:53.929297 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 00:07:53.929297 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 00:07:53.929297 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 00:07:53.930280 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 00:07:53.930280 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:53.930280 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:53.930280 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:53.930280 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:53.930280 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:53.930280 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:53.930280 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:53.930280 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:53.930280 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:53.930280 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:53.930280 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:53.930280 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:53.930280 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:53.930280 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:53.930280 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:53.930280 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:53.931183 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 00:07:53.931183 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 00:07:53.931183 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:07:53.931183 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:07:53.931183 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:07:53.931183 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:07:53.931183 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:07:53.931183 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 31 00:07:53.932521 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 406/832] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 31 00:07:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:07:53.935034 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61c3e63-30b3-4b36-ada5-cb189f5633a2 None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:53.935313 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61c3e63-30b3-4b36-ada5-cb189f5633a2 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:53.935542 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61c3e63-30b3-4b36-ada5-cb189f5633a2 None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:53.936980 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 407/833] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 00:07:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:07:53.937698 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61c3e63-30b3-4b36-ada5-cb189f5633a2 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:53.965455 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:53.978091 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22e5bc9-7adc-4e8b-ac57-ebac7a9d0bb2 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:54.043658 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552f1efe-7c8f-497c-a38e-52360cfaf33a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:54.044321 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552f1efe-7c8f-497c-a38e-52360cfaf33a None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:54.044988 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552f1efe-7c8f-497c-a38e-52360cfaf33a None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:54.045274 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552f1efe-7c8f-497c-a38e-52360cfaf33a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:54.059013 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552f1efe-7c8f-497c-a38e-52360cfaf33a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:07:54.063250 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-552f1efe-7c8f-497c-a38e-52360cfaf33a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:07:54.063250 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:54.063250 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:54.063250 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:54.063250 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:54.063250 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:54.063250 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:54.063250 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:54.063250 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:54.063250 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:54.063250 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:54.063250 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:54.063250 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:07:54.063250 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:07:54.063250 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:07:54.063250 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:07:54.064231 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:07:54.064231 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:07:54.064231 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:07:54.064231 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:07:54.064231 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:54.064231 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:54.064231 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:54.064231 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:54.064231 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:54.064231 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:54.064231 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:54.064231 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:54.064231 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:54.064231 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:54.064231 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:54.064231 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:54.065089 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:54.065089 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:54.065089 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:54.065089 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:54.065089 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:07:54.065089 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:07:54.065089 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:07:54.065089 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:07:54.065089 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:07:54.065089 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:07:54.065089 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:07:54.065089 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Aug 31 00:07:54.065089 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 427/834] 10.222.0.47 () {56 vars in 1102 bytes} [Wed Aug 31 00:07:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:07:54.065978 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee503184-0902-4d41-934f-89fa685c2eef None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:54.066361 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee503184-0902-4d41-934f-89fa685c2eef None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:54.066645 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee503184-0902-4d41-934f-89fa685c2eef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:54.083357 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61c3e63-30b3-4b36-ada5-cb189f5633a2 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:54.087869 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-ee503184-0902-4d41-934f-89fa685c2eef None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:07:54.089634 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-ee503184-0902-4d41-934f-89fa685c2eef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:07:54.140792 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b5f398-693c-4f57-8cfb-2b7bc9e32fc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:54.141747 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b5f398-693c-4f57-8cfb-2b7bc9e32fc7 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:54.142200 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b5f398-693c-4f57-8cfb-2b7bc9e32fc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:54.142641 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b5f398-693c-4f57-8cfb-2b7bc9e32fc7 None admin] PATH_INFO: `/v3/projects` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:54.143803 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b5f398-693c-4f57-8cfb-2b7bc9e32fc7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:54.144330 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b5f398-693c-4f57-8cfb-2b7bc9e32fc7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:54.146799 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b5f398-693c-4f57-8cfb-2b7bc9e32fc7 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:54.154920 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:54.174657 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 408/835] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Aug 31 00:07:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:54.174657 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b5f398-693c-4f57-8cfb-2b7bc9e32fc7 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:54.199893 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 428/836] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 00:07:54 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:07:54.200953 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee503184-0902-4d41-934f-89fa685c2eef None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:54.303217 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:54.330435 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b5f398-693c-4f57-8cfb-2b7bc9e32fc7 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:54.337639 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee503184-0902-4d41-934f-89fa685c2eef None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:54.372857 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e19fe4-67f6-4626-8782-b1e969901be0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:54.374025 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e19fe4-67f6-4626-8782-b1e969901be0 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:54.374666 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e19fe4-67f6-4626-8782-b1e969901be0 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:54.375212 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e19fe4-67f6-4626-8782-b1e969901be0 None admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:54.376187 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e19fe4-67f6-4626-8782-b1e969901be0 None admin] RBAC: Adding query filter params (name=service) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:54.376759 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e19fe4-67f6-4626-8782-b1e969901be0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:54.378486 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e19fe4-67f6-4626-8782-b1e969901be0 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:54.394871 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 409/837] 10.222.0.47 () {56 vars in 1103 bytes} [Wed Aug 31 00:07:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:54.405314 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e19fe4-67f6-4626-8782-b1e969901be0 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:54.405561 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d382b24-f638-4754-bc76-ec85fd5362a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:54.405561 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d382b24-f638-4754-bc76-ec85fd5362a2 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:54.405561 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d382b24-f638-4754-bc76-ec85fd5362a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:54.405561 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d382b24-f638-4754-bc76-ec85fd5362a2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:54.406109 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d382b24-f638-4754-bc76-ec85fd5362a2 None admin] RBAC: Adding query filter params (role.id=12f6817f9aaa4e2bb477095a6bed5d0f, scope.project.id=1b647cccb30a427193fc62dbebe0c6f1, user.id=9ea002bf49c248dbae7147665fa10fd1) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:54.406109 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d382b24-f638-4754-bc76-ec85fd5362a2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:54.407517 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d382b24-f638-4754-bc76-ec85fd5362a2 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:54.415119 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 429/838] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 31 00:07:54 2022] GET /identity/v3/role_assignments?user.id=9ea002bf49c248dbae7147665fa10fd1&scope.project.id=1b647cccb30a427193fc62dbebe0c6f1&role.id=12f6817f9aaa4e2bb477095a6bed5d0f => generated 608 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:54.423953 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d76386-c6df-44c5-93e8-035464ed00b5 None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:54.424317 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d76386-c6df-44c5-93e8-035464ed00b5 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:54.424591 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d76386-c6df-44c5-93e8-035464ed00b5 None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:54.426314 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 430/839] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 00:07:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:07:54.432855 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32873b62-ab0e-4f6d-9760-c67140ef4b19 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:54.433139 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32873b62-ab0e-4f6d-9760-c67140ef4b19 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:54.433446 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32873b62-ab0e-4f6d-9760-c67140ef4b19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:54.466666 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-32873b62-ab0e-4f6d-9760-c67140ef4b19 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:07:54.468182 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-32873b62-ab0e-4f6d-9760-c67140ef4b19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:07:54.544136 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e19fe4-67f6-4626-8782-b1e969901be0 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:54.545272 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:54.585873 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d82fdf9-7ded-401d-a9ea-4eab3c65238f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:54.586533 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d82fdf9-7ded-401d-a9ea-4eab3c65238f None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:54.586804 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d82fdf9-7ded-401d-a9ea-4eab3c65238f None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:54.587100 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d82fdf9-7ded-401d-a9ea-4eab3c65238f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:54.588411 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 431/840] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 00:07:54 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 00:07:54.593446 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32873b62-ab0e-4f6d-9760-c67140ef4b19 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:54.599955 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d82fdf9-7ded-401d-a9ea-4eab3c65238f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:54.601511 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d82fdf9-7ded-401d-a9ea-4eab3c65238f None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:54.603565 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:54.619688 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-6d82fdf9-7ded-401d-a9ea-4eab3c65238f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:07:54.619688 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:54.619688 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:54.619688 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:54.619688 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:54.619688 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:54.619688 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:54.619688 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:54.619688 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:54.619688 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:54.619688 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:54.619688 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:54.619688 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:07:54.619688 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:07:54.619688 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:07:54.619688 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:07:54.621730 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:54.621730 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:54.621730 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:54.621730 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:54.621730 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:54.621730 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:54.621730 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:54.621730 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:54.621730 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:54.621730 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:54.621730 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:54.621730 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:54.621730 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:54.621730 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:54.621730 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:54.621730 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:54.621730 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:07:54.623581 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:07:54.623581 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:07:54.623581 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 31 00:07:54.623581 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 410/841] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 00:07:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:07:54.629369 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d82fdf9-7ded-401d-a9ea-4eab3c65238f None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:54.743936 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32873b62-ab0e-4f6d-9760-c67140ef4b19 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:54.772191 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d82fdf9-7ded-401d-a9ea-4eab3c65238f None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:54.790590 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2b7e0f-5f3a-4ac8-bead-f6b3c3e9ec88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:54.791245 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2b7e0f-5f3a-4ac8-bead-f6b3c3e9ec88 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:54.791518 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2b7e0f-5f3a-4ac8-bead-f6b3c3e9ec88 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:54.792356 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2b7e0f-5f3a-4ac8-bead-f6b3c3e9ec88 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:54.804209 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2b7e0f-5f3a-4ac8-bead-f6b3c3e9ec88 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:07:54.810496 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-9b2b7e0f-5f3a-4ac8-bead-f6b3c3e9ec88 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:07:54.810496 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:54.810496 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:54.810496 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:54.810496 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:54.810496 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:54.810496 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:54.810496 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:54.810496 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:54.810496 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:54.810496 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:54.810496 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:54.810496 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:07:54.810496 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:07:54.810496 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:07:54.810496 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:07:54.811680 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:07:54.811680 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:07:54.811680 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:07:54.811680 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:07:54.811680 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:54.811680 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:54.811680 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:54.811680 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:54.811680 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:54.811680 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:54.811680 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:54.811680 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:54.811680 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:54.811680 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:54.811680 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:54.811680 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:54.812859 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:54.812859 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:54.812859 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:54.812859 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:54.812859 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:07:54.812859 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:07:54.812859 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:07:54.812859 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:07:54.812859 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:07:54.812859 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:07:54.812859 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:07:54.812859 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Aug 31 00:07:54.816300 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 432/842] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Aug 31 00:07:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:07:54.817183 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc7d7b2-59af-4881-9b7f-57c5e4d0f52d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:54.817899 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2b7e0f-5f3a-4ac8-bead-f6b3c3e9ec88 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:54.818134 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc7d7b2-59af-4881-9b7f-57c5e4d0f52d None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:54.818546 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc7d7b2-59af-4881-9b7f-57c5e4d0f52d None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:54.818952 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc7d7b2-59af-4881-9b7f-57c5e4d0f52d None admin] PATH_INFO: `/v3/domains` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:54.819802 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc7d7b2-59af-4881-9b7f-57c5e4d0f52d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:54.820298 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc7d7b2-59af-4881-9b7f-57c5e4d0f52d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:54.821828 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc7d7b2-59af-4881-9b7f-57c5e4d0f52d None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:54.836059 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 411/843] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 31 00:07:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:54.842781 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc7d7b2-59af-4881-9b7f-57c5e4d0f52d None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:54.860865 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:54.904226 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:54.941928 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2b7e0f-5f3a-4ac8-bead-f6b3c3e9ec88 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:54.953665 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc7d7b2-59af-4881-9b7f-57c5e4d0f52d None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:54.986577 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42f278a-5542-447b-90d3-cad22c05e63c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:54.987609 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42f278a-5542-447b-90d3-cad22c05e63c None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:54.988145 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42f278a-5542-447b-90d3-cad22c05e63c None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:54.989291 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42f278a-5542-447b-90d3-cad22c05e63c None admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:54.990038 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42f278a-5542-447b-90d3-cad22c05e63c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:54.990352 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42f278a-5542-447b-90d3-cad22c05e63c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:54.991813 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42f278a-5542-447b-90d3-cad22c05e63c None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:55.007759 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 433/844] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 31 00:07:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:55.009131 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42f278a-5542-447b-90d3-cad22c05e63c None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:55.029987 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942aaf65-6dfe-4386-8b71-5f846efd5984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:55.030560 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942aaf65-6dfe-4386-8b71-5f846efd5984 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:55.030900 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942aaf65-6dfe-4386-8b71-5f846efd5984 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:55.031238 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942aaf65-6dfe-4386-8b71-5f846efd5984 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:55.042305 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942aaf65-6dfe-4386-8b71-5f846efd5984 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:55.044685 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942aaf65-6dfe-4386-8b71-5f846efd5984 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:55.060244 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-942aaf65-6dfe-4386-8b71-5f846efd5984 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 00:07:55.060244 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:55.060244 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:55.060244 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:55.060244 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:55.060244 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:55.060244 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:55.060244 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:55.060244 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:55.060244 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:55.060244 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:55.060244 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:55.060244 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 00:07:55.060244 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 00:07:55.060244 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 00:07:55.060244 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 00:07:55.061285 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:55.061285 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:55.061285 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:07:55.061285 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:07:55.061285 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:07:55.061285 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:07:55.061285 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:55.061285 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:55.061285 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:55.061285 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:55.061285 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:55.061285 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:55.061285 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:55.061285 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:55.061285 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:55.061285 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:55.061285 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:55.061285 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:55.062249 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:55.062249 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:55.062249 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 00:07:55.062249 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 00:07:55.062249 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 00:07:55.062249 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 00:07:55.062249 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 00:07:55.062249 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 00:07:55.062249 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 00:07:55.062249 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 31 00:07:55.069458 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 412/845] 10.222.0.47 () {56 vars in 1117 bytes} [Wed Aug 31 00:07:54 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:07:55.071035 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942aaf65-6dfe-4386-8b71-5f846efd5984 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:55.132956 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:55.140462 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42f278a-5542-447b-90d3-cad22c05e63c None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:55.181142 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387a6efc-ad3f-4792-9107-3193da3832fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:55.182743 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387a6efc-ad3f-4792-9107-3193da3832fe None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:55.183266 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387a6efc-ad3f-4792-9107-3193da3832fe None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:55.183770 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387a6efc-ad3f-4792-9107-3193da3832fe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:55.200914 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387a6efc-ad3f-4792-9107-3193da3832fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:55.201891 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942aaf65-6dfe-4386-8b71-5f846efd5984 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:55.202631 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387a6efc-ad3f-4792-9107-3193da3832fe None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:55.219669 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:55.222996 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-387a6efc-ad3f-4792-9107-3193da3832fe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:07:55.222996 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:55.222996 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:55.222996 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:55.222996 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:55.222996 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:55.222996 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:55.222996 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:55.222996 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:55.222996 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:55.222996 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:55.222996 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:55.222996 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:07:55.222996 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:07:55.222996 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:07:55.222996 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:07:55.224801 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:55.224801 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:55.224801 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:55.224801 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:55.224801 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:55.224801 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:55.224801 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:55.224801 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:55.224801 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:55.224801 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:55.224801 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:55.224801 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:55.224801 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:55.224801 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:55.224801 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:55.224801 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:55.224801 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:07:55.226532 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:07:55.226532 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:07:55.226532 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Aug 31 00:07:55.228339 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 434/846] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 00:07:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:07:55.230189 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387a6efc-ad3f-4792-9107-3193da3832fe None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:55.249844 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8163809-e3ab-422f-98dc-b8deff7b152f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:55.250781 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8163809-e3ab-422f-98dc-b8deff7b152f None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:55.251236 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8163809-e3ab-422f-98dc-b8deff7b152f None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:55.251694 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8163809-e3ab-422f-98dc-b8deff7b152f None admin] PATH_INFO: `/v3/users` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:55.252645 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8163809-e3ab-422f-98dc-b8deff7b152f None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:55.253127 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8163809-e3ab-422f-98dc-b8deff7b152f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:55.254763 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8163809-e3ab-422f-98dc-b8deff7b152f None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:55.275768 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 413/847] 10.222.0.47 () {56 vars in 1149 bytes} [Wed Aug 31 00:07:55 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:07:55.277524 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8163809-e3ab-422f-98dc-b8deff7b152f None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:55.389220 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387a6efc-ad3f-4792-9107-3193da3832fe None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:55.409806 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8163809-e3ab-422f-98dc-b8deff7b152f None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:55.432412 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f178fc2-79af-4062-807f-584e7f4fdadd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:55.433220 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f178fc2-79af-4062-807f-584e7f4fdadd None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:55.433220 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f178fc2-79af-4062-807f-584e7f4fdadd None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:55.433757 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f178fc2-79af-4062-807f-584e7f4fdadd None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:55.434244 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f178fc2-79af-4062-807f-584e7f4fdadd None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:55.436498 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f178fc2-79af-4062-807f-584e7f4fdadd None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:55.450037 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-3f178fc2-79af-4062-807f-584e7f4fdadd None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 31 00:07:55.450037 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:55.450037 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 00:07:55.450037 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 00:07:55.450037 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 00:07:55.450037 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 00:07:55.450037 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 00:07:55.450037 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:07:55.450037 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 31 00:07:55.450037 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Aug 31 00:07:55.450037 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 00:07:55.450037 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Aug 31 00:07:55.450037 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:55.450037 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:55.450037 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:55.450037 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:55.450037 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:55.451992 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:55.451992 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:55.451992 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:55.451992 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:55.451992 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:55.451992 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:55.451992 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 00:07:55.451992 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 00:07:55.451992 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 00:07:55.451992 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 00:07:55.451992 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:55.451992 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:55.451992 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:55.451992 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:55.451992 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:55.451992 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:55.453698 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:55.453698 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:55.453698 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:55.453698 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:55.453698 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:55.453698 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:55.453698 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:55.453698 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:55.453698 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:55.453698 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:55.453698 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 00:07:55.453698 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:07:55.453698 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 31 00:07:55.453698 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Aug 31 00:07:55.453698 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 435/848] 10.222.0.47 () {56 vars in 1114 bytes} [Wed Aug 31 00:07:55 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:07:55.457804 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f178fc2-79af-4062-807f-584e7f4fdadd None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:55.473592 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:55.492009 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9298a99e-6413-48eb-b273-7d4bda3ea45c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:55.492675 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9298a99e-6413-48eb-b273-7d4bda3ea45c None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:55.492948 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9298a99e-6413-48eb-b273-7d4bda3ea45c None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:55.493218 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9298a99e-6413-48eb-b273-7d4bda3ea45c None admin] PATH_INFO: `/v3/domains` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:55.493881 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9298a99e-6413-48eb-b273-7d4bda3ea45c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:55.494187 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9298a99e-6413-48eb-b273-7d4bda3ea45c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:55.496727 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9298a99e-6413-48eb-b273-7d4bda3ea45c None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:55.516200 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 414/849] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 31 00:07:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:55.525314 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9298a99e-6413-48eb-b273-7d4bda3ea45c None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:55.566440 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:55.622457 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f178fc2-79af-4062-807f-584e7f4fdadd None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:55.677873 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319d18d0-dcb1-4dc0-a0b3-ed148d65a671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:55.678488 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319d18d0-dcb1-4dc0-a0b3-ed148d65a671 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:55.678770 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319d18d0-dcb1-4dc0-a0b3-ed148d65a671 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:55.679175 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319d18d0-dcb1-4dc0-a0b3-ed148d65a671 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:55.705162 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9298a99e-6413-48eb-b273-7d4bda3ea45c None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:55.765325 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32aa42a-0efd-4180-8adb-d4890ed39ab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:55.766268 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32aa42a-0efd-4180-8adb-d4890ed39ab7 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:55.766729 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32aa42a-0efd-4180-8adb-d4890ed39ab7 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:55.767165 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32aa42a-0efd-4180-8adb-d4890ed39ab7 None admin] PATH_INFO: `/v3/services` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:55.768241 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32aa42a-0efd-4180-8adb-d4890ed39ab7 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:55.768883 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32aa42a-0efd-4180-8adb-d4890ed39ab7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:55.771259 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32aa42a-0efd-4180-8adb-d4890ed39ab7 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:55.786659 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 415/850] 10.222.0.47 () {56 vars in 1114 bytes} [Wed Aug 31 00:07:55 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:55.788002 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32aa42a-0efd-4180-8adb-d4890ed39ab7 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:55.805319 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319d18d0-dcb1-4dc0-a0b3-ed148d65a671 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:55.808066 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319d18d0-dcb1-4dc0-a0b3-ed148d65a671 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:55.827263 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:55.930563 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:55.938098 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32aa42a-0efd-4180-8adb-d4890ed39ab7 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:55.944702 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 436/851] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 31 00:07:55 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 492 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 00:07:55.945589 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319d18d0-dcb1-4dc0-a0b3-ed148d65a671 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:56.007408 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d527a06-512a-45a8-8919-649b95e493f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:56.008655 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d527a06-512a-45a8-8919-649b95e493f3 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:56.008770 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d527a06-512a-45a8-8919-649b95e493f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:56.009038 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d527a06-512a-45a8-8919-649b95e493f3 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:56.018132 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d527a06-512a-45a8-8919-649b95e493f3 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:56.019601 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d527a06-512a-45a8-8919-649b95e493f3 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:56.033259 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-3d527a06-512a-45a8-8919-649b95e493f3 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 31 00:07:56.033259 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:56.033259 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:56.033259 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:56.033259 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:56.033259 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:56.033259 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:56.033259 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:56.033259 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:56.033259 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:56.033259 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:56.033259 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:56.033259 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 00:07:56.033259 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 00:07:56.033259 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 00:07:56.033259 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 00:07:56.034986 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:56.034986 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:56.034986 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:07:56.034986 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:07:56.034986 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:07:56.034986 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:07:56.034986 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:56.034986 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:56.034986 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:56.034986 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:56.034986 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:56.034986 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:56.034986 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:56.034986 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:56.034986 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:56.034986 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:56.034986 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:56.034986 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:56.036560 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:56.036560 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:56.036560 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 00:07:56.036560 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 00:07:56.036560 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 00:07:56.036560 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 00:07:56.036560 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 00:07:56.036560 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 00:07:56.036560 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 31 00:07:56.036560 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 31 00:07:56.037664 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 416/852] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Aug 31 00:07:55 2022] GET /identity/v3/users/swift => generated 83 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:07:56.038939 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d527a06-512a-45a8-8919-649b95e493f3 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:56.092735 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319d18d0-dcb1-4dc0-a0b3-ed148d65a671 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:56.108487 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:56.146696 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfce5d36-1fed-45a7-b6d3-62d604c9579e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:56.147379 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfce5d36-1fed-45a7-b6d3-62d604c9579e None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:56.147878 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfce5d36-1fed-45a7-b6d3-62d604c9579e None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:56.148176 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfce5d36-1fed-45a7-b6d3-62d604c9579e None admin] PATH_INFO: `/v3/services` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:56.148844 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfce5d36-1fed-45a7-b6d3-62d604c9579e None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:56.149144 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfce5d36-1fed-45a7-b6d3-62d604c9579e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:56.150670 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfce5d36-1fed-45a7-b6d3-62d604c9579e None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:56.170627 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 437/853] 10.222.0.47 () {56 vars in 1114 bytes} [Wed Aug 31 00:07:55 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:56.170627 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfce5d36-1fed-45a7-b6d3-62d604c9579e None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:56.174319 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d527a06-512a-45a8-8919-649b95e493f3 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:56.224696 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3f7fab-a931-4d3d-9fbc-f0dac8dc9682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:56.225764 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3f7fab-a931-4d3d-9fbc-f0dac8dc9682 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:56.226412 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3f7fab-a931-4d3d-9fbc-f0dac8dc9682 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:56.226886 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3f7fab-a931-4d3d-9fbc-f0dac8dc9682 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:56.241417 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3f7fab-a931-4d3d-9fbc-f0dac8dc9682 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:56.242930 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3f7fab-a931-4d3d-9fbc-f0dac8dc9682 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:56.263430 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-0c3f7fab-a931-4d3d-9fbc-f0dac8dc9682 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:07:56.263430 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:56.263430 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:56.263430 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:56.263430 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:56.263430 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:56.263430 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:56.263430 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:56.263430 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:56.263430 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:56.263430 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:56.263430 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:56.263430 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:07:56.263430 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:07:56.263430 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:07:56.263430 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:07:56.265200 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:56.265200 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:56.265200 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:56.265200 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:56.265200 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:56.265200 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:56.265200 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:56.265200 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:56.265200 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:56.265200 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:56.265200 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:56.265200 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:56.265200 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:56.265200 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:56.265200 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:56.265200 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:56.265200 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:07:56.267367 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:07:56.267367 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:07:56.267367 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 31 00:07:56.269884 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 417/854] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 00:07:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:07:56.271094 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3f7fab-a931-4d3d-9fbc-f0dac8dc9682 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:56.295354 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:56.422314 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfce5d36-1fed-45a7-b6d3-62d604c9579e None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:56.474730 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea2cfbc-5ba9-47ca-a33a-bf991363b857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:56.475754 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea2cfbc-5ba9-47ca-a33a-bf991363b857 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:56.476254 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea2cfbc-5ba9-47ca-a33a-bf991363b857 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:56.476715 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea2cfbc-5ba9-47ca-a33a-bf991363b857 None admin] PATH_INFO: `/v3/users` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:56.477744 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea2cfbc-5ba9-47ca-a33a-bf991363b857 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:56.478274 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea2cfbc-5ba9-47ca-a33a-bf991363b857 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:56.480035 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea2cfbc-5ba9-47ca-a33a-bf991363b857 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:56.508351 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3f7fab-a931-4d3d-9fbc-f0dac8dc9682 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:56.509080 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 438/855] 10.222.0.47 () {56 vars in 1135 bytes} [Wed Aug 31 00:07:56 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:56.511425 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea2cfbc-5ba9-47ca-a33a-bf991363b857 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:56.549613 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75912357-e21f-47e9-a323-5eac19543fe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:56.550218 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75912357-e21f-47e9-a323-5eac19543fe7 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:56.550441 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75912357-e21f-47e9-a323-5eac19543fe7 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:56.550713 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75912357-e21f-47e9-a323-5eac19543fe7 None admin] PATH_INFO: `/v3/domains` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:56.551363 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75912357-e21f-47e9-a323-5eac19543fe7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:56.551665 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75912357-e21f-47e9-a323-5eac19543fe7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:56.553434 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75912357-e21f-47e9-a323-5eac19543fe7 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:56.575164 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 418/856] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 31 00:07:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:56.576162 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75912357-e21f-47e9-a323-5eac19543fe7 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:56.590160 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:56.676758 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:56.725049 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea2cfbc-5ba9-47ca-a33a-bf991363b857 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:56.736941 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75912357-e21f-47e9-a323-5eac19543fe7 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:56.778829 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a57490b-8c72-4649-9c68-24ae60936622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:56.780062 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a57490b-8c72-4649-9c68-24ae60936622 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:56.780709 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a57490b-8c72-4649-9c68-24ae60936622 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:56.781295 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a57490b-8c72-4649-9c68-24ae60936622 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:56.797467 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e0db48-34fa-4338-b343-201738860de0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:56.798450 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e0db48-34fa-4338-b343-201738860de0 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:56.799677 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e0db48-34fa-4338-b343-201738860de0 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:56.800111 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e0db48-34fa-4338-b343-201738860de0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:56.812447 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e0db48-34fa-4338-b343-201738860de0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:56.815497 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e0db48-34fa-4338-b343-201738860de0 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:56.831627 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-84e0db48-34fa-4338-b343-201738860de0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:07:56.831627 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:56.831627 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:56.831627 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:56.831627 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:56.831627 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:56.831627 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:56.831627 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:56.831627 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:56.831627 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:56.831627 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:56.831627 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:56.831627 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 00:07:56.831627 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 00:07:56.831627 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 00:07:56.832830 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 00:07:56.832830 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:56.832830 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:56.832830 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:56.832830 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:56.832830 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:56.832830 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:56.832830 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:56.832830 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:56.832830 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:56.832830 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:56.832830 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:56.832830 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:56.832830 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:56.832830 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:56.832830 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:56.832830 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:56.833944 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 00:07:56.833944 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 00:07:56.833944 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:07:56.833944 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:07:56.833944 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:07:56.833944 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:07:56.833944 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:07:56.833944 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 31 00:07:56.835931 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 419/857] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 31 00:07:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:07:56.837402 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dc3d07-ba82-4608-be84-2e3144a8145b None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:56.837685 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dc3d07-ba82-4608-be84-2e3144a8145b None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:56.837957 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dc3d07-ba82-4608-be84-2e3144a8145b None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:56.840821 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 420/858] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 00:07:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:07:56.842648 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dc3d07-ba82-4608-be84-2e3144a8145b None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:56.914185 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a57490b-8c72-4649-9c68-24ae60936622 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:56.915686 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a57490b-8c72-4649-9c68-24ae60936622 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:56.956883 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:56.980635 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dc3d07-ba82-4608-be84-2e3144a8145b None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:57.017272 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:57.032428 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ac363d-6929-4c09-8de5-47b32db54ce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:57.033227 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ac363d-6929-4c09-8de5-47b32db54ce6 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:57.033531 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ac363d-6929-4c09-8de5-47b32db54ce6 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:57.033779 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ac363d-6929-4c09-8de5-47b32db54ce6 None admin] PATH_INFO: `/v3/projects` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:57.034949 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ac363d-6929-4c09-8de5-47b32db54ce6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:57.035394 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ac363d-6929-4c09-8de5-47b32db54ce6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:57.037029 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ac363d-6929-4c09-8de5-47b32db54ce6 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:57.050041 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 421/859] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Aug 31 00:07:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:07:57.051280 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163e637f-a450-4a2d-bf29-b1645bb3660e None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:57.051584 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163e637f-a450-4a2d-bf29-b1645bb3660e None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:57.051824 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163e637f-a450-4a2d-bf29-b1645bb3660e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:57.071509 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-163e637f-a450-4a2d-bf29-b1645bb3660e None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:07:57.072741 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-163e637f-a450-4a2d-bf29-b1645bb3660e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:07:57.083936 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 439/860] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 31 00:07:56 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 569 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 31 00:07:57.083936 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a57490b-8c72-4649-9c68-24ae60936622 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:57.200225 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 422/861] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 00:07:57 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:07:57.201111 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163e637f-a450-4a2d-bf29-b1645bb3660e None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:57.211352 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a57490b-8c72-4649-9c68-24ae60936622 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:57.248550 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:57.258274 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c530cac8-4028-4501-bfd7-4aefd2287fce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:57.259821 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c530cac8-4028-4501-bfd7-4aefd2287fce None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:57.260496 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c530cac8-4028-4501-bfd7-4aefd2287fce None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:57.261087 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c530cac8-4028-4501-bfd7-4aefd2287fce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:57.262789 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c530cac8-4028-4501-bfd7-4aefd2287fce None admin] RBAC: Adding query filter params (role.id=1e6d7ecde4b0415bb944f25eda475f9c, scope.project.id=1b647cccb30a427193fc62dbebe0c6f1, user.id=601aa9e547aa4d42bef6753b26f48eaa) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:57.263370 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c530cac8-4028-4501-bfd7-4aefd2287fce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:57.266449 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c530cac8-4028-4501-bfd7-4aefd2287fce None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:57.280107 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 440/862] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 31 00:07:57 2022] GET /identity/v3/role_assignments?user.id=601aa9e547aa4d42bef6753b26f48eaa&scope.project.id=1b647cccb30a427193fc62dbebe0c6f1&role.id=1e6d7ecde4b0415bb944f25eda475f9c => generated 608 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:57.397273 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163e637f-a450-4a2d-bf29-b1645bb3660e None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:57.436592 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:57.472479 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dd6a8d-36ca-48d3-9ba1-f3427faf4a47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:57.473551 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dd6a8d-36ca-48d3-9ba1-f3427faf4a47 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:57.474037 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dd6a8d-36ca-48d3-9ba1-f3427faf4a47 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:57.474524 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dd6a8d-36ca-48d3-9ba1-f3427faf4a47 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:57.489199 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c530cac8-4028-4501-bfd7-4aefd2287fce None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:57.494178 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dd6a8d-36ca-48d3-9ba1-f3427faf4a47 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:57.497656 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dd6a8d-36ca-48d3-9ba1-f3427faf4a47 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:57.521254 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-94dd6a8d-36ca-48d3-9ba1-f3427faf4a47 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:07:57.521254 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:57.521254 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:57.521254 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:57.521254 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:57.521254 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:57.521254 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:57.521254 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:57.521254 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:57.521254 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:57.521254 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:57.521254 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:57.521254 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:07:57.521254 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:07:57.521254 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:07:57.521254 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:07:57.523145 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:57.523145 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:57.523145 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:57.523145 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:57.523145 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:57.523145 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:57.523145 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:57.523145 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:57.523145 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:57.523145 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:57.523145 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:57.523145 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:57.523145 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:57.523145 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:57.523145 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:57.523145 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:57.523145 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:07:57.524188 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:07:57.524188 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:07:57.524188 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 31 00:07:57.524188 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 423/863] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 00:07:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:07:57.532132 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dd6a8d-36ca-48d3-9ba1-f3427faf4a47 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:57.629761 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c530cac8-4028-4501-bfd7-4aefd2287fce None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:57.675935 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061156fc-2053-4270-9148-e63b0df0edf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:57.676616 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061156fc-2053-4270-9148-e63b0df0edf7 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:57.677072 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061156fc-2053-4270-9148-e63b0df0edf7 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:57.677515 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061156fc-2053-4270-9148-e63b0df0edf7 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:57.678795 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061156fc-2053-4270-9148-e63b0df0edf7 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:57.681396 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061156fc-2053-4270-9148-e63b0df0edf7 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:57.690848 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dd6a8d-36ca-48d3-9ba1-f3427faf4a47 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:57.701621 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-061156fc-2053-4270-9148-e63b0df0edf7 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 31 00:07:57.701621 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:57.701621 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 00:07:57.701621 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 00:07:57.701621 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 00:07:57.701621 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 00:07:57.701621 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 00:07:57.701621 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:07:57.701621 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 31 00:07:57.701621 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Aug 31 00:07:57.701621 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 00:07:57.701621 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Aug 31 00:07:57.701621 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:57.701621 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:57.701621 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:57.701621 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:57.702863 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:57.702863 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:57.702863 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:57.702863 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:57.702863 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:57.702863 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:57.702863 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:57.702863 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 00:07:57.702863 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 00:07:57.702863 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 00:07:57.702863 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 00:07:57.702863 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:57.702863 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:57.702863 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:57.702863 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:57.702863 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:57.702863 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:57.703946 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:57.703946 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:57.703946 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:57.703946 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:57.703946 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:57.703946 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:57.703946 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:57.703946 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:57.703946 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:57.703946 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:57.703946 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 00:07:57.703946 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:07:57.703946 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 31 00:07:57.703946 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Aug 31 00:07:57.704873 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 441/864] 10.222.0.47 () {56 vars in 1132 bytes} [Wed Aug 31 00:07:57 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:07:57.710200 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061156fc-2053-4270-9148-e63b0df0edf7 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:57.740358 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9a4a7a-f61e-4051-844e-0008923a7f05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:57.741866 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9a4a7a-f61e-4051-844e-0008923a7f05 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:57.742316 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9a4a7a-f61e-4051-844e-0008923a7f05 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:57.742992 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9a4a7a-f61e-4051-844e-0008923a7f05 None admin] PATH_INFO: `/v3/domains` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:57.743803 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9a4a7a-f61e-4051-844e-0008923a7f05 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:57.744532 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9a4a7a-f61e-4051-844e-0008923a7f05 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:57.747991 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9a4a7a-f61e-4051-844e-0008923a7f05 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:57.764079 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 424/865] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 31 00:07:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:57.774040 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9a4a7a-f61e-4051-844e-0008923a7f05 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:57.796220 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:57.832617 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:57.881336 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061156fc-2053-4270-9148-e63b0df0edf7 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:57.937892 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9a4a7a-f61e-4051-844e-0008923a7f05 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:57.943471 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5066213d-1c55-4415-8f64-3d5e8659e30b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:57.944206 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5066213d-1c55-4415-8f64-3d5e8659e30b None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:57.944569 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5066213d-1c55-4415-8f64-3d5e8659e30b None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:57.944917 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5066213d-1c55-4415-8f64-3d5e8659e30b None admin] PATH_INFO: `/v3/services` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:57.945655 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5066213d-1c55-4415-8f64-3d5e8659e30b None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:57.946030 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5066213d-1c55-4415-8f64-3d5e8659e30b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:57.947507 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5066213d-1c55-4415-8f64-3d5e8659e30b None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:57.954348 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 442/866] 10.222.0.47 () {56 vars in 1126 bytes} [Wed Aug 31 00:07:57 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:57.960574 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5066213d-1c55-4415-8f64-3d5e8659e30b None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:58.021398 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c81d749-7cfc-48d6-8b8b-c68d9013a98c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:58.022541 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c81d749-7cfc-48d6-8b8b-c68d9013a98c None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:58.023048 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c81d749-7cfc-48d6-8b8b-c68d9013a98c None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:58.023559 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c81d749-7cfc-48d6-8b8b-c68d9013a98c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:58.038097 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c81d749-7cfc-48d6-8b8b-c68d9013a98c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:58.041131 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c81d749-7cfc-48d6-8b8b-c68d9013a98c None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:58.057233 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-5c81d749-7cfc-48d6-8b8b-c68d9013a98c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:07:58.057233 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:07:58.057233 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:07:58.057233 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:07:58.057233 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:07:58.057233 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:07:58.057233 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:07:58.057233 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:07:58.057233 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:07:58.057233 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:07:58.057233 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:07:58.057233 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:07:58.057233 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 00:07:58.057233 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 00:07:58.057233 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 00:07:58.058214 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 00:07:58.058214 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:07:58.058214 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:07:58.058214 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:07:58.058214 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:07:58.058214 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:07:58.058214 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:07:58.058214 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:07:58.058214 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 31 00:07:58.058214 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:07:58.058214 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:07:58.058214 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:07:58.058214 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:07:58.058214 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:07:58.058214 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:07:58.058214 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:07:58.058214 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:07:58.059422 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 00:07:58.059422 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 00:07:58.059422 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:07:58.059422 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:07:58.059422 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:07:58.059422 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:07:58.059422 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:07:58.059422 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 31 00:07:58.059422 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 425/867] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 31 00:07:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:07:58.070145 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c81d749-7cfc-48d6-8b8b-c68d9013a98c None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:58.114488 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5066213d-1c55-4415-8f64-3d5e8659e30b None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:58.160554 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:58.182348 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1538971a-baf8-4e8c-b17e-c12ffb4d6816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:58.183466 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1538971a-baf8-4e8c-b17e-c12ffb4d6816 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:58.183877 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1538971a-baf8-4e8c-b17e-c12ffb4d6816 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:58.184374 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1538971a-baf8-4e8c-b17e-c12ffb4d6816 None admin] PATH_INFO: `/v3/services` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:58.185473 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1538971a-baf8-4e8c-b17e-c12ffb4d6816 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:58.185990 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1538971a-baf8-4e8c-b17e-c12ffb4d6816 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:58.188619 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1538971a-baf8-4e8c-b17e-c12ffb4d6816 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:58.204178 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 443/868] 10.222.0.47 () {56 vars in 1126 bytes} [Wed Aug 31 00:07:57 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:58.247321 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:58.262591 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c81d749-7cfc-48d6-8b8b-c68d9013a98c None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:58.268924 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac78edf-b3b7-4687-bc02-980bc8c2a8e3 None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:58.269271 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac78edf-b3b7-4687-bc02-980bc8c2a8e3 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:58.269484 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac78edf-b3b7-4687-bc02-980bc8c2a8e3 None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:58.271046 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 444/869] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 00:07:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 00:07:58.277536 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a733c3e-81ad-40c4-9d12-00ed89ddcb1e None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:58.277827 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a733c3e-81ad-40c4-9d12-00ed89ddcb1e None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:58.278111 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a733c3e-81ad-40c4-9d12-00ed89ddcb1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:58.302770 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-3a733c3e-81ad-40c4-9d12-00ed89ddcb1e None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:07:58.304036 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-3a733c3e-81ad-40c4-9d12-00ed89ddcb1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:07:58.316712 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e4079d-d3e4-49bb-8e20-8e153269c011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:58.317797 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e4079d-d3e4-49bb-8e20-8e153269c011 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:58.317797 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e4079d-d3e4-49bb-8e20-8e153269c011 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:58.318146 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e4079d-d3e4-49bb-8e20-8e153269c011 None admin] PATH_INFO: `/v3/projects` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:58.318700 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e4079d-d3e4-49bb-8e20-8e153269c011 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:58.319016 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e4079d-d3e4-49bb-8e20-8e153269c011 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:58.320560 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e4079d-d3e4-49bb-8e20-8e153269c011 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:58.336710 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 426/870] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Aug 31 00:07:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:58.345513 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e4079d-d3e4-49bb-8e20-8e153269c011 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:58.431790 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 445/871] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 00:07:58 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 00:07:58.499677 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e4079d-d3e4-49bb-8e20-8e153269c011 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:58.548308 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8404a605-f489-4ac4-9060-9f80e6024682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:58.549419 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8404a605-f489-4ac4-9060-9f80e6024682 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:58.549419 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8404a605-f489-4ac4-9060-9f80e6024682 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:58.549746 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8404a605-f489-4ac4-9060-9f80e6024682 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:58.550522 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8404a605-f489-4ac4-9060-9f80e6024682 None admin] RBAC: Adding query filter params (role.id=12f6817f9aaa4e2bb477095a6bed5d0f, scope.project.id=1b647cccb30a427193fc62dbebe0c6f1, user.id=ffbfbf19509645f49dbf9566e447c8c5) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:07:58.551043 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8404a605-f489-4ac4-9060-9f80e6024682 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:58.552908 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8404a605-f489-4ac4-9060-9f80e6024682 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:58.561106 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 427/872] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 31 00:07:58 2022] GET /identity/v3/role_assignments?user.id=ffbfbf19509645f49dbf9566e447c8c5&scope.project.id=1b647cccb30a427193fc62dbebe0c6f1&role.id=12f6817f9aaa4e2bb477095a6bed5d0f => generated 608 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:07:58.745285 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a733c3e-81ad-40c4-9d12-00ed89ddcb1e None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:07:58.904777 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a733c3e-81ad-40c4-9d12-00ed89ddcb1e None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:07:58.938698 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:07:58.973132 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddfc6cc-59fb-4b8e-bf43-0e670b5b2a51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:07:58.974230 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddfc6cc-59fb-4b8e-bf43-0e670b5b2a51 None admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:58.974828 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddfc6cc-59fb-4b8e-bf43-0e670b5b2a51 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:58.975349 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddfc6cc-59fb-4b8e-bf43-0e670b5b2a51 None admin] PATH_INFO: `/v3/services` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:58.976899 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddfc6cc-59fb-4b8e-bf43-0e670b5b2a51 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:07:58.979867 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddfc6cc-59fb-4b8e-bf43-0e670b5b2a51 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:07:59.008603 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 446/873] 10.222.0.47 () {60 vars in 1141 bytes} [Wed Aug 31 00:07:58 2022] POST /identity/v3/services => generated 251 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:07:59.603092 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4869c0e0-5507-4ed9-ba47-98512cdf5ac1 None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:59.603613 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4869c0e0-5507-4ed9-ba47-98512cdf5ac1 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:59.603613 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4869c0e0-5507-4ed9-ba47-98512cdf5ac1 None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:59.605274 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 428/874] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 00:07:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:07:59.610842 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d011234-5090-496c-80bd-67935ed85010 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:07:59.611136 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d011234-5090-496c-80bd-67935ed85010 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:07:59.611414 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d011234-5090-496c-80bd-67935ed85010 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:07:59.630988 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-4d011234-5090-496c-80bd-67935ed85010 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:07:59.632215 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-4d011234-5090-496c-80bd-67935ed85010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:07:59.735814 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 447/875] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 00:07:59 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 00:08:00.012981 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4869c0e0-5507-4ed9-ba47-98512cdf5ac1 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:00.040186 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:00.148676 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4869c0e0-5507-4ed9-ba47-98512cdf5ac1 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:00.198506 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86f366d-548b-4479-a319-8f37f25928ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:00.199527 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86f366d-548b-4479-a319-8f37f25928ec None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:00.200017 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86f366d-548b-4479-a319-8f37f25928ec None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:00.200580 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86f366d-548b-4479-a319-8f37f25928ec None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:00.214548 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86f366d-548b-4479-a319-8f37f25928ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:08:00.219533 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-f86f366d-548b-4479-a319-8f37f25928ec None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 00:08:00.219533 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:00.219533 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:08:00.219533 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:08:00.219533 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:08:00.219533 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:08:00.219533 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:08:00.219533 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:08:00.219533 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:08:00.219533 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:08:00.219533 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:08:00.219533 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:08:00.219533 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:08:00.219533 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:08:00.219533 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:08:00.219533 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:08:00.220525 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:08:00.220525 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:08:00.220525 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:08:00.220525 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:08:00.220525 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:08:00.220525 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:08:00.220525 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:08:00.220525 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:08:00.220525 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:08:00.220525 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:08:00.220525 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:08:00.220525 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 31 00:08:00.220525 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:08:00.220525 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:08:00.220525 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:08:00.220525 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:08:00.221393 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:08:00.221393 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:08:00.221393 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:08:00.221393 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:08:00.221393 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:08:00.221393 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:08:00.221393 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:08:00.221393 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:08:00.221393 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:08:00.221393 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:08:00.221393 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 00:08:00.221393 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 31 00:08:00.221393 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 429/876] 10.222.0.47 () {56 vars in 1120 bytes} [Wed Aug 31 00:08:00 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:08:00.230586 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d011234-5090-496c-80bd-67935ed85010 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:00.363439 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d011234-5090-496c-80bd-67935ed85010 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:00.365838 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:00.409882 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2e3a97-fe2b-4037-97a9-9c60db3de5f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:00.410502 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2e3a97-fe2b-4037-97a9-9c60db3de5f1 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:00.410781 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2e3a97-fe2b-4037-97a9-9c60db3de5f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:00.411063 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2e3a97-fe2b-4037-97a9-9c60db3de5f1 None admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:00.411721 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2e3a97-fe2b-4037-97a9-9c60db3de5f1 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:00.412022 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2e3a97-fe2b-4037-97a9-9c60db3de5f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:00.413424 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2e3a97-fe2b-4037-97a9-9c60db3de5f1 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:00.423200 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 448/877] 10.222.0.47 () {56 vars in 1115 bytes} [Wed Aug 31 00:08:00 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:00.433924 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86f366d-548b-4479-a319-8f37f25928ec None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:00.553551 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:00.584373 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86f366d-548b-4479-a319-8f37f25928ec None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:00.623954 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118a6923-e76a-4d3a-b51a-320d3e061599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:00.624933 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118a6923-e76a-4d3a-b51a-320d3e061599 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:00.624933 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118a6923-e76a-4d3a-b51a-320d3e061599 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:00.625213 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118a6923-e76a-4d3a-b51a-320d3e061599 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:00.637766 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118a6923-e76a-4d3a-b51a-320d3e061599 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:00.639263 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118a6923-e76a-4d3a-b51a-320d3e061599 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:00.656106 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-118a6923-e76a-4d3a-b51a-320d3e061599 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:08:00.656106 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:00.656106 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:08:00.656106 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:08:00.656106 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:08:00.656106 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:08:00.656106 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:08:00.656106 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:08:00.656106 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:08:00.656106 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:08:00.656106 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:08:00.656106 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:08:00.656106 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:08:00.656106 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:08:00.656106 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:08:00.656106 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:08:00.658007 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:08:00.658007 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:08:00.658007 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:08:00.658007 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:08:00.658007 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:08:00.658007 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:08:00.658007 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:08:00.658007 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 31 00:08:00.658007 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:08:00.658007 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:08:00.658007 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:08:00.658007 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:08:00.658007 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:08:00.658007 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:08:00.658007 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:08:00.658007 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:08:00.658007 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:08:00.660053 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:08:00.660053 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:08:00.660053 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 31 00:08:00.660053 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 430/878] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 00:08:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:08:00.671466 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2e3a97-fe2b-4037-97a9-9c60db3de5f1 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:00.728217 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88e13e9-b00b-4604-bf0d-b3926a3abed7 None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:00.728633 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88e13e9-b00b-4604-bf0d-b3926a3abed7 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:00.728824 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88e13e9-b00b-4604-bf0d-b3926a3abed7 None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:00.730905 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 431/879] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 00:08:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 00:08:00.736293 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696649a1-f2b9-4dd2-9b28-cd50e3922277 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:00.736621 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696649a1-f2b9-4dd2-9b28-cd50e3922277 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:00.736892 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696649a1-f2b9-4dd2-9b28-cd50e3922277 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:00.760668 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-696649a1-f2b9-4dd2-9b28-cd50e3922277 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:08:00.762076 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-696649a1-f2b9-4dd2-9b28-cd50e3922277 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:08:00.822267 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2e3a97-fe2b-4037-97a9-9c60db3de5f1 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:00.844470 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 432/880] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 00:08:00 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 00:08:00.860884 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f73d69-b688-4a4b-b77c-41f0833c690a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:00.861505 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f73d69-b688-4a4b-b77c-41f0833c690a None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:00.861775 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f73d69-b688-4a4b-b77c-41f0833c690a None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:00.862057 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f73d69-b688-4a4b-b77c-41f0833c690a None admin] PATH_INFO: `/v3/domains` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:00.862716 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f73d69-b688-4a4b-b77c-41f0833c690a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:00.863022 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f73d69-b688-4a4b-b77c-41f0833c690a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:00.864437 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f73d69-b688-4a4b-b77c-41f0833c690a None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:00.878337 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 449/881] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 31 00:08:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:08:00.886737 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696649a1-f2b9-4dd2-9b28-cd50e3922277 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:00.966045 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1775e1ec-4142-45da-aedc-b6916f33fc09 None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:00.966467 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1775e1ec-4142-45da-aedc-b6916f33fc09 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:00.966658 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1775e1ec-4142-45da-aedc-b6916f33fc09 None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:00.968337 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 450/882] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 00:08:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 00:08:00.973657 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9738d5f-4e70-4745-89ef-a7453fb0d66b None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:00.973982 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9738d5f-4e70-4745-89ef-a7453fb0d66b None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:00.974324 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9738d5f-4e70-4745-89ef-a7453fb0d66b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:00.975194 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:00.997067 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-a9738d5f-4e70-4745-89ef-a7453fb0d66b None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:08:00.998398 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-a9738d5f-4e70-4745-89ef-a7453fb0d66b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:08:01.022305 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:01.027461 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696649a1-f2b9-4dd2-9b28-cd50e3922277 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:01.066391 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252bd2ab-1fd3-4ef4-8a6b-9fdc1cafed53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:01.067315 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252bd2ab-1fd3-4ef4-8a6b-9fdc1cafed53 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:01.067834 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252bd2ab-1fd3-4ef4-8a6b-9fdc1cafed53 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:01.068297 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252bd2ab-1fd3-4ef4-8a6b-9fdc1cafed53 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:01.077127 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252bd2ab-1fd3-4ef4-8a6b-9fdc1cafed53 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:01.078851 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252bd2ab-1fd3-4ef4-8a6b-9fdc1cafed53 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:01.084319 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 451/883] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 00:08:00 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 00:08:01.092181 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-252bd2ab-1fd3-4ef4-8a6b-9fdc1cafed53 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 00:08:01.092181 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:01.092181 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:08:01.092181 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:08:01.092181 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:08:01.092181 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:08:01.092181 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:08:01.092181 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:08:01.092181 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:08:01.092181 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:08:01.092181 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:08:01.092181 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:08:01.092181 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 00:08:01.092181 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 00:08:01.092181 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 00:08:01.092181 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 00:08:01.093286 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:08:01.093286 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:08:01.093286 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:08:01.093286 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:08:01.093286 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:08:01.093286 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:08:01.093286 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:08:01.093286 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:08:01.093286 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:08:01.093286 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:08:01.093286 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:08:01.093286 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 31 00:08:01.093286 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:08:01.093286 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:08:01.093286 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:08:01.093286 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:08:01.093286 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:08:01.093286 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:08:01.094258 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:08:01.094258 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:08:01.094258 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 00:08:01.094258 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 00:08:01.094258 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 00:08:01.094258 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 00:08:01.094258 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 00:08:01.094258 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 00:08:01.094258 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 00:08:01.094258 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 31 00:08:01.094258 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 433/884] 10.222.0.47 () {56 vars in 1117 bytes} [Wed Aug 31 00:08:00 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:08:01.102312 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9738d5f-4e70-4745-89ef-a7453fb0d66b None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:01.177712 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f834f2ad-0088-49b3-8595-0472405fd222 None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:01.178611 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f834f2ad-0088-49b3-8595-0472405fd222 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:01.179353 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f834f2ad-0088-49b3-8595-0472405fd222 None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:01.182852 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 434/885] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 00:08:01 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:08:01.188885 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93b9b76-1847-402d-a3c0-df5ccb27a8e3 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:01.189465 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93b9b76-1847-402d-a3c0-df5ccb27a8e3 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:01.189951 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93b9b76-1847-402d-a3c0-df5ccb27a8e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:01.210506 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-d93b9b76-1847-402d-a3c0-df5ccb27a8e3 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:08:01.212014 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-d93b9b76-1847-402d-a3c0-df5ccb27a8e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:08:01.215647 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9738d5f-4e70-4745-89ef-a7453fb0d66b None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:01.261949 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64189249-5c05-4f3d-aba5-dea49cdaa760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:01.262605 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64189249-5c05-4f3d-aba5-dea49cdaa760 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:01.263309 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64189249-5c05-4f3d-aba5-dea49cdaa760 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:01.263309 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64189249-5c05-4f3d-aba5-dea49cdaa760 None admin] PATH_INFO: `/v3/users` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:01.263838 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64189249-5c05-4f3d-aba5-dea49cdaa760 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:01.264167 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64189249-5c05-4f3d-aba5-dea49cdaa760 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:01.265659 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64189249-5c05-4f3d-aba5-dea49cdaa760 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:01.288705 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 452/886] 10.222.0.47 () {56 vars in 1149 bytes} [Wed Aug 31 00:08:01 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:08:01.288705 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64189249-5c05-4f3d-aba5-dea49cdaa760 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:01.301041 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 435/887] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 00:08:01 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 00:08:01.302331 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93b9b76-1847-402d-a3c0-df5ccb27a8e3 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:01.327642 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:01.366895 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:01.428583 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93b9b76-1847-402d-a3c0-df5ccb27a8e3 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:01.468998 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f82f05-91d3-4dba-9328-63aa6de0509d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:01.469621 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f82f05-91d3-4dba-9328-63aa6de0509d None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:01.469906 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f82f05-91d3-4dba-9328-63aa6de0509d None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:01.470181 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f82f05-91d3-4dba-9328-63aa6de0509d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:01.475146 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64189249-5c05-4f3d-aba5-dea49cdaa760 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:01.518564 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f723fd90-053f-4d1f-917d-7e021830fd03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:01.519249 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f723fd90-053f-4d1f-917d-7e021830fd03 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:01.519522 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f723fd90-053f-4d1f-917d-7e021830fd03 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:01.519788 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f723fd90-053f-4d1f-917d-7e021830fd03 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:01.520412 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f723fd90-053f-4d1f-917d-7e021830fd03 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:01.521785 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f723fd90-053f-4d1f-917d-7e021830fd03 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:01.532744 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-f723fd90-053f-4d1f-917d-7e021830fd03 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 00:08:01.532744 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:01.532744 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 00:08:01.532744 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 00:08:01.532744 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 00:08:01.532744 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 00:08:01.532744 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 00:08:01.532744 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:08:01.532744 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 00:08:01.532744 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Aug 31 00:08:01.532744 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 00:08:01.532744 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Aug 31 00:08:01.532744 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:01.532744 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:08:01.532744 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:08:01.532744 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:08:01.532744 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:08:01.535070 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:08:01.535070 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:08:01.535070 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:08:01.535070 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:08:01.535070 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:08:01.535070 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:08:01.535070 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 00:08:01.535070 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 00:08:01.535070 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 00:08:01.535070 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 00:08:01.535070 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:08:01.535070 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:08:01.535070 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:08:01.535070 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:08:01.535070 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:08:01.535070 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:08:01.537001 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:08:01.537001 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Aug 31 00:08:01.537001 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:08:01.537001 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:08:01.537001 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:08:01.537001 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:08:01.537001 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:08:01.537001 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:08:01.537001 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:08:01.537001 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:08:01.537001 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 00:08:01.537001 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:08:01.537001 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 00:08:01.537001 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Aug 31 00:08:01.537001 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 453/888] 10.222.0.47 () {56 vars in 1126 bytes} [Wed Aug 31 00:08:01 2022] GET /identity/v3/services/object-store => generated 93 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:08:01.538717 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f723fd90-053f-4d1f-917d-7e021830fd03 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:01.562132 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f82f05-91d3-4dba-9328-63aa6de0509d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:01.563725 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f82f05-91d3-4dba-9328-63aa6de0509d None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:01.620977 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:01.645940 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:01.674283 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f723fd90-053f-4d1f-917d-7e021830fd03 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:01.699697 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 436/889] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 31 00:08:01 2022] GET /identity/v3/auth/tokens => generated 1262 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 00:08:01.701774 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f82f05-91d3-4dba-9328-63aa6de0509d None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:01.712587 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4001f009-d276-417c-922a-689eeb61f4bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:01.713476 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4001f009-d276-417c-922a-689eeb61f4bd None admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:01.713763 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4001f009-d276-417c-922a-689eeb61f4bd None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:01.714042 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4001f009-d276-417c-922a-689eeb61f4bd None admin] PATH_INFO: `/v3/services` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:01.714709 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4001f009-d276-417c-922a-689eeb61f4bd None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:01.716071 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4001f009-d276-417c-922a-689eeb61f4bd None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:01.736223 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 454/890] 10.222.0.47 () {60 vars in 1141 bytes} [Wed Aug 31 00:08:01 2022] POST /identity/v3/services => generated 269 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:08:01.736223 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4001f009-d276-417c-922a-689eeb61f4bd None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:01.861817 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f82f05-91d3-4dba-9328-63aa6de0509d None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:01.877661 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4001f009-d276-417c-922a-689eeb61f4bd None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:01.921329 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcf80c3-0eeb-4ebc-a28d-c877487d1b76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:01.922482 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcf80c3-0eeb-4ebc-a28d-c877487d1b76 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:01.922758 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcf80c3-0eeb-4ebc-a28d-c877487d1b76 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:01.923293 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcf80c3-0eeb-4ebc-a28d-c877487d1b76 None admin] PATH_INFO: `/v3/services` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:01.923941 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcf80c3-0eeb-4ebc-a28d-c877487d1b76 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:01.924319 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcf80c3-0eeb-4ebc-a28d-c877487d1b76 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:01.925706 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcf80c3-0eeb-4ebc-a28d-c877487d1b76 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:01.927561 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e827a4-ad2e-4281-a430-7cf3923cacc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:01.928449 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e827a4-ad2e-4281-a430-7cf3923cacc2 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:01.928904 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e827a4-ad2e-4281-a430-7cf3923cacc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:01.929258 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e827a4-ad2e-4281-a430-7cf3923cacc2 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:01.930097 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e827a4-ad2e-4281-a430-7cf3923cacc2 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:01.931399 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 437/891] 10.222.0.47 () {56 vars in 1122 bytes} [Wed Aug 31 00:08:01 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:01.932454 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e827a4-ad2e-4281-a430-7cf3923cacc2 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:01.932599 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcf80c3-0eeb-4ebc-a28d-c877487d1b76 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:01.935827 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:01.949171 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:01.950396 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-56e827a4-ad2e-4281-a430-7cf3923cacc2 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 31 00:08:01.950396 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:01.950396 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 00:08:01.950396 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 00:08:01.950396 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 00:08:01.950396 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 00:08:01.950396 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 00:08:01.950396 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:08:01.950396 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 31 00:08:01.950396 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Aug 31 00:08:01.950396 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 00:08:01.950396 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Aug 31 00:08:01.950396 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:01.950396 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:08:01.950396 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:08:01.950396 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:08:01.950396 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:08:01.951635 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:08:01.951635 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:08:01.951635 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:08:01.951635 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:08:01.951635 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:08:01.951635 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:08:01.951635 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 00:08:01.951635 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 00:08:01.951635 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 00:08:01.951635 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 00:08:01.951635 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:08:01.951635 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:08:01.951635 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:08:01.951635 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:08:01.951635 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:08:01.951635 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:08:01.952671 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:08:01.952671 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Aug 31 00:08:01.952671 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:08:01.952671 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:08:01.952671 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:08:01.952671 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:08:01.952671 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:08:01.952671 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:08:01.952671 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:08:01.952671 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:08:01.952671 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 00:08:01.952671 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:08:01.952671 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 31 00:08:01.952671 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Aug 31 00:08:01.952671 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 455/892] 10.222.0.47 () {56 vars in 1114 bytes} [Wed Aug 31 00:08:01 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:08:01.953933 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e827a4-ad2e-4281-a430-7cf3923cacc2 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:02.076589 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcf80c3-0eeb-4ebc-a28d-c877487d1b76 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:02.103545 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e827a4-ad2e-4281-a430-7cf3923cacc2 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:02.122542 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2276ee-219a-4f72-ad6b-be23909c1f46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:02.123316 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2276ee-219a-4f72-ad6b-be23909c1f46 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:02.123669 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2276ee-219a-4f72-ad6b-be23909c1f46 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:02.124016 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2276ee-219a-4f72-ad6b-be23909c1f46 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:02.137160 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2276ee-219a-4f72-ad6b-be23909c1f46 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:02.138814 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2276ee-219a-4f72-ad6b-be23909c1f46 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:02.142254 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b027d8a2-20ff-4c8b-ace0-910176d35847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:02.142877 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b027d8a2-20ff-4c8b-ace0-910176d35847 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:02.143158 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b027d8a2-20ff-4c8b-ace0-910176d35847 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:02.143431 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b027d8a2-20ff-4c8b-ace0-910176d35847 None admin] PATH_INFO: `/v3/services` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:02.144068 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b027d8a2-20ff-4c8b-ace0-910176d35847 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:02.144592 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b027d8a2-20ff-4c8b-ace0-910176d35847 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:02.145769 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b027d8a2-20ff-4c8b-ace0-910176d35847 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:02.161120 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 456/893] 10.222.0.47 () {56 vars in 1122 bytes} [Wed Aug 31 00:08:01 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:02.161120 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b027d8a2-20ff-4c8b-ace0-910176d35847 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:02.162759 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-6b2276ee-219a-4f72-ad6b-be23909c1f46 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:08:02.162759 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:02.162759 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:08:02.162759 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:08:02.162759 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:08:02.162759 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:08:02.162759 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:08:02.162759 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:08:02.162759 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:08:02.162759 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:08:02.162759 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:08:02.162759 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:08:02.162759 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:08:02.162759 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:08:02.162759 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:08:02.162759 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:08:02.163635 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:08:02.163635 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:08:02.163635 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:08:02.163635 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:08:02.163635 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:08:02.163635 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:08:02.163635 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:08:02.163635 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 31 00:08:02.163635 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:08:02.163635 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:08:02.163635 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:08:02.163635 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:08:02.163635 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:08:02.163635 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:08:02.163635 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:08:02.163635 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:08:02.163635 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:08:02.164715 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:08:02.164715 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:08:02.164715 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 31 00:08:02.164715 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 438/894] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 00:08:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:08:02.168894 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2276ee-219a-4f72-ad6b-be23909c1f46 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:02.246568 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:02.274249 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:02.294336 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2276ee-219a-4f72-ad6b-be23909c1f46 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:02.340143 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a95ad68-b5c6-4563-870d-d8e787e3b8b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:02.341260 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a95ad68-b5c6-4563-870d-d8e787e3b8b4 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:02.341770 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a95ad68-b5c6-4563-870d-d8e787e3b8b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:02.342288 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a95ad68-b5c6-4563-870d-d8e787e3b8b4 None admin] PATH_INFO: `/v3/domains` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:02.343546 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a95ad68-b5c6-4563-870d-d8e787e3b8b4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:02.344120 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a95ad68-b5c6-4563-870d-d8e787e3b8b4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:02.346897 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a95ad68-b5c6-4563-870d-d8e787e3b8b4 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:02.350268 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b027d8a2-20ff-4c8b-ace0-910176d35847 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:02.376996 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 439/895] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 31 00:08:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:08:02.378937 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a95ad68-b5c6-4563-870d-d8e787e3b8b4 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:02.419397 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58914d7f-a595-4593-a94c-d485fe7c9ffb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:02.420136 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58914d7f-a595-4593-a94c-d485fe7c9ffb None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:02.420688 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58914d7f-a595-4593-a94c-d485fe7c9ffb None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:02.421220 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58914d7f-a595-4593-a94c-d485fe7c9ffb None admin] PATH_INFO: `/v3/services` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:02.422276 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58914d7f-a595-4593-a94c-d485fe7c9ffb None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:02.422809 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58914d7f-a595-4593-a94c-d485fe7c9ffb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:02.425862 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58914d7f-a595-4593-a94c-d485fe7c9ffb None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:02.435754 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 457/896] 10.222.0.47 () {56 vars in 1114 bytes} [Wed Aug 31 00:08:02 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:02.442447 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58914d7f-a595-4593-a94c-d485fe7c9ffb None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:02.519320 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a95ad68-b5c6-4563-870d-d8e787e3b8b4 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:02.560303 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:02.589141 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f9d784-e863-41fd-94e3-32d00752a013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:02.590248 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f9d784-e863-41fd-94e3-32d00752a013 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:02.590716 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f9d784-e863-41fd-94e3-32d00752a013 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:02.591228 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f9d784-e863-41fd-94e3-32d00752a013 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:02.611513 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f9d784-e863-41fd-94e3-32d00752a013 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:02.615942 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f9d784-e863-41fd-94e3-32d00752a013 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:02.637723 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58914d7f-a595-4593-a94c-d485fe7c9ffb None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:02.647742 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-a8f9d784-e863-41fd-94e3-32d00752a013 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:08:02.647742 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:02.647742 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:08:02.647742 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:08:02.647742 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:08:02.647742 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:08:02.647742 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:08:02.647742 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:08:02.647742 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:08:02.647742 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:08:02.647742 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:08:02.647742 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:08:02.647742 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 00:08:02.647742 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 00:08:02.647742 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 00:08:02.648770 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 00:08:02.648770 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:08:02.648770 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:08:02.648770 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:08:02.648770 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:08:02.648770 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:08:02.648770 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:08:02.648770 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:08:02.648770 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 31 00:08:02.648770 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:08:02.648770 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:08:02.648770 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:08:02.648770 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:08:02.648770 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:08:02.648770 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:08:02.648770 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:08:02.648770 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:08:02.649679 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 00:08:02.649679 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 00:08:02.649679 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:08:02.649679 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:08:02.649679 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:08:02.649679 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:08:02.649679 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:08:02.649679 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 31 00:08:02.649679 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 440/897] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 31 00:08:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:08:02.658959 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f9d784-e863-41fd-94e3-32d00752a013 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:02.690670 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:02.707808 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88366752-30d2-4309-9ad3-ead96758b3ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:02.708941 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88366752-30d2-4309-9ad3-ead96758b3ce None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:02.709457 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88366752-30d2-4309-9ad3-ead96758b3ce None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:02.709940 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88366752-30d2-4309-9ad3-ead96758b3ce None admin] PATH_INFO: `/v3/services` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:02.710796 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88366752-30d2-4309-9ad3-ead96758b3ce None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:02.711307 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88366752-30d2-4309-9ad3-ead96758b3ce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:02.712964 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88366752-30d2-4309-9ad3-ead96758b3ce None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:02.719669 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 458/898] 10.222.0.47 () {56 vars in 1114 bytes} [Wed Aug 31 00:08:02 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:02.725832 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88366752-30d2-4309-9ad3-ead96758b3ce None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:02.794927 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f9d784-e863-41fd-94e3-32d00752a013 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:02.858653 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88366752-30d2-4309-9ad3-ead96758b3ce None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:02.860301 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfb08a2-ff0f-4c6b-a577-99311ce3322f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:02.860986 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfb08a2-ff0f-4c6b-a577-99311ce3322f None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:02.861305 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfb08a2-ff0f-4c6b-a577-99311ce3322f None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:02.861711 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfb08a2-ff0f-4c6b-a577-99311ce3322f None admin] PATH_INFO: `/v3/projects` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:02.863073 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfb08a2-ff0f-4c6b-a577-99311ce3322f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:02.863717 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfb08a2-ff0f-4c6b-a577-99311ce3322f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:02.866649 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfb08a2-ff0f-4c6b-a577-99311ce3322f None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:02.896014 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 441/899] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Aug 31 00:08:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:02.901870 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfb08a2-ff0f-4c6b-a577-99311ce3322f None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:02.913073 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0deb5067-c846-4f4d-8a58-7f706f61828a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:02.914018 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deb5067-c846-4f4d-8a58-7f706f61828a None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:02.914534 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deb5067-c846-4f4d-8a58-7f706f61828a None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:02.915016 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deb5067-c846-4f4d-8a58-7f706f61828a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:02.915941 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0deb5067-c846-4f4d-8a58-7f706f61828a None admin] RBAC: Adding query filter params (interface=public, service_id=4fbf22c541eb419c8cf268a5854cf6cb, region_id=RegionOne) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:02.917026 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0deb5067-c846-4f4d-8a58-7f706f61828a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:02.918644 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0deb5067-c846-4f4d-8a58-7f706f61828a None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:02.924678 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 459/900] 10.222.0.47 () {56 vars in 1251 bytes} [Wed Aug 31 00:08:02 2022] GET /identity/v3/endpoints?service_id=4fbf22c541eb419c8cf268a5854cf6cb&interface=public®ion_id=RegionOne => generated 194 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:02.935168 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0deb5067-c846-4f4d-8a58-7f706f61828a None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:02.963145 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:03.005127 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:03.044886 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfb08a2-ff0f-4c6b-a577-99311ce3322f None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:03.077137 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0deb5067-c846-4f4d-8a58-7f706f61828a None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:03.098778 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ad2a2c-4402-416a-bac3-5102c8bd7b57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:03.100671 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ad2a2c-4402-416a-bac3-5102c8bd7b57 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:03.101472 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ad2a2c-4402-416a-bac3-5102c8bd7b57 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:03.102253 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ad2a2c-4402-416a-bac3-5102c8bd7b57 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:03.105009 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ad2a2c-4402-416a-bac3-5102c8bd7b57 None admin] RBAC: Adding query filter params (role.id=37e9c028ff614960bea9cb8941645e61, scope.project.id=1b647cccb30a427193fc62dbebe0c6f1, user.id=601aa9e547aa4d42bef6753b26f48eaa) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:03.105896 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ad2a2c-4402-416a-bac3-5102c8bd7b57 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:03.109378 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ad2a2c-4402-416a-bac3-5102c8bd7b57 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:03.116242 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c4baf9-db04-418a-96d0-429926227269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:03.116869 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c4baf9-db04-418a-96d0-429926227269 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:03.117153 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c4baf9-db04-418a-96d0-429926227269 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:03.117483 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c4baf9-db04-418a-96d0-429926227269 None admin] PATH_INFO: `/v3/services` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:03.118027 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c4baf9-db04-418a-96d0-429926227269 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:03.119493 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c4baf9-db04-418a-96d0-429926227269 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:03.122819 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 442/901] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 31 00:08:02 2022] GET /identity/v3/role_assignments?user.id=601aa9e547aa4d42bef6753b26f48eaa&scope.project.id=1b647cccb30a427193fc62dbebe0c6f1&role.id=37e9c028ff614960bea9cb8941645e61 => generated 259 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:03.128212 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 460/902] 10.222.0.47 () {56 vars in 1087 bytes} [Wed Aug 31 00:08:02 2022] GET /identity/v3/services => generated 1268 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:08:04.225524 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc5e7d1-10b5-451f-9353-4f3f04126999 None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:04.226477 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc5e7d1-10b5-451f-9353-4f3f04126999 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:04.226944 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc5e7d1-10b5-451f-9353-4f3f04126999 None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:04.228791 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 443/903] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 00:08:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:08:04.235546 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2158f723-6e2a-49c6-ac78-fcdce1ba6b6b None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:04.236576 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2158f723-6e2a-49c6-ac78-fcdce1ba6b6b None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:04.237062 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2158f723-6e2a-49c6-ac78-fcdce1ba6b6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:04.258963 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-2158f723-6e2a-49c6-ac78-fcdce1ba6b6b None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:08:04.261036 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-2158f723-6e2a-49c6-ac78-fcdce1ba6b6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:08:04.279874 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f346b0c-d35d-4511-a10f-88e4051b5c71 None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:04.280221 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f346b0c-d35d-4511-a10f-88e4051b5c71 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:04.280458 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f346b0c-d35d-4511-a10f-88e4051b5c71 None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:04.281986 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 444/904] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 00:08:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 00:08:04.289548 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9f0b8d-0743-448e-878b-f381f2d69ae6 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:04.290157 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9f0b8d-0743-448e-878b-f381f2d69ae6 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:04.290928 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9f0b8d-0743-448e-878b-f381f2d69ae6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:04.315996 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-5f9f0b8d-0743-448e-878b-f381f2d69ae6 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:08:04.317593 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-5f9f0b8d-0743-448e-878b-f381f2d69ae6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:08:04.376336 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 461/905] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 00:08:04 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:08:04.408209 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 445/906] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 00:08:04 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 00:08:04.681363 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2158f723-6e2a-49c6-ac78-fcdce1ba6b6b None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:04.737245 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:04.789992 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9f0b8d-0743-448e-878b-f381f2d69ae6 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:04.794322 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2158f723-6e2a-49c6-ac78-fcdce1ba6b6b None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:04.840381 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615b6731-a84a-4761-9382-e2ac5ce498db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:04.841394 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615b6731-a84a-4761-9382-e2ac5ce498db None admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:04.841834 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615b6731-a84a-4761-9382-e2ac5ce498db None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:04.842567 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615b6731-a84a-4761-9382-e2ac5ce498db None admin] PATH_INFO: `/v3/services` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:04.843840 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615b6731-a84a-4761-9382-e2ac5ce498db None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:04.845969 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615b6731-a84a-4761-9382-e2ac5ce498db None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:04.854783 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:04.872250 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 462/907] 10.222.0.47 () {60 vars in 1141 bytes} [Wed Aug 31 00:08:04 2022] POST /identity/v3/services => generated 241 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:08:04.946910 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9f0b8d-0743-448e-878b-f381f2d69ae6 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:05.002018 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b2dd2c-1bd7-474e-8a70-883d3b776611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:05.002729 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b2dd2c-1bd7-474e-8a70-883d3b776611 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:05.003014 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b2dd2c-1bd7-474e-8a70-883d3b776611 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:05.003287 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b2dd2c-1bd7-474e-8a70-883d3b776611 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:05.003881 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b2dd2c-1bd7-474e-8a70-883d3b776611 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:05.005332 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b2dd2c-1bd7-474e-8a70-883d3b776611 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:05.016732 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-a3b2dd2c-1bd7-474e-8a70-883d3b776611 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 31 00:08:05.016732 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:05.016732 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 00:08:05.016732 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 00:08:05.016732 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 00:08:05.016732 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 00:08:05.016732 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 00:08:05.016732 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:08:05.016732 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 31 00:08:05.016732 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 31 00:08:05.016732 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 00:08:05.016732 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 31 00:08:05.016732 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:05.016732 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:08:05.016732 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:08:05.016732 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:08:05.017757 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:08:05.017757 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:08:05.017757 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:08:05.017757 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:08:05.017757 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:08:05.017757 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:08:05.017757 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:08:05.017757 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 00:08:05.017757 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 00:08:05.017757 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 00:08:05.017757 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 00:08:05.017757 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:08:05.017757 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:08:05.017757 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:08:05.017757 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:08:05.017757 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:08:05.017757 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:08:05.018668 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:08:05.018668 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 31 00:08:05.018668 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:08:05.018668 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:08:05.018668 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:08:05.018668 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:08:05.018668 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:08:05.018668 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:08:05.018668 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:08:05.018668 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:08:05.018668 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 00:08:05.018668 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:08:05.018668 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 31 00:08:05.018668 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 31 00:08:05.018668 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 446/908] 10.222.0.47 () {56 vars in 1132 bytes} [Wed Aug 31 00:08:04 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:08:05.026329 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615b6731-a84a-4761-9382-e2ac5ce498db None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:05.145812 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615b6731-a84a-4761-9382-e2ac5ce498db None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:05.156678 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:05.189955 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a783d49-5f13-4d6e-aa90-7b45ad063740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:05.190974 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a783d49-5f13-4d6e-aa90-7b45ad063740 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:05.191479 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a783d49-5f13-4d6e-aa90-7b45ad063740 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:05.191947 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a783d49-5f13-4d6e-aa90-7b45ad063740 None admin] PATH_INFO: `/v3/services` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:05.192810 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a783d49-5f13-4d6e-aa90-7b45ad063740 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:05.193313 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a783d49-5f13-4d6e-aa90-7b45ad063740 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:05.194912 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a783d49-5f13-4d6e-aa90-7b45ad063740 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:05.201199 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 463/909] 10.222.0.47 () {56 vars in 1126 bytes} [Wed Aug 31 00:08:05 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:05.207077 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b2dd2c-1bd7-474e-8a70-883d3b776611 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:05.318928 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66333b93-477c-47ab-9fc1-0eea5de47cd6 None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:05.319973 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66333b93-477c-47ab-9fc1-0eea5de47cd6 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:05.320514 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66333b93-477c-47ab-9fc1-0eea5de47cd6 None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:05.322382 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 464/910] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 00:08:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 00:08:05.327814 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:05.329341 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c69723c-7248-4400-b2a4-9692cfdac9f5 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:05.329853 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c69723c-7248-4400-b2a4-9692cfdac9f5 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:05.330560 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b2dd2c-1bd7-474e-8a70-883d3b776611 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:05.331130 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c69723c-7248-4400-b2a4-9692cfdac9f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:05.352524 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-2c69723c-7248-4400-b2a4-9692cfdac9f5 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:08:05.354768 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-2c69723c-7248-4400-b2a4-9692cfdac9f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:08:05.373029 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd49fe2-ca22-4f1f-a33e-6aa4684ef165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:05.373664 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd49fe2-ca22-4f1f-a33e-6aa4684ef165 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:05.373941 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd49fe2-ca22-4f1f-a33e-6aa4684ef165 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:05.374208 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd49fe2-ca22-4f1f-a33e-6aa4684ef165 None admin] PATH_INFO: `/v3/services` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:05.374853 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd49fe2-ca22-4f1f-a33e-6aa4684ef165 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:05.375156 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd49fe2-ca22-4f1f-a33e-6aa4684ef165 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:05.376613 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd49fe2-ca22-4f1f-a33e-6aa4684ef165 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:05.387520 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 447/911] 10.222.0.47 () {56 vars in 1126 bytes} [Wed Aug 31 00:08:05 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:05.388795 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd49fe2-ca22-4f1f-a33e-6aa4684ef165 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:05.447025 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 465/912] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 00:08:05 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 00:08:05.448388 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff93b0b-afea-4e97-a87d-776c8f066fae None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:05.448751 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff93b0b-afea-4e97-a87d-776c8f066fae None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:05.449089 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff93b0b-afea-4e97-a87d-776c8f066fae None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:05.454578 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 466/913] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 00:08:05 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:08:05.455826 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8e9313-93f8-4058-8f5b-cfff4b35964f None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:05.456120 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8e9313-93f8-4058-8f5b-cfff4b35964f None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:05.456430 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8e9313-93f8-4058-8f5b-cfff4b35964f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:05.482376 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-3b8e9313-93f8-4058-8f5b-cfff4b35964f None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:08:05.483684 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-3b8e9313-93f8-4058-8f5b-cfff4b35964f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:08:05.545217 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd49fe2-ca22-4f1f-a33e-6aa4684ef165 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:05.571755 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 467/914] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 00:08:05 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:08:05.585263 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70745b99-aa0a-4857-8612-53c3a3999d28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:05.585981 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70745b99-aa0a-4857-8612-53c3a3999d28 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:05.586388 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70745b99-aa0a-4857-8612-53c3a3999d28 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:05.586658 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70745b99-aa0a-4857-8612-53c3a3999d28 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:05.587559 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70745b99-aa0a-4857-8612-53c3a3999d28 None admin] RBAC: Adding query filter params (interface=public, service_id=40d923fc524a484ca34079d279f1b0eb, region_id=RegionOne) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:05.587896 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70745b99-aa0a-4857-8612-53c3a3999d28 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:05.589969 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70745b99-aa0a-4857-8612-53c3a3999d28 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:05.596419 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 448/915] 10.222.0.47 () {56 vars in 1251 bytes} [Wed Aug 31 00:08:05 2022] GET /identity/v3/endpoints?service_id=40d923fc524a484ca34079d279f1b0eb&interface=public®ion_id=RegionOne => generated 194 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:05.607686 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8e9313-93f8-4058-8f5b-cfff4b35964f None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:05.650207 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:05.736230 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8e9313-93f8-4058-8f5b-cfff4b35964f None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:05.753470 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70745b99-aa0a-4857-8612-53c3a3999d28 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:05.784726 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:05.785448 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6052e2f2-645c-444a-bd59-122a7c44d613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:05.786124 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6052e2f2-645c-444a-bd59-122a7c44d613 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:05.786422 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6052e2f2-645c-444a-bd59-122a7c44d613 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:05.786684 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6052e2f2-645c-444a-bd59-122a7c44d613 None admin] PATH_INFO: `/v3/services` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:05.787314 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6052e2f2-645c-444a-bd59-122a7c44d613 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:05.788800 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6052e2f2-645c-444a-bd59-122a7c44d613 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:05.798917 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 468/916] 10.222.0.47 () {56 vars in 1087 bytes} [Wed Aug 31 00:08:05 2022] GET /identity/v3/services => generated 1497 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:08:05.849911 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6052e2f2-645c-444a-bd59-122a7c44d613 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:05.900138 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70745b99-aa0a-4857-8612-53c3a3999d28 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:05.949478 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc04e2a7-08b5-4099-994e-38e0dffce4ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:05.950126 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc04e2a7-08b5-4099-994e-38e0dffce4ce None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:05.950397 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc04e2a7-08b5-4099-994e-38e0dffce4ce None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:05.950662 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc04e2a7-08b5-4099-994e-38e0dffce4ce None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:05.951264 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc04e2a7-08b5-4099-994e-38e0dffce4ce None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:05.953889 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc04e2a7-08b5-4099-994e-38e0dffce4ce None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:05.965120 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-cc04e2a7-08b5-4099-994e-38e0dffce4ce None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 31 00:08:05.965120 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:05.965120 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 00:08:05.965120 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 00:08:05.965120 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 00:08:05.965120 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 00:08:05.965120 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 00:08:05.965120 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:08:05.965120 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 31 00:08:05.965120 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 31 00:08:05.965120 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 00:08:05.965120 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 31 00:08:05.965120 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:05.965120 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:08:05.965120 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:08:05.965120 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:08:05.965120 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:08:05.966194 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:08:05.966194 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:08:05.966194 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:08:05.966194 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:08:05.966194 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:08:05.966194 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:08:05.966194 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 00:08:05.966194 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 00:08:05.966194 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 00:08:05.966194 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 00:08:05.966194 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:08:05.966194 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:08:05.966194 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:08:05.966194 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:08:05.966194 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:08:05.966194 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:08:05.967074 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:08:05.967074 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 31 00:08:05.967074 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:08:05.967074 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:08:05.967074 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:08:05.967074 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:08:05.967074 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:08:05.967074 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:08:05.967074 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:08:05.967074 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:08:05.967074 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 00:08:05.967074 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:08:05.967074 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 31 00:08:05.967074 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 31 00:08:05.967074 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 449/917] 10.222.0.47 () {56 vars in 1114 bytes} [Wed Aug 31 00:08:05 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:08:05.972850 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc04e2a7-08b5-4099-994e-38e0dffce4ce None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:06.010927 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:06.018147 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6052e2f2-645c-444a-bd59-122a7c44d613 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:06.058344 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b83c954-d296-4e6e-a079-16f47a3b8ad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:06.059002 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b83c954-d296-4e6e-a079-16f47a3b8ad1 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:06.059288 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b83c954-d296-4e6e-a079-16f47a3b8ad1 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:06.059565 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b83c954-d296-4e6e-a079-16f47a3b8ad1 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:06.071758 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b83c954-d296-4e6e-a079-16f47a3b8ad1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:08:06.077833 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-8b83c954-d296-4e6e-a079-16f47a3b8ad1 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 00:08:06.077833 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:06.077833 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:08:06.077833 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:08:06.077833 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:08:06.077833 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:08:06.077833 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:08:06.077833 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:08:06.077833 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:08:06.077833 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:08:06.077833 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:08:06.077833 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:08:06.077833 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:08:06.077833 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:08:06.077833 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:08:06.077833 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:08:06.079045 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:08:06.079045 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:08:06.079045 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:08:06.079045 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:08:06.079045 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:08:06.079045 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:08:06.079045 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:08:06.079045 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:08:06.079045 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:08:06.079045 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:08:06.079045 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:08:06.079045 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Aug 31 00:08:06.079045 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:08:06.079045 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:08:06.079045 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:08:06.079045 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:08:06.080109 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:08:06.080109 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:08:06.080109 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:08:06.080109 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:08:06.080109 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:08:06.080109 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:08:06.080109 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:08:06.080109 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:08:06.080109 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:08:06.080109 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:08:06.080109 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 00:08:06.080109 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Aug 31 00:08:06.080109 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 469/918] 10.222.0.47 () {56 vars in 1120 bytes} [Wed Aug 31 00:08:05 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:08:06.086226 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b83c954-d296-4e6e-a079-16f47a3b8ad1 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:06.099837 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:06.117277 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc04e2a7-08b5-4099-994e-38e0dffce4ce None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:06.167143 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e174a55a-2119-4e8d-b12d-f7c22d3e9e9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:06.167988 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e174a55a-2119-4e8d-b12d-f7c22d3e9e9d None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:06.168299 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e174a55a-2119-4e8d-b12d-f7c22d3e9e9d None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:06.168638 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e174a55a-2119-4e8d-b12d-f7c22d3e9e9d None admin] PATH_INFO: `/v3/services` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:06.169280 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e174a55a-2119-4e8d-b12d-f7c22d3e9e9d None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:06.169578 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e174a55a-2119-4e8d-b12d-f7c22d3e9e9d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:06.171545 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e174a55a-2119-4e8d-b12d-f7c22d3e9e9d None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:06.180248 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 450/919] 10.222.0.47 () {56 vars in 1114 bytes} [Wed Aug 31 00:08:05 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:08:06.188011 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e174a55a-2119-4e8d-b12d-f7c22d3e9e9d None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:06.248196 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b83c954-d296-4e6e-a079-16f47a3b8ad1 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:06.289851 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d69666-db5a-43c3-b13c-b35903fd182c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:06.290474 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d69666-db5a-43c3-b13c-b35903fd182c None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:06.290751 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d69666-db5a-43c3-b13c-b35903fd182c None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:06.291022 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d69666-db5a-43c3-b13c-b35903fd182c None admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:06.292325 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d69666-db5a-43c3-b13c-b35903fd182c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:06.292735 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d69666-db5a-43c3-b13c-b35903fd182c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:06.294231 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d69666-db5a-43c3-b13c-b35903fd182c None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:06.304208 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 470/920] 10.222.0.47 () {56 vars in 1115 bytes} [Wed Aug 31 00:08:06 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:06.310438 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d69666-db5a-43c3-b13c-b35903fd182c None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:06.330777 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e174a55a-2119-4e8d-b12d-f7c22d3e9e9d None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:06.337205 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:06.378635 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528abd00-bbf2-4a96-96bb-11039c328966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:06.379828 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528abd00-bbf2-4a96-96bb-11039c328966 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:06.380314 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528abd00-bbf2-4a96-96bb-11039c328966 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:06.380919 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528abd00-bbf2-4a96-96bb-11039c328966 None admin] PATH_INFO: `/v3/services` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:06.382024 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528abd00-bbf2-4a96-96bb-11039c328966 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:06.382532 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528abd00-bbf2-4a96-96bb-11039c328966 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:06.384123 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528abd00-bbf2-4a96-96bb-11039c328966 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:06.392615 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 451/921] 10.222.0.47 () {56 vars in 1114 bytes} [Wed Aug 31 00:08:06 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:08:06.398600 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528abd00-bbf2-4a96-96bb-11039c328966 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:06.424058 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:06.457401 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d69666-db5a-43c3-b13c-b35903fd182c None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:06.503191 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de75814c-aef2-4eb7-8216-e2b332767c09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:06.503750 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de75814c-aef2-4eb7-8216-e2b332767c09 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:06.504033 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de75814c-aef2-4eb7-8216-e2b332767c09 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:06.505165 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de75814c-aef2-4eb7-8216-e2b332767c09 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:06.521083 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de75814c-aef2-4eb7-8216-e2b332767c09 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:06.522828 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de75814c-aef2-4eb7-8216-e2b332767c09 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:06.542500 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-de75814c-aef2-4eb7-8216-e2b332767c09 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:08:06.542500 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:06.542500 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:08:06.542500 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:08:06.542500 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:08:06.542500 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:08:06.542500 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:08:06.542500 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:08:06.542500 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:08:06.542500 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:08:06.542500 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:08:06.542500 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:08:06.542500 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:08:06.542500 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:08:06.542500 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:08:06.542500 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:08:06.543622 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:08:06.543622 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:08:06.543622 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:08:06.543622 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:08:06.543622 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:08:06.543622 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:08:06.543622 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:08:06.543622 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Aug 31 00:08:06.543622 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:08:06.543622 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:08:06.543622 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:08:06.543622 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:08:06.543622 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:08:06.543622 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:08:06.543622 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:08:06.543622 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:08:06.543622 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:08:06.544585 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:08:06.544585 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:08:06.544585 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Aug 31 00:08:06.545447 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528abd00-bbf2-4a96-96bb-11039c328966 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:06.548315 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 471/922] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 00:08:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:08:06.550360 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de75814c-aef2-4eb7-8216-e2b332767c09 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:06.595112 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b05508-575d-4dfd-8cc4-47292c080b33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:06.596103 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b05508-575d-4dfd-8cc4-47292c080b33 None admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:06.596620 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b05508-575d-4dfd-8cc4-47292c080b33 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:06.597259 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b05508-575d-4dfd-8cc4-47292c080b33 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:06.599144 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b05508-575d-4dfd-8cc4-47292c080b33 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:06.600883 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b05508-575d-4dfd-8cc4-47292c080b33 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:06.636428 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 452/923] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 31 00:08:06 2022] POST /identity/v3/endpoints => generated 346 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:08:06.650551 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:06.694084 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de75814c-aef2-4eb7-8216-e2b332767c09 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:06.743474 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c619b5ff-8cc1-4f7e-ac86-57c372f1ca63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:06.744095 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c619b5ff-8cc1-4f7e-ac86-57c372f1ca63 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:06.744407 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c619b5ff-8cc1-4f7e-ac86-57c372f1ca63 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:06.744795 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c619b5ff-8cc1-4f7e-ac86-57c372f1ca63 None admin] PATH_INFO: `/v3/domains` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:06.745501 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c619b5ff-8cc1-4f7e-ac86-57c372f1ca63 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:06.745790 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c619b5ff-8cc1-4f7e-ac86-57c372f1ca63 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:06.747204 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c619b5ff-8cc1-4f7e-ac86-57c372f1ca63 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:06.765221 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 472/924] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 31 00:08:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:06.770501 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b05508-575d-4dfd-8cc4-47292c080b33 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:06.857993 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:06.895549 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b05508-575d-4dfd-8cc4-47292c080b33 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:06.932679 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3022e653-1b24-470e-8c6a-0301e75443b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:06.933735 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3022e653-1b24-470e-8c6a-0301e75443b7 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:06.934217 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3022e653-1b24-470e-8c6a-0301e75443b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:06.934685 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3022e653-1b24-470e-8c6a-0301e75443b7 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:06.943509 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3022e653-1b24-470e-8c6a-0301e75443b7 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:06.945479 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3022e653-1b24-470e-8c6a-0301e75443b7 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:06.959351 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-3022e653-1b24-470e-8c6a-0301e75443b7 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 00:08:06.959351 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:06.959351 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:08:06.959351 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:08:06.959351 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:08:06.959351 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:08:06.959351 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:08:06.959351 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:08:06.959351 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:08:06.959351 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:08:06.959351 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:08:06.959351 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:08:06.959351 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 00:08:06.959351 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 00:08:06.959351 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 00:08:06.959351 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 00:08:06.960447 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:08:06.960447 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:08:06.960447 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:08:06.960447 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:08:06.960447 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:08:06.960447 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:08:06.960447 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:08:06.960447 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:08:06.960447 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:08:06.960447 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:08:06.960447 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:08:06.960447 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 31 00:08:06.960447 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:08:06.960447 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:08:06.960447 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:08:06.960447 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:08:06.960447 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:08:06.960447 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:08:06.961629 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:08:06.961629 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:08:06.961629 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 00:08:06.961629 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 00:08:06.961629 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 00:08:06.961629 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 00:08:06.961629 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 00:08:06.961629 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 00:08:06.961629 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 00:08:06.961629 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 31 00:08:06.964000 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 453/925] 10.222.0.47 () {56 vars in 1117 bytes} [Wed Aug 31 00:08:06 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:08:06.970211 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c619b5ff-8cc1-4f7e-ac86-57c372f1ca63 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:07.046283 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04306dba-d0d8-4691-a987-8cba02810474 None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:07.046463 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04306dba-d0d8-4691-a987-8cba02810474 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:07.046741 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04306dba-d0d8-4691-a987-8cba02810474 None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:07.048389 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 454/926] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 00:08:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 00:08:07.053543 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ebe624-ad6c-46cd-addc-8c13178bc886 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:07.054082 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ebe624-ad6c-46cd-addc-8c13178bc886 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:07.054562 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ebe624-ad6c-46cd-addc-8c13178bc886 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:07.077758 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-a7ebe624-ad6c-46cd-addc-8c13178bc886 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:08:07.079503 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-a7ebe624-ad6c-46cd-addc-8c13178bc886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:08:07.082907 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c619b5ff-8cc1-4f7e-ac86-57c372f1ca63 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:07.120700 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:07.128492 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e80916d-afe4-4409-b675-204ee7df6fd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:07.129769 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e80916d-afe4-4409-b675-204ee7df6fd5 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:07.130357 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e80916d-afe4-4409-b675-204ee7df6fd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:07.131023 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e80916d-afe4-4409-b675-204ee7df6fd5 None admin] PATH_INFO: `/v3/users` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:07.131917 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e80916d-afe4-4409-b675-204ee7df6fd5 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:07.132581 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e80916d-afe4-4409-b675-204ee7df6fd5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:07.134939 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e80916d-afe4-4409-b675-204ee7df6fd5 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:07.155737 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 455/927] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 00:08:07 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:08:07.157993 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 473/928] 10.222.0.47 () {56 vars in 1149 bytes} [Wed Aug 31 00:08:06 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:07.163675 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ebe624-ad6c-46cd-addc-8c13178bc886 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:07.232782 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:07.275584 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ebe624-ad6c-46cd-addc-8c13178bc886 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:07.313459 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dc401b-9330-4e04-a0d8-cde9c9ec2064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:07.314099 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dc401b-9330-4e04-a0d8-cde9c9ec2064 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:07.314380 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dc401b-9330-4e04-a0d8-cde9c9ec2064 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:07.314736 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dc401b-9330-4e04-a0d8-cde9c9ec2064 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:07.327161 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dc401b-9330-4e04-a0d8-cde9c9ec2064 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:07.328775 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dc401b-9330-4e04-a0d8-cde9c9ec2064 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:07.345177 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-54dc401b-9330-4e04-a0d8-cde9c9ec2064 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:08:07.345177 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:07.345177 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:08:07.345177 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:08:07.345177 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:08:07.345177 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:08:07.345177 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:08:07.345177 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:08:07.345177 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:08:07.345177 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:08:07.345177 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:08:07.345177 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:08:07.345177 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:08:07.345177 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:08:07.345177 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:08:07.345177 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:08:07.346640 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:08:07.346640 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:08:07.346640 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:08:07.346640 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:08:07.346640 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:08:07.346640 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:08:07.346640 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:08:07.346640 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 31 00:08:07.346640 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:08:07.346640 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:08:07.346640 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:08:07.346640 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:08:07.346640 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:08:07.346640 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:08:07.346640 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:08:07.346640 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:08:07.346640 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:08:07.347567 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:08:07.347567 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:08:07.347567 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 31 00:08:07.347567 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 456/929] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 00:08:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:08:07.353307 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e80916d-afe4-4409-b675-204ee7df6fd5 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:07.447380 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dc401b-9330-4e04-a0d8-cde9c9ec2064 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:07.474678 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e80916d-afe4-4409-b675-204ee7df6fd5 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:07.524777 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69da5d12-91e0-41a0-b58d-38c809117d73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:07.525403 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69da5d12-91e0-41a0-b58d-38c809117d73 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:07.525686 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69da5d12-91e0-41a0-b58d-38c809117d73 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:07.526024 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69da5d12-91e0-41a0-b58d-38c809117d73 None admin] PATH_INFO: `/v3/domains` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:07.526686 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69da5d12-91e0-41a0-b58d-38c809117d73 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:07.526998 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69da5d12-91e0-41a0-b58d-38c809117d73 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:07.528402 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69da5d12-91e0-41a0-b58d-38c809117d73 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:07.542155 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 474/930] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 31 00:08:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:07.549048 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69da5d12-91e0-41a0-b58d-38c809117d73 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:07.573846 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dc401b-9330-4e04-a0d8-cde9c9ec2064 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:07.591128 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:07.614292 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:07.615461 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3562ec10-f49e-48f6-8b6e-488f37fcf974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:07.616236 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3562ec10-f49e-48f6-8b6e-488f37fcf974 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:07.616560 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3562ec10-f49e-48f6-8b6e-488f37fcf974 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:07.616707 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3562ec10-f49e-48f6-8b6e-488f37fcf974 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:07.617427 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3562ec10-f49e-48f6-8b6e-488f37fcf974 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:07.619015 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3562ec10-f49e-48f6-8b6e-488f37fcf974 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:07.630634 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-3562ec10-f49e-48f6-8b6e-488f37fcf974 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 00:08:07.630634 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:07.630634 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 00:08:07.630634 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 00:08:07.630634 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 00:08:07.630634 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 00:08:07.630634 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 00:08:07.630634 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:08:07.630634 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 00:08:07.630634 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 31 00:08:07.630634 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 00:08:07.630634 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 31 00:08:07.630634 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:07.630634 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:08:07.630634 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:08:07.630634 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:08:07.630634 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:08:07.631902 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:08:07.631902 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:08:07.631902 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:08:07.631902 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:08:07.631902 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:08:07.631902 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:08:07.631902 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 00:08:07.631902 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 00:08:07.631902 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 00:08:07.631902 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 00:08:07.631902 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:08:07.631902 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:08:07.631902 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:08:07.631902 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:08:07.631902 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:08:07.631902 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:08:07.632800 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:08:07.632800 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 31 00:08:07.632800 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:08:07.632800 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:08:07.632800 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:08:07.632800 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:08:07.632800 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:08:07.632800 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:08:07.632800 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:08:07.632800 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:08:07.632800 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 00:08:07.632800 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:08:07.632800 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 00:08:07.632800 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 31 00:08:07.632800 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 457/931] 10.222.0.47 () {56 vars in 1126 bytes} [Wed Aug 31 00:08:07 2022] GET /identity/v3/services/object-store => generated 93 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:08:07.638401 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3562ec10-f49e-48f6-8b6e-488f37fcf974 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:07.708726 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69da5d12-91e0-41a0-b58d-38c809117d73 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:07.755894 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18e8bc2-bfea-4a23-8c00-3cea73c4b08c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:07.756594 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18e8bc2-bfea-4a23-8c00-3cea73c4b08c None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:07.756877 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18e8bc2-bfea-4a23-8c00-3cea73c4b08c None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:07.757158 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18e8bc2-bfea-4a23-8c00-3cea73c4b08c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:07.763068 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3562ec10-f49e-48f6-8b6e-488f37fcf974 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:07.768331 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18e8bc2-bfea-4a23-8c00-3cea73c4b08c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:07.769800 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18e8bc2-bfea-4a23-8c00-3cea73c4b08c None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:07.786296 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-b18e8bc2-bfea-4a23-8c00-3cea73c4b08c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:08:07.786296 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:07.786296 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:08:07.786296 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:08:07.786296 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:08:07.786296 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:08:07.786296 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:08:07.786296 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:08:07.786296 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:08:07.786296 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:08:07.786296 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:08:07.786296 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:08:07.786296 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 00:08:07.786296 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 00:08:07.786296 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 00:08:07.787284 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 00:08:07.787284 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:08:07.787284 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:08:07.787284 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:08:07.787284 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:08:07.787284 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:08:07.787284 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:08:07.787284 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:08:07.787284 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Aug 31 00:08:07.787284 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:08:07.787284 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:08:07.787284 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:08:07.787284 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:08:07.787284 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:08:07.787284 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:08:07.787284 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:08:07.787284 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:08:07.788260 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 00:08:07.788260 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 00:08:07.788260 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:08:07.788260 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:08:07.788260 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:08:07.788260 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:08:07.788260 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:08:07.788260 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Aug 31 00:08:07.793120 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 475/932] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 31 00:08:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:08:07.794042 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18e8bc2-bfea-4a23-8c00-3cea73c4b08c None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:07.814050 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9561bc18-59af-476b-9d92-24a85ddf5e2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:07.814680 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9561bc18-59af-476b-9d92-24a85ddf5e2f None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:07.814958 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9561bc18-59af-476b-9d92-24a85ddf5e2f None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:07.815277 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9561bc18-59af-476b-9d92-24a85ddf5e2f None admin] PATH_INFO: `/v3/services` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:07.816452 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9561bc18-59af-476b-9d92-24a85ddf5e2f None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:07.816760 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9561bc18-59af-476b-9d92-24a85ddf5e2f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:07.818452 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9561bc18-59af-476b-9d92-24a85ddf5e2f None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:07.828383 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 458/933] 10.222.0.47 () {56 vars in 1122 bytes} [Wed Aug 31 00:08:07 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:08:07.832408 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9561bc18-59af-476b-9d92-24a85ddf5e2f None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:07.881510 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:07.925548 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18e8bc2-bfea-4a23-8c00-3cea73c4b08c None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:07.928914 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:07.940810 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9561bc18-59af-476b-9d92-24a85ddf5e2f None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:07.975650 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33634596-473d-41c4-a462-26c7e7db091d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:07.976542 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33634596-473d-41c4-a462-26c7e7db091d None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:07.976963 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33634596-473d-41c4-a462-26c7e7db091d None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:07.977410 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33634596-473d-41c4-a462-26c7e7db091d None admin] PATH_INFO: `/v3/projects` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:07.977842 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50918e8-d02d-4287-9751-1f5331c8ea4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:07.978418 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33634596-473d-41c4-a462-26c7e7db091d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:07.978534 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50918e8-d02d-4287-9751-1f5331c8ea4f None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:07.978719 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50918e8-d02d-4287-9751-1f5331c8ea4f None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:07.979582 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50918e8-d02d-4287-9751-1f5331c8ea4f None admin] PATH_INFO: `/v3/services` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:07.979808 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33634596-473d-41c4-a462-26c7e7db091d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:07.980415 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50918e8-d02d-4287-9751-1f5331c8ea4f None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:07.980722 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50918e8-d02d-4287-9751-1f5331c8ea4f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:07.981731 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33634596-473d-41c4-a462-26c7e7db091d None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:07.982086 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50918e8-d02d-4287-9751-1f5331c8ea4f None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:07.992023 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 459/934] 10.222.0.47 () {56 vars in 1122 bytes} [Wed Aug 31 00:08:07 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:07.993205 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baf4c59-77d7-4e0f-b006-ff4789a92017 None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:07.993495 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baf4c59-77d7-4e0f-b006-ff4789a92017 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:07.993774 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baf4c59-77d7-4e0f-b006-ff4789a92017 None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:07.995688 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 460/935] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 00:08:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:08:08.000208 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baf4c59-77d7-4e0f-b006-ff4789a92017 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:08.006193 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 476/936] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Aug 31 00:08:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:08.008123 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a76006-f2ae-4178-b762-f1502c987ebf None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:08.008919 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a76006-f2ae-4178-b762-f1502c987ebf None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:08.009353 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a76006-f2ae-4178-b762-f1502c987ebf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:08.029891 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-e8a76006-f2ae-4178-b762-f1502c987ebf None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:08:08.031078 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-e8a76006-f2ae-4178-b762-f1502c987ebf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:08:08.112409 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 477/937] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 00:08:08 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:08:08.112409 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a76006-f2ae-4178-b762-f1502c987ebf None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:08.119201 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baf4c59-77d7-4e0f-b006-ff4789a92017 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:08.128032 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:08.175083 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3654669-8f35-4735-b76c-295c5ca1060d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:08.176219 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3654669-8f35-4735-b76c-295c5ca1060d None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:08.176664 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3654669-8f35-4735-b76c-295c5ca1060d None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:08.177366 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3654669-8f35-4735-b76c-295c5ca1060d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:08.178257 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3654669-8f35-4735-b76c-295c5ca1060d None admin] RBAC: Adding query filter params (interface=public, service_id=f1723c70c78c42b2922a6ae3f6155af1, region_id=RegionOne) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:08.179233 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3654669-8f35-4735-b76c-295c5ca1060d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:08.181090 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3654669-8f35-4735-b76c-295c5ca1060d None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:08.194015 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 461/938] 10.222.0.47 () {56 vars in 1251 bytes} [Wed Aug 31 00:08:07 2022] GET /identity/v3/endpoints?service_id=f1723c70c78c42b2922a6ae3f6155af1&interface=public®ion_id=RegionOne => generated 194 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:08.195793 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3654669-8f35-4735-b76c-295c5ca1060d None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:08.244251 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:08.253681 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a76006-f2ae-4178-b762-f1502c987ebf None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:08.301048 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65030798-f296-42f3-b618-30f02ff72d12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:08.302356 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65030798-f296-42f3-b618-30f02ff72d12 None admin] REQUEST_METHOD: `PUT` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:08.303217 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65030798-f296-42f3-b618-30f02ff72d12 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:08.303731 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65030798-f296-42f3-b618-30f02ff72d12 None admin] PATH_INFO: `/v3/projects/1b647cccb30a427193fc62dbebe0c6f1/users/601aa9e547aa4d42bef6753b26f48eaa/roles/37e9c028ff614960bea9cb8941645e61` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:08.306763 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65030798-f296-42f3-b618-30f02ff72d12 None admin] RBAC: Authorizing `identity:create_grant(project_id=1b647cccb30a427193fc62dbebe0c6f1, user_id=601aa9e547aa4d42bef6753b26f48eaa, role_id=37e9c028ff614960bea9cb8941645e61)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:08.309640 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65030798-f296-42f3-b618-30f02ff72d12 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:08.320394 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3654669-8f35-4735-b76c-295c5ca1060d None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:08.331064 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 478/939] 10.222.0.47 () {58 vars in 1439 bytes} [Wed Aug 31 00:08:08 2022] PUT /identity/v3/projects/1b647cccb30a427193fc62dbebe0c6f1/users/601aa9e547aa4d42bef6753b26f48eaa/roles/37e9c028ff614960bea9cb8941645e61 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:08:08.377492 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62827066-4e82-4802-a04e-3543f8b91d36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:08.378035 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62827066-4e82-4802-a04e-3543f8b91d36 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:08.378297 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62827066-4e82-4802-a04e-3543f8b91d36 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:08.378568 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62827066-4e82-4802-a04e-3543f8b91d36 None admin] PATH_INFO: `/v3/services` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:08.379201 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62827066-4e82-4802-a04e-3543f8b91d36 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:08.380959 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62827066-4e82-4802-a04e-3543f8b91d36 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:08.388941 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 462/940] 10.222.0.47 () {56 vars in 1087 bytes} [Wed Aug 31 00:08:08 2022] GET /identity/v3/services => generated 1497 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:08:08.394509 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65030798-f296-42f3-b618-30f02ff72d12 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:08.534825 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65030798-f296-42f3-b618-30f02ff72d12 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:08.573767 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6290ec69-8d82-49e8-8893-2fe79fd77cee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:08.574378 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6290ec69-8d82-49e8-8893-2fe79fd77cee None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:08.574660 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6290ec69-8d82-49e8-8893-2fe79fd77cee None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:08.574934 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6290ec69-8d82-49e8-8893-2fe79fd77cee None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:08.575522 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6290ec69-8d82-49e8-8893-2fe79fd77cee None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:08.576944 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6290ec69-8d82-49e8-8893-2fe79fd77cee None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:08.587854 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-6290ec69-8d82-49e8-8893-2fe79fd77cee None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 31 00:08:08.587854 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:08.587854 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 00:08:08.587854 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 00:08:08.587854 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 00:08:08.587854 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 00:08:08.587854 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 00:08:08.587854 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:08:08.587854 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 31 00:08:08.587854 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Aug 31 00:08:08.587854 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 00:08:08.587854 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Aug 31 00:08:08.587854 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:08.587854 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:08:08.587854 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:08:08.587854 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:08:08.589711 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:08:08.589711 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:08:08.589711 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:08:08.589711 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:08:08.589711 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:08:08.589711 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:08:08.589711 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:08:08.589711 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 00:08:08.589711 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 00:08:08.589711 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 00:08:08.589711 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 00:08:08.589711 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:08:08.589711 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:08:08.589711 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:08:08.589711 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:08:08.589711 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:08:08.589711 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:08:08.590656 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:08:08.590656 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Aug 31 00:08:08.590656 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:08:08.590656 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:08:08.590656 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:08:08.590656 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:08:08.590656 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:08:08.590656 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:08:08.590656 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:08:08.590656 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:08:08.590656 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 00:08:08.590656 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:08:08.590656 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 31 00:08:08.590656 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Aug 31 00:08:08.590656 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 479/941] 10.222.0.47 () {56 vars in 1132 bytes} [Wed Aug 31 00:08:08 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:08:08.595735 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62827066-4e82-4802-a04e-3543f8b91d36 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:08.642369 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:08.727166 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62827066-4e82-4802-a04e-3543f8b91d36 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:08.767742 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479a9d84-fc37-408d-a419-fbcaae0e59d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:08.768632 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479a9d84-fc37-408d-a419-fbcaae0e59d7 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:08.769056 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479a9d84-fc37-408d-a419-fbcaae0e59d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:08.769524 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479a9d84-fc37-408d-a419-fbcaae0e59d7 None admin] PATH_INFO: `/v3/services` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:08.770324 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479a9d84-fc37-408d-a419-fbcaae0e59d7 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:08.770818 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479a9d84-fc37-408d-a419-fbcaae0e59d7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:08.772421 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479a9d84-fc37-408d-a419-fbcaae0e59d7 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:08.783878 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 463/942] 10.222.0.47 () {56 vars in 1126 bytes} [Wed Aug 31 00:08:08 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:08.785709 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6290ec69-8d82-49e8-8893-2fe79fd77cee None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:08.813238 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:08.898495 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ec793f-ade6-4376-8a77-fb66bb9cde21 None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:08.898822 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ec793f-ade6-4376-8a77-fb66bb9cde21 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:08.899205 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ec793f-ade6-4376-8a77-fb66bb9cde21 None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:08.902212 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 464/943] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 00:08:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 00:08:08.905930 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6290ec69-8d82-49e8-8893-2fe79fd77cee None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:08.907368 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f612ce0b-81b4-40de-a0b0-eb3aea235d46 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:08.907764 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f612ce0b-81b4-40de-a0b0-eb3aea235d46 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:08.908128 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f612ce0b-81b4-40de-a0b0-eb3aea235d46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:08.930624 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-f612ce0b-81b4-40de-a0b0-eb3aea235d46 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:08:08.931827 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-f612ce0b-81b4-40de-a0b0-eb3aea235d46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:08:08.957053 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464ea63b-bb74-4c10-bd7d-5b391c69ec4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:08.958338 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464ea63b-bb74-4c10-bd7d-5b391c69ec4c None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:08.958826 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464ea63b-bb74-4c10-bd7d-5b391c69ec4c None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:08.959567 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464ea63b-bb74-4c10-bd7d-5b391c69ec4c None admin] PATH_INFO: `/v3/services` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:08.960709 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464ea63b-bb74-4c10-bd7d-5b391c69ec4c None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:08.961027 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464ea63b-bb74-4c10-bd7d-5b391c69ec4c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:08.963144 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464ea63b-bb74-4c10-bd7d-5b391c69ec4c None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:08.975724 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 480/944] 10.222.0.47 () {56 vars in 1126 bytes} [Wed Aug 31 00:08:08 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:08.977706 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464ea63b-bb74-4c10-bd7d-5b391c69ec4c None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:09.024424 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 465/945] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 00:08:08 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 00:08:09.080993 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:09.097752 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464ea63b-bb74-4c10-bd7d-5b391c69ec4c None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:09.134238 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fe6bee-20e7-4d60-8af9-21676c5323fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:09.135846 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fe6bee-20e7-4d60-8af9-21676c5323fd None admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:09.136400 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fe6bee-20e7-4d60-8af9-21676c5323fd None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:09.136884 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fe6bee-20e7-4d60-8af9-21676c5323fd None admin] PATH_INFO: `/v3/endpoints` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:09.137841 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fe6bee-20e7-4d60-8af9-21676c5323fd None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:09.139512 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fe6bee-20e7-4d60-8af9-21676c5323fd None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:09.167797 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 481/946] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 31 00:08:08 2022] POST /identity/v3/endpoints => generated 347 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:08:09.299298 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f612ce0b-81b4-40de-a0b0-eb3aea235d46 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:09.334007 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:09.423004 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f612ce0b-81b4-40de-a0b0-eb3aea235d46 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:09.473446 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2b25b8-c231-41e8-917c-833abe5b8778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:09.474070 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2b25b8-c231-41e8-917c-833abe5b8778 None admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:09.474349 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2b25b8-c231-41e8-917c-833abe5b8778 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:09.474620 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2b25b8-c231-41e8-917c-833abe5b8778 None admin] PATH_INFO: `/v3/projects` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:09.475282 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2b25b8-c231-41e8-917c-833abe5b8778 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:09.476793 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2b25b8-c231-41e8-917c-833abe5b8778 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:09.479983 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: WARNING keystone.server.flask.common [None req-9d2b25b8-c231-41e8-917c-833abe5b8778 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 31 00:08:09.501436 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.sql.core [None req-9d2b25b8-c231-41e8-917c-833abe5b8778 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 31 00:08:09.501436 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 31 00:08:09.501436 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [parameters: {'id': '10c656e9c5904891bb28636f950a44f4', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 31 00:08:09.501436 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81523) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 31 00:08:09.509938 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-9d2b25b8-c231-41e8-917c-833abe5b8778 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 10c656e9c5904891bb28636f950a44f4.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 10c656e9c5904891bb28636f950a44f4. Aug 31 00:08:09.509938 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:09.509938 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 31 00:08:09.509938 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 31 00:08:09.509938 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 31 00:08:09.509938 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 31 00:08:09.509938 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 31 00:08:09.509938 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application result = self._query(query) Aug 31 00:08:09.509938 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 31 00:08:09.509938 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application conn.query(q) Aug 31 00:08:09.509938 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 31 00:08:09.509938 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 31 00:08:09.509938 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 31 00:08:09.510892 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application result.read() Aug 31 00:08:09.510892 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 31 00:08:09.510892 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 31 00:08:09.510892 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 31 00:08:09.510892 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 31 00:08:09.510892 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 31 00:08:09.510892 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 31 00:08:09.510892 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 31 00:08:09.510892 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 31 00:08:09.510892 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 31 00:08:09.510892 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 31 00:08:09.510892 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 31 00:08:09.510892 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 31 00:08:09.510892 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:09.510892 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 31 00:08:09.510892 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 31 00:08:09.510892 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 31 00:08:09.510892 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 31 00:08:09.512094 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 31 00:08:09.512094 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application next(self.gen) Aug 31 00:08:09.512094 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 31 00:08:09.512094 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application yield resource Aug 31 00:08:09.512094 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 31 00:08:09.512094 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application next(self.gen) Aug 31 00:08:09.512094 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 31 00:08:09.512094 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application self.session.rollback() Aug 31 00:08:09.512094 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 31 00:08:09.512094 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application self.force_reraise() Aug 31 00:08:09.512094 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 31 00:08:09.512094 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise self.value Aug 31 00:08:09.512094 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 31 00:08:09.512094 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 31 00:08:09.512094 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 31 00:08:09.512094 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application session.commit() Aug 31 00:08:09.512094 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 31 00:08:09.514884 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 31 00:08:09.514884 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 31 00:08:09.514884 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application self._prepare_impl() Aug 31 00:08:09.514884 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 31 00:08:09.514884 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application self.session.flush() Aug 31 00:08:09.514884 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 31 00:08:09.514884 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application self._flush(objects) Aug 31 00:08:09.514884 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 31 00:08:09.514884 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 31 00:08:09.514884 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 31 00:08:09.514884 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application compat.raise_( Aug 31 00:08:09.514884 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 31 00:08:09.514884 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception Aug 31 00:08:09.514884 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 31 00:08:09.514884 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application flush_context.execute() Aug 31 00:08:09.514884 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 31 00:08:09.514884 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rec.execute(self) Aug 31 00:08:09.517128 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 31 00:08:09.517128 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 31 00:08:09.517128 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 31 00:08:09.517128 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 31 00:08:09.517128 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 31 00:08:09.517128 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 31 00:08:09.517128 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 31 00:08:09.517128 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 31 00:08:09.517128 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 31 00:08:09.517128 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 31 00:08:09.517128 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 31 00:08:09.517128 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 31 00:08:09.517128 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 31 00:08:09.517128 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 31 00:08:09.517128 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 31 00:08:09.519203 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 31 00:08:09.519203 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 31 00:08:09.519203 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception Aug 31 00:08:09.519203 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 31 00:08:09.519203 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 31 00:08:09.519203 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 31 00:08:09.519203 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 31 00:08:09.519203 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 31 00:08:09.519203 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application result = self._query(query) Aug 31 00:08:09.519203 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 31 00:08:09.519203 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application conn.query(q) Aug 31 00:08:09.519203 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 31 00:08:09.519203 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 31 00:08:09.519203 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 31 00:08:09.519203 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application result.read() Aug 31 00:08:09.519203 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 31 00:08:09.519203 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 31 00:08:09.524523 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 31 00:08:09.524523 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 31 00:08:09.524523 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 31 00:08:09.524523 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 31 00:08:09.524523 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 31 00:08:09.524523 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 31 00:08:09.524523 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 31 00:08:09.524523 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 31 00:08:09.524523 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [parameters: {'id': '10c656e9c5904891bb28636f950a44f4', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 31 00:08:09.524523 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 31 00:08:09.524523 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 31 00:08:09.524523 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 00:08:09.524523 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 31 00:08:09.524523 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:09.524523 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 31 00:08:09.525374 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 31 00:08:09.525374 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 31 00:08:09.525374 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 31 00:08:09.525374 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 31 00:08:09.525374 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 31 00:08:09.525374 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 00:08:09.525374 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 31 00:08:09.525374 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:09.525374 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:08:09.525374 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:08:09.525374 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:08:09.525374 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:08:09.525374 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:08:09.525374 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:08:09.525374 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:08:09.525374 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:08:09.525374 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:08:09.526371 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:08:09.526371 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 31 00:08:09.526371 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 31 00:08:09.526371 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:08:09.526371 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:08:09.526371 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 31 00:08:09.526371 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 31 00:08:09.526371 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 10c656e9c5904891bb28636f950a44f4. Aug 31 00:08:09.526371 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 31 00:08:09.526371 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 466/947] 10.222.0.47 () {60 vars in 1140 bytes} [Wed Aug 31 00:08:09 2022] POST /identity/v3/projects => generated 262 bytes in 213 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:08:09.527137 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fe6bee-20e7-4d60-8af9-21676c5323fd None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:09.638948 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fe6bee-20e7-4d60-8af9-21676c5323fd None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:09.676998 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f889eeed-27ce-4b41-a729-20f09ddeb024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:09.677913 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f889eeed-27ce-4b41-a729-20f09ddeb024 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:09.678394 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f889eeed-27ce-4b41-a729-20f09ddeb024 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:09.678818 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f889eeed-27ce-4b41-a729-20f09ddeb024 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:09.687570 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f889eeed-27ce-4b41-a729-20f09ddeb024 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:09.689299 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f889eeed-27ce-4b41-a729-20f09ddeb024 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:09.692480 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:09.702717 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-f889eeed-27ce-4b41-a729-20f09ddeb024 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:08:09.702717 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:09.702717 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:08:09.702717 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:08:09.702717 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:08:09.702717 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:08:09.702717 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:08:09.702717 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:08:09.702717 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:08:09.702717 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:08:09.702717 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:08:09.702717 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:08:09.702717 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 00:08:09.702717 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 00:08:09.702717 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 00:08:09.703797 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 00:08:09.703797 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:08:09.703797 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:08:09.703797 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:08:09.703797 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:08:09.703797 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:08:09.703797 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:08:09.703797 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:08:09.703797 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Aug 31 00:08:09.703797 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:08:09.703797 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:08:09.703797 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:08:09.703797 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:08:09.703797 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:08:09.703797 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:08:09.703797 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:08:09.703797 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:08:09.704731 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 00:08:09.704731 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 00:08:09.704731 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:08:09.704731 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:08:09.704731 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:08:09.704731 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:08:09.704731 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:08:09.704731 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Aug 31 00:08:09.711107 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 482/948] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 31 00:08:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:08:09.717394 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2b25b8-c231-41e8-917c-833abe5b8778 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:09.808203 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:09.829232 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2b25b8-c231-41e8-917c-833abe5b8778 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:09.867327 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac34a97c-d263-46a0-8eb0-04ee91dbb5cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:09.867948 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac34a97c-d263-46a0-8eb0-04ee91dbb5cb None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:09.868270 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac34a97c-d263-46a0-8eb0-04ee91dbb5cb None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:09.868547 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac34a97c-d263-46a0-8eb0-04ee91dbb5cb None admin] PATH_INFO: `/v3/projects` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:09.869224 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac34a97c-d263-46a0-8eb0-04ee91dbb5cb None admin] RBAC: Adding query filter params (name=service) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:09.870078 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac34a97c-d263-46a0-8eb0-04ee91dbb5cb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:09.871810 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac34a97c-d263-46a0-8eb0-04ee91dbb5cb None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:09.894059 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 467/949] 10.222.0.47 () {56 vars in 1112 bytes} [Wed Aug 31 00:08:09 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:10.381972 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1b495e-20e8-4db1-89f7-73c24080c580 None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:10.382170 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1b495e-20e8-4db1-89f7-73c24080c580 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:10.382451 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1b495e-20e8-4db1-89f7-73c24080c580 None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:10.384075 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 483/950] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 00:08:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:08:10.390205 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb426456-6015-4942-9cef-071f77223a06 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:10.390482 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb426456-6015-4942-9cef-071f77223a06 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:10.390757 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb426456-6015-4942-9cef-071f77223a06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:10.411363 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-cb426456-6015-4942-9cef-071f77223a06 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:08:10.412968 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-cb426456-6015-4942-9cef-071f77223a06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:08:10.491260 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 468/951] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 00:08:10 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:08:10.624500 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232b1637-af9b-4412-bef9-aaa2b2f96385 None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:10.625162 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232b1637-af9b-4412-bef9-aaa2b2f96385 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:10.625162 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232b1637-af9b-4412-bef9-aaa2b2f96385 None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:10.626637 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 484/952] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 00:08:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:08:10.632142 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d8c348-3615-45c8-ae70-41b6e8ab4eb5 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:10.632411 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d8c348-3615-45c8-ae70-41b6e8ab4eb5 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:10.633385 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d8c348-3615-45c8-ae70-41b6e8ab4eb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:10.653184 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-90d8c348-3615-45c8-ae70-41b6e8ab4eb5 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:08:10.654401 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-90d8c348-3615-45c8-ae70-41b6e8ab4eb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:08:10.723938 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:10.729106 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 469/953] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 00:08:10 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:08:10.813799 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232b1637-af9b-4412-bef9-aaa2b2f96385 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:10.932773 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232b1637-af9b-4412-bef9-aaa2b2f96385 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:10.974196 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef13456-0654-41d4-b1d7-b7a9fd1d0ec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:10.975275 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef13456-0654-41d4-b1d7-b7a9fd1d0ec8 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:10.975798 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef13456-0654-41d4-b1d7-b7a9fd1d0ec8 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:10.976383 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef13456-0654-41d4-b1d7-b7a9fd1d0ec8 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:10.989282 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef13456-0654-41d4-b1d7-b7a9fd1d0ec8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:08:10.995153 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-fef13456-0654-41d4-b1d7-b7a9fd1d0ec8 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 00:08:10.995153 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:10.995153 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:08:10.995153 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:08:10.995153 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:08:10.995153 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:08:10.995153 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:08:10.995153 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:08:10.995153 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:08:10.995153 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:08:10.995153 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:08:10.995153 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:08:10.995153 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:08:10.995153 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:08:10.995153 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:08:10.995153 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:08:10.996239 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:08:10.996239 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:08:10.996239 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:08:10.996239 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:08:10.996239 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:08:10.996239 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:08:10.996239 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:08:10.996239 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:08:10.996239 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:08:10.996239 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:08:10.996239 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:08:10.996239 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Aug 31 00:08:10.996239 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:08:10.996239 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:08:10.996239 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:08:10.996239 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:08:10.997163 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:08:10.997163 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:08:10.997163 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:08:10.997163 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:08:10.997163 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:08:10.997163 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:08:10.997163 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:08:10.997163 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:08:10.997163 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:08:10.997163 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:08:10.997163 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 00:08:10.997163 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Aug 31 00:08:10.997163 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 485/954] 10.222.0.47 () {56 vars in 1120 bytes} [Wed Aug 31 00:08:10 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:08:11.007373 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d8c348-3615-45c8-ae70-41b6e8ab4eb5 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:11.016922 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef13456-0654-41d4-b1d7-b7a9fd1d0ec8 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:11.099442 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:11.139343 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d8c348-3615-45c8-ae70-41b6e8ab4eb5 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:11.147499 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef13456-0654-41d4-b1d7-b7a9fd1d0ec8 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:11.181056 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaedac22-576b-4d2f-ac31-95cfd7b4526a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:11.181681 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaedac22-576b-4d2f-ac31-95cfd7b4526a None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:11.182129 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaedac22-576b-4d2f-ac31-95cfd7b4526a None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:11.183176 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaedac22-576b-4d2f-ac31-95cfd7b4526a None admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:11.183903 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaedac22-576b-4d2f-ac31-95cfd7b4526a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:11.184250 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaedac22-576b-4d2f-ac31-95cfd7b4526a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:11.185670 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaedac22-576b-4d2f-ac31-95cfd7b4526a None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:11.189535 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893d0cac-7d26-4141-b6ff-350bde6664ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:11.190196 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893d0cac-7d26-4141-b6ff-350bde6664ce None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:11.190478 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893d0cac-7d26-4141-b6ff-350bde6664ce None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:11.190753 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893d0cac-7d26-4141-b6ff-350bde6664ce None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:11.191341 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893d0cac-7d26-4141-b6ff-350bde6664ce None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:11.192771 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893d0cac-7d26-4141-b6ff-350bde6664ce None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:11.195624 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 470/955] 10.222.0.47 () {56 vars in 1115 bytes} [Wed Aug 31 00:08:11 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:11.201774 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaedac22-576b-4d2f-ac31-95cfd7b4526a None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:11.203677 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-893d0cac-7d26-4141-b6ff-350bde6664ce None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 00:08:11.203677 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:11.203677 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 00:08:11.203677 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 00:08:11.203677 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 00:08:11.203677 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 00:08:11.203677 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 00:08:11.203677 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:08:11.203677 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 00:08:11.203677 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Aug 31 00:08:11.203677 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 00:08:11.203677 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Aug 31 00:08:11.203677 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:11.203677 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:08:11.203677 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:08:11.203677 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:08:11.203677 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:08:11.205181 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:08:11.205181 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:08:11.205181 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:08:11.205181 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:08:11.205181 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:08:11.205181 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:08:11.205181 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 00:08:11.205181 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 00:08:11.205181 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 00:08:11.205181 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 00:08:11.205181 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:08:11.205181 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:08:11.205181 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:08:11.205181 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:08:11.205181 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:08:11.205181 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:08:11.206098 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:08:11.206098 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Aug 31 00:08:11.206098 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:08:11.206098 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:08:11.206098 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:08:11.206098 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:08:11.206098 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:08:11.206098 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:08:11.206098 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:08:11.206098 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:08:11.206098 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 00:08:11.206098 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:08:11.206098 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 00:08:11.206098 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Aug 31 00:08:11.206098 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 486/956] 10.222.0.47 () {56 vars in 1126 bytes} [Wed Aug 31 00:08:11 2022] GET /identity/v3/services/object-store => generated 93 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:08:11.212275 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893d0cac-7d26-4141-b6ff-350bde6664ce None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:11.287518 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:11.342237 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaedac22-576b-4d2f-ac31-95cfd7b4526a None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:11.359858 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893d0cac-7d26-4141-b6ff-350bde6664ce None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:11.381002 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c744a43-4150-4157-964e-f2c6df0a06f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:11.381991 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c744a43-4150-4157-964e-f2c6df0a06f4 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:11.382515 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c744a43-4150-4157-964e-f2c6df0a06f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:11.382936 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c744a43-4150-4157-964e-f2c6df0a06f4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:11.390129 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:11.397204 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c744a43-4150-4157-964e-f2c6df0a06f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:11.398960 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c744a43-4150-4157-964e-f2c6df0a06f4 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:11.407334 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c828b70d-c23a-42a0-9827-6321671ca7d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:11.408125 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c828b70d-c23a-42a0-9827-6321671ca7d2 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:11.408428 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c828b70d-c23a-42a0-9827-6321671ca7d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:11.408962 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c828b70d-c23a-42a0-9827-6321671ca7d2 None admin] PATH_INFO: `/v3/services` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:11.409629 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c828b70d-c23a-42a0-9827-6321671ca7d2 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:11.410073 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c828b70d-c23a-42a0-9827-6321671ca7d2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:11.411735 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c828b70d-c23a-42a0-9827-6321671ca7d2 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:11.416011 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-3c744a43-4150-4157-964e-f2c6df0a06f4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:08:11.416011 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:11.416011 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:08:11.416011 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:08:11.416011 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:08:11.416011 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:08:11.416011 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:08:11.416011 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:08:11.416011 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:08:11.416011 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:08:11.416011 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:08:11.416011 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:08:11.416011 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:08:11.416011 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:08:11.416011 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:08:11.416011 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:08:11.424415 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:08:11.424415 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:08:11.424415 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:08:11.424415 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:08:11.424415 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:08:11.424415 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:08:11.424415 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:08:11.424415 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 31 00:08:11.424415 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:08:11.424415 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:08:11.424415 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:08:11.424415 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:08:11.424415 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:08:11.424415 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:08:11.424415 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:08:11.424415 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:08:11.424415 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:08:11.425400 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:08:11.425400 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:08:11.425400 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 31 00:08:11.425400 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 471/957] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 00:08:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:08:11.425400 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde8a412-34ec-42e5-827d-a048f4c0d583 None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:11.425400 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde8a412-34ec-42e5-827d-a048f4c0d583 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:11.425400 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde8a412-34ec-42e5-827d-a048f4c0d583 None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:11.425400 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 472/958] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 00:08:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:08:11.425400 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde8a412-34ec-42e5-827d-a048f4c0d583 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:11.428026 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 487/959] 10.222.0.47 () {56 vars in 1122 bytes} [Wed Aug 31 00:08:11 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:11.429574 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d15b8e-237d-460e-8a58-e7b75fc4bfc4 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:11.429862 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d15b8e-237d-460e-8a58-e7b75fc4bfc4 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:11.430136 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d15b8e-237d-460e-8a58-e7b75fc4bfc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:11.450682 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-f8d15b8e-237d-460e-8a58-e7b75fc4bfc4 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:08:11.451800 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-f8d15b8e-237d-460e-8a58-e7b75fc4bfc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:08:11.531014 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 488/960] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 00:08:11 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:08:11.532457 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d15b8e-237d-460e-8a58-e7b75fc4bfc4 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:11.573237 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde8a412-34ec-42e5-827d-a048f4c0d583 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:11.593388 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:11.621781 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bba1087-40d8-425a-b1b6-ce95e6a2860c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:11.622606 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bba1087-40d8-425a-b1b6-ce95e6a2860c None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:11.623001 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bba1087-40d8-425a-b1b6-ce95e6a2860c None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:11.623270 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bba1087-40d8-425a-b1b6-ce95e6a2860c None admin] PATH_INFO: `/v3/domains` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:11.624597 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bba1087-40d8-425a-b1b6-ce95e6a2860c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:11.624597 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bba1087-40d8-425a-b1b6-ce95e6a2860c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:11.626406 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bba1087-40d8-425a-b1b6-ce95e6a2860c None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:11.655904 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 473/961] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 31 00:08:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:08:11.661454 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bba1087-40d8-425a-b1b6-ce95e6a2860c None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:11.706205 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d15b8e-237d-460e-8a58-e7b75fc4bfc4 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:11.730408 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:11.755653 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddabd672-f135-42a4-9a80-7db8f0c0be35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:11.756466 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddabd672-f135-42a4-9a80-7db8f0c0be35 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:11.756813 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddabd672-f135-42a4-9a80-7db8f0c0be35 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:11.757160 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddabd672-f135-42a4-9a80-7db8f0c0be35 None admin] PATH_INFO: `/v3/services` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:11.757872 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddabd672-f135-42a4-9a80-7db8f0c0be35 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:11.758558 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddabd672-f135-42a4-9a80-7db8f0c0be35 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:11.759685 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddabd672-f135-42a4-9a80-7db8f0c0be35 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:11.766641 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 489/962] 10.222.0.47 () {56 vars in 1122 bytes} [Wed Aug 31 00:08:11 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:11.771956 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddabd672-f135-42a4-9a80-7db8f0c0be35 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:11.790616 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bba1087-40d8-425a-b1b6-ce95e6a2860c None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:11.839882 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d265b514-99be-4c38-be0b-311d5be3060e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:11.840572 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d265b514-99be-4c38-be0b-311d5be3060e None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:11.840850 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d265b514-99be-4c38-be0b-311d5be3060e None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:11.841121 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d265b514-99be-4c38-be0b-311d5be3060e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:11.848839 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d265b514-99be-4c38-be0b-311d5be3060e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:11.850298 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d265b514-99be-4c38-be0b-311d5be3060e None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:11.863787 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-d265b514-99be-4c38-be0b-311d5be3060e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 00:08:11.863787 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:11.863787 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:08:11.863787 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:08:11.863787 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:08:11.863787 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:08:11.863787 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:08:11.863787 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:08:11.863787 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:08:11.863787 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:08:11.863787 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:08:11.863787 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:08:11.863787 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 00:08:11.863787 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 00:08:11.863787 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 00:08:11.863787 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 00:08:11.864864 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:08:11.864864 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:08:11.864864 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:08:11.864864 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:08:11.864864 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:08:11.864864 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:08:11.864864 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:08:11.864864 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:08:11.864864 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:08:11.864864 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:08:11.864864 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:08:11.864864 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 31 00:08:11.864864 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:08:11.864864 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:08:11.864864 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:08:11.864864 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:08:11.864864 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:08:11.864864 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:08:11.865860 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:08:11.865860 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:08:11.865860 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 00:08:11.865860 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 00:08:11.865860 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 00:08:11.865860 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 00:08:11.865860 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 00:08:11.865860 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 00:08:11.865860 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 00:08:11.865860 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 31 00:08:11.865860 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 474/963] 10.222.0.47 () {56 vars in 1117 bytes} [Wed Aug 31 00:08:11 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:08:11.865860 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d265b514-99be-4c38-be0b-311d5be3060e None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:11.898132 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddabd672-f135-42a4-9a80-7db8f0c0be35 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:11.909218 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:11.939395 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c5974a-1289-4a9e-bc51-812b8f4dce7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:11.940016 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c5974a-1289-4a9e-bc51-812b8f4dce7f None admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:11.940350 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c5974a-1289-4a9e-bc51-812b8f4dce7f None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:11.940605 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c5974a-1289-4a9e-bc51-812b8f4dce7f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:11.941283 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c5974a-1289-4a9e-bc51-812b8f4dce7f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:11.942642 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c5974a-1289-4a9e-bc51-812b8f4dce7f None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:11.965178 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 490/964] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 31 00:08:11 2022] POST /identity/v3/endpoints => generated 349 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:08:11.966397 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c5974a-1289-4a9e-bc51-812b8f4dce7f None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:12.023011 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d265b514-99be-4c38-be0b-311d5be3060e None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:12.031301 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:12.077343 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0143d6f8-56fd-4cbc-9281-3c6de7948968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:12.077991 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0143d6f8-56fd-4cbc-9281-3c6de7948968 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:12.078270 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0143d6f8-56fd-4cbc-9281-3c6de7948968 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:12.078540 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0143d6f8-56fd-4cbc-9281-3c6de7948968 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:12.079682 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0143d6f8-56fd-4cbc-9281-3c6de7948968 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:12.081511 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0143d6f8-56fd-4cbc-9281-3c6de7948968 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:12.093074 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-0143d6f8-56fd-4cbc-9281-3c6de7948968 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 31 00:08:12.093074 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:12.093074 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 00:08:12.093074 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 00:08:12.093074 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 00:08:12.093074 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 00:08:12.093074 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 00:08:12.093074 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:08:12.093074 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 31 00:08:12.093074 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 31 00:08:12.093074 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 00:08:12.093074 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 31 00:08:12.093074 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:12.093074 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:08:12.093074 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:08:12.093074 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:08:12.093074 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:08:12.094272 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:08:12.094272 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:08:12.094272 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:08:12.094272 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:08:12.094272 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:08:12.094272 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:08:12.094272 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 00:08:12.094272 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 00:08:12.094272 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 00:08:12.094272 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 00:08:12.094272 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:08:12.094272 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:08:12.094272 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:08:12.094272 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:08:12.094272 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:08:12.094272 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:08:12.095156 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:08:12.095156 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 31 00:08:12.095156 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:08:12.095156 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:08:12.095156 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:08:12.095156 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:08:12.095156 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:08:12.095156 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:08:12.095156 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:08:12.095156 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:08:12.095156 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 00:08:12.095156 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:08:12.095156 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 31 00:08:12.095156 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 31 00:08:12.095156 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 475/965] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 31 00:08:11 2022] GET /identity/v3/services/compute => generated 88 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:08:12.100602 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6c695c-12dd-4780-ac33-1811e245438e None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:12.100903 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6c695c-12dd-4780-ac33-1811e245438e None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:12.101153 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6c695c-12dd-4780-ac33-1811e245438e None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:12.102810 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 476/966] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 00:08:12 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:08:12.103282 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6c695c-12dd-4780-ac33-1811e245438e None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:12.117404 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c5974a-1289-4a9e-bc51-812b8f4dce7f None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:12.158584 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6358ebd7-9a8f-4d0c-8c43-5b80a2536d6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:12.159203 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6358ebd7-9a8f-4d0c-8c43-5b80a2536d6f None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:12.159743 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6358ebd7-9a8f-4d0c-8c43-5b80a2536d6f None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:12.160021 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6358ebd7-9a8f-4d0c-8c43-5b80a2536d6f None admin] PATH_INFO: `/v3/users` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:12.160859 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6358ebd7-9a8f-4d0c-8c43-5b80a2536d6f None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:12.161164 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6358ebd7-9a8f-4d0c-8c43-5b80a2536d6f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:12.162615 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6358ebd7-9a8f-4d0c-8c43-5b80a2536d6f None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:12.183868 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 491/967] 10.222.0.47 () {56 vars in 1149 bytes} [Wed Aug 31 00:08:11 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:12.185522 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9b3f0d-d321-4d1b-8f7d-b06b343e0060 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:12.185966 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9b3f0d-d321-4d1b-8f7d-b06b343e0060 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:12.186479 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9b3f0d-d321-4d1b-8f7d-b06b343e0060 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:12.206058 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-fe9b3f0d-d321-4d1b-8f7d-b06b343e0060 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:08:12.207291 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-fe9b3f0d-d321-4d1b-8f7d-b06b343e0060 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:08:12.225866 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:12.235724 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6c695c-12dd-4780-ac33-1811e245438e None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:12.278524 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c3e498-a315-4108-998b-be9d8cd74136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:12.279247 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c3e498-a315-4108-998b-be9d8cd74136 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:12.279529 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c3e498-a315-4108-998b-be9d8cd74136 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:12.279799 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c3e498-a315-4108-998b-be9d8cd74136 None admin] PATH_INFO: `/v3/services` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:12.280528 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c3e498-a315-4108-998b-be9d8cd74136 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:12.280839 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c3e498-a315-4108-998b-be9d8cd74136 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:12.282270 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c3e498-a315-4108-998b-be9d8cd74136 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:12.293929 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 477/968] 10.222.0.47 () {56 vars in 1112 bytes} [Wed Aug 31 00:08:12 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:12.293929 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c3e498-a315-4108-998b-be9d8cd74136 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:12.304489 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 492/969] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 00:08:12 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:08:12.306227 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9b3f0d-d321-4d1b-8f7d-b06b343e0060 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:12.349363 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:12.421513 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c3e498-a315-4108-998b-be9d8cd74136 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:12.440676 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9b3f0d-d321-4d1b-8f7d-b06b343e0060 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:12.466693 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd77a0e-adfd-41a7-8115-3467196e3834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:12.468176 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd77a0e-adfd-41a7-8115-3467196e3834 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:12.468695 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd77a0e-adfd-41a7-8115-3467196e3834 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:12.469168 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd77a0e-adfd-41a7-8115-3467196e3834 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:12.489336 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5222cb50-b7a7-4b55-9325-f6391e8fb0a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:12.489870 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5222cb50-b7a7-4b55-9325-f6391e8fb0a3 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:12.490153 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5222cb50-b7a7-4b55-9325-f6391e8fb0a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:12.490423 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5222cb50-b7a7-4b55-9325-f6391e8fb0a3 None admin] PATH_INFO: `/v3/services` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:12.491076 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5222cb50-b7a7-4b55-9325-f6391e8fb0a3 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:12.491648 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5222cb50-b7a7-4b55-9325-f6391e8fb0a3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:12.493308 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5222cb50-b7a7-4b55-9325-f6391e8fb0a3 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:12.505211 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 493/970] 10.222.0.47 () {56 vars in 1112 bytes} [Wed Aug 31 00:08:12 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:12.520592 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:12.574312 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd77a0e-adfd-41a7-8115-3467196e3834 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:12.575810 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd77a0e-adfd-41a7-8115-3467196e3834 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:12.577635 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5222cb50-b7a7-4b55-9325-f6391e8fb0a3 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:12.696315 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:12.699617 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 478/971] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 31 00:08:12 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 00:08:12.706345 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd77a0e-adfd-41a7-8115-3467196e3834 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:12.715671 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5222cb50-b7a7-4b55-9325-f6391e8fb0a3 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:12.759510 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdedf4a-a64e-49c9-a154-4f5280ef0789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:12.760734 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdedf4a-a64e-49c9-a154-4f5280ef0789 None admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:12.761135 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdedf4a-a64e-49c9-a154-4f5280ef0789 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:12.761606 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdedf4a-a64e-49c9-a154-4f5280ef0789 None admin] PATH_INFO: `/v3/users` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:12.762504 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdedf4a-a64e-49c9-a154-4f5280ef0789 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:12.764169 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdedf4a-a64e-49c9-a154-4f5280ef0789 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:12.767199 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: WARNING keystone.server.flask.common [None req-fbdedf4a-a64e-49c9-a154-4f5280ef0789 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 31 00:08:12.783106 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:12.785811 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.sql.core [None req-fbdedf4a-a64e-49c9-a154-4f5280ef0789 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 31 00:08:12.785811 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 31 00:08:12.785811 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [parameters: {'user_id': '5beb3353c0ad49318fc16bf7671be240', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 31 00:08:12.785811 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81524) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 31 00:08:12.804985 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-fbdedf4a-a64e-49c9-a154-4f5280ef0789 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 31 00:08:12.804985 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:12.804985 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 31 00:08:12.804985 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 31 00:08:12.804985 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 31 00:08:12.804985 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 31 00:08:12.804985 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 31 00:08:12.804985 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application result = self._query(query) Aug 31 00:08:12.804985 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 31 00:08:12.804985 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application conn.query(q) Aug 31 00:08:12.804985 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 31 00:08:12.804985 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 31 00:08:12.804985 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 31 00:08:12.804985 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application result.read() Aug 31 00:08:12.804985 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 31 00:08:12.806016 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 31 00:08:12.806016 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 31 00:08:12.806016 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 31 00:08:12.806016 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 31 00:08:12.806016 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 31 00:08:12.806016 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 31 00:08:12.806016 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 31 00:08:12.806016 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 31 00:08:12.806016 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Aug 31 00:08:12.806016 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 31 00:08:12.806016 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Aug 31 00:08:12.806016 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:12.806016 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 31 00:08:12.806016 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 31 00:08:12.806016 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 31 00:08:12.806016 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 31 00:08:12.806016 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 31 00:08:12.806016 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application next(self.gen) Aug 31 00:08:12.807853 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 31 00:08:12.807853 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application yield resource Aug 31 00:08:12.807853 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 31 00:08:12.807853 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application next(self.gen) Aug 31 00:08:12.807853 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 31 00:08:12.807853 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application self.session.rollback() Aug 31 00:08:12.807853 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 31 00:08:12.807853 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application self.force_reraise() Aug 31 00:08:12.807853 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 31 00:08:12.807853 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise self.value Aug 31 00:08:12.807853 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 31 00:08:12.807853 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 31 00:08:12.807853 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 31 00:08:12.807853 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application session.commit() Aug 31 00:08:12.807853 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 31 00:08:12.807853 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 31 00:08:12.807853 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 31 00:08:12.809169 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application self._prepare_impl() Aug 31 00:08:12.809169 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 31 00:08:12.809169 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application self.session.flush() Aug 31 00:08:12.809169 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 31 00:08:12.809169 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application self._flush(objects) Aug 31 00:08:12.809169 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 31 00:08:12.809169 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 31 00:08:12.809169 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 31 00:08:12.809169 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application compat.raise_( Aug 31 00:08:12.809169 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 31 00:08:12.809169 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception Aug 31 00:08:12.809169 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 31 00:08:12.809169 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application flush_context.execute() Aug 31 00:08:12.809169 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 31 00:08:12.809169 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application rec.execute(self) Aug 31 00:08:12.809169 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 31 00:08:12.809169 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 31 00:08:12.810321 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 31 00:08:12.810321 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 31 00:08:12.810321 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 31 00:08:12.810321 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 31 00:08:12.810321 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 31 00:08:12.810321 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 31 00:08:12.810321 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 31 00:08:12.810321 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 31 00:08:12.810321 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 31 00:08:12.810321 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 31 00:08:12.810321 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 31 00:08:12.810321 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 31 00:08:12.810321 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 31 00:08:12.810321 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 31 00:08:12.810321 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 31 00:08:12.810321 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception Aug 31 00:08:12.811438 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 31 00:08:12.811438 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 31 00:08:12.811438 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 31 00:08:12.811438 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 31 00:08:12.811438 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 31 00:08:12.811438 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application result = self._query(query) Aug 31 00:08:12.811438 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 31 00:08:12.811438 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application conn.query(q) Aug 31 00:08:12.811438 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 31 00:08:12.811438 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 31 00:08:12.811438 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 31 00:08:12.811438 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application result.read() Aug 31 00:08:12.811438 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 31 00:08:12.811438 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 31 00:08:12.811438 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 31 00:08:12.811438 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 31 00:08:12.812534 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 31 00:08:12.812534 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 31 00:08:12.812534 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 31 00:08:12.812534 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 31 00:08:12.812534 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 31 00:08:12.812534 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 31 00:08:12.812534 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application [parameters: {'user_id': '5beb3353c0ad49318fc16bf7671be240', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 31 00:08:12.812534 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 31 00:08:12.812534 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Aug 31 00:08:12.812534 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 00:08:12.812534 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Aug 31 00:08:12.812534 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:12.812534 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:08:12.812534 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:08:12.812534 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:08:12.813589 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:08:12.813589 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:08:12.813589 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:08:12.813589 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:08:12.813589 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:08:12.813589 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:08:12.813589 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:08:12.813589 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 31 00:08:12.813589 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 31 00:08:12.813589 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:08:12.813589 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:08:12.813589 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:08:12.813589 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:08:12.813589 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:08:12.813589 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:08:12.813589 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 31 00:08:12.813589 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 31 00:08:12.816676 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 31 00:08:12.816676 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 31 00:08:12.816676 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 31 00:08:12.816676 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 31 00:08:12.816676 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 31 00:08:12.816676 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Aug 31 00:08:12.816676 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 494/972] 10.222.0.47 () {60 vars in 1131 bytes} [Wed Aug 31 00:08:12 2022] POST /identity/v3/users => generated 160 bytes in 229 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:08:12.819614 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdedf4a-a64e-49c9-a154-4f5280ef0789 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:12.840272 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd77a0e-adfd-41a7-8115-3467196e3834 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:12.889295 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cfbe60-a87a-4ae3-bd77-eaba9bba7998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:12.889954 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cfbe60-a87a-4ae3-bd77-eaba9bba7998 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:12.890235 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cfbe60-a87a-4ae3-bd77-eaba9bba7998 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:12.890503 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cfbe60-a87a-4ae3-bd77-eaba9bba7998 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:12.906186 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cfbe60-a87a-4ae3-bd77-eaba9bba7998 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:12.907947 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cfbe60-a87a-4ae3-bd77-eaba9bba7998 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:12.930445 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-f0cfbe60-a87a-4ae3-bd77-eaba9bba7998 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:08:12.930445 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:12.930445 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:08:12.930445 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:08:12.930445 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:08:12.930445 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:08:12.930445 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:08:12.930445 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:08:12.930445 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:08:12.930445 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:08:12.930445 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:08:12.930445 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:08:12.930445 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:08:12.930445 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:08:12.930445 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:08:12.930445 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:08:12.931519 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:08:12.931519 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:08:12.931519 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:08:12.931519 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:08:12.931519 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:08:12.931519 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:08:12.931519 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:08:12.931519 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 31 00:08:12.931519 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:08:12.931519 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:08:12.931519 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:08:12.931519 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:08:12.931519 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:08:12.931519 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:08:12.931519 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:08:12.931519 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:08:12.931519 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:08:12.932688 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:08:12.932688 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:08:12.932688 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 31 00:08:12.932688 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 479/973] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 00:08:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:08:12.937411 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cfbe60-a87a-4ae3-bd77-eaba9bba7998 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:12.965834 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdedf4a-a64e-49c9-a154-4f5280ef0789 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:13.017203 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f380ae-09c3-417a-8480-9e594ce783e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:13.017821 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f380ae-09c3-417a-8480-9e594ce783e7 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:13.018106 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f380ae-09c3-417a-8480-9e594ce783e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:13.018379 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f380ae-09c3-417a-8480-9e594ce783e7 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:13.030434 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f380ae-09c3-417a-8480-9e594ce783e7 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:13.032480 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f380ae-09c3-417a-8480-9e594ce783e7 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:13.050734 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-97f380ae-09c3-417a-8480-9e594ce783e7 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 31 00:08:13.050734 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:13.050734 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:08:13.050734 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:08:13.050734 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:08:13.050734 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:08:13.050734 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:08:13.050734 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:08:13.050734 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:08:13.050734 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:08:13.050734 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:08:13.050734 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:08:13.050734 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 00:08:13.050734 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 00:08:13.050734 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 00:08:13.050734 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 00:08:13.051795 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:08:13.051795 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:08:13.051795 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:08:13.051795 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:08:13.051795 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:08:13.051795 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:08:13.051795 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:08:13.051795 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:08:13.051795 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:08:13.051795 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:08:13.051795 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:08:13.051795 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Aug 31 00:08:13.051795 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:08:13.051795 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:08:13.051795 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:08:13.051795 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:08:13.051795 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:08:13.051795 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:08:13.053180 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:08:13.053180 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:08:13.053180 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 00:08:13.053180 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 00:08:13.053180 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 00:08:13.053180 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 00:08:13.053180 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 00:08:13.053180 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 00:08:13.053180 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 31 00:08:13.053180 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Aug 31 00:08:13.053180 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 495/974] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 31 00:08:12 2022] GET /identity/v3/users/cinder => generated 84 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:08:13.061978 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f380ae-09c3-417a-8480-9e594ce783e7 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:13.074094 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cfbe60-a87a-4ae3-bd77-eaba9bba7998 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:13.084686 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:13.086276 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:13.117792 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5100376-c31b-432d-b8a0-7476b043968e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:13.118612 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5100376-c31b-432d-b8a0-7476b043968e None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:13.118983 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5100376-c31b-432d-b8a0-7476b043968e None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:13.119348 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5100376-c31b-432d-b8a0-7476b043968e None admin] PATH_INFO: `/v3/domains` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:13.120340 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5100376-c31b-432d-b8a0-7476b043968e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:13.120914 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5100376-c31b-432d-b8a0-7476b043968e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:13.122575 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5100376-c31b-432d-b8a0-7476b043968e None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:13.138331 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 480/975] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 31 00:08:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:08:13.143947 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5100376-c31b-432d-b8a0-7476b043968e None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:13.200637 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f380ae-09c3-417a-8480-9e594ce783e7 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:13.238314 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1781642-a494-4dd6-8fea-12ff110c6796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:13.239322 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1781642-a494-4dd6-8fea-12ff110c6796 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:13.239815 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1781642-a494-4dd6-8fea-12ff110c6796 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:13.240329 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1781642-a494-4dd6-8fea-12ff110c6796 None admin] PATH_INFO: `/v3/users` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:13.241543 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1781642-a494-4dd6-8fea-12ff110c6796 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:13.242106 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1781642-a494-4dd6-8fea-12ff110c6796 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:13.243806 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1781642-a494-4dd6-8fea-12ff110c6796 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:13.262062 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5100376-c31b-432d-b8a0-7476b043968e None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:13.290108 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 496/976] 10.222.0.47 () {56 vars in 1101 bytes} [Wed Aug 31 00:08:13 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:13.304071 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ba9f8d-fb89-4b16-95d1-6a152dd2576b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:13.304796 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ba9f8d-fb89-4b16-95d1-6a152dd2576b None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:13.305081 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ba9f8d-fb89-4b16-95d1-6a152dd2576b None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:13.305356 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ba9f8d-fb89-4b16-95d1-6a152dd2576b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:13.314591 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ba9f8d-fb89-4b16-95d1-6a152dd2576b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:13.316263 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ba9f8d-fb89-4b16-95d1-6a152dd2576b None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:13.330465 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-f1ba9f8d-fb89-4b16-95d1-6a152dd2576b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:08:13.330465 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:13.330465 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:08:13.330465 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:08:13.330465 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:08:13.330465 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:08:13.330465 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:08:13.330465 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:08:13.330465 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:08:13.330465 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:08:13.330465 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:08:13.330465 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:08:13.330465 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 00:08:13.330465 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 00:08:13.330465 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 00:08:13.331468 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 00:08:13.331468 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:08:13.331468 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:08:13.331468 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:08:13.331468 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:08:13.331468 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:08:13.331468 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:08:13.331468 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:08:13.331468 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 31 00:08:13.331468 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:08:13.331468 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:08:13.331468 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:08:13.331468 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:08:13.331468 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:08:13.331468 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:08:13.331468 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:08:13.331468 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:08:13.332536 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 00:08:13.332536 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 00:08:13.332536 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:08:13.332536 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:08:13.332536 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:08:13.332536 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:08:13.332536 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:08:13.332536 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 31 00:08:13.332536 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 481/977] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 31 00:08:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:08:13.338129 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1781642-a494-4dd6-8fea-12ff110c6796 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:13.424091 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:13.463878 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1781642-a494-4dd6-8fea-12ff110c6796 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:13.512010 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831f08c4-7de0-4f48-9165-a07e4b4dd57d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:13.512680 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831f08c4-7de0-4f48-9165-a07e4b4dd57d None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:13.512961 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831f08c4-7de0-4f48-9165-a07e4b4dd57d None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:13.513263 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831f08c4-7de0-4f48-9165-a07e4b4dd57d None admin] PATH_INFO: `/v3/projects` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:13.514015 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831f08c4-7de0-4f48-9165-a07e4b4dd57d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:13.514324 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831f08c4-7de0-4f48-9165-a07e4b4dd57d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:13.515790 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831f08c4-7de0-4f48-9165-a07e4b4dd57d None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:13.530433 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 497/978] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Aug 31 00:08:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:13.536737 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ba9f8d-fb89-4b16-95d1-6a152dd2576b None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:13.571457 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:13.650406 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ba9f8d-fb89-4b16-95d1-6a152dd2576b None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:13.693641 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbf5fe9-14e1-47f1-a68d-d13ea48cb451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:13.694250 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbf5fe9-14e1-47f1-a68d-d13ea48cb451 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:13.694523 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbf5fe9-14e1-47f1-a68d-d13ea48cb451 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:13.694790 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbf5fe9-14e1-47f1-a68d-d13ea48cb451 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:13.695521 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbf5fe9-14e1-47f1-a68d-d13ea48cb451 None admin] RBAC: Adding query filter params (role.id=37e9c028ff614960bea9cb8941645e61, scope.project.id=1b647cccb30a427193fc62dbebe0c6f1, user.id=601aa9e547aa4d42bef6753b26f48eaa) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:13.695827 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbf5fe9-14e1-47f1-a68d-d13ea48cb451 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:13.697339 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbf5fe9-14e1-47f1-a68d-d13ea48cb451 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:13.712183 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 482/979] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 31 00:08:13 2022] GET /identity/v3/role_assignments?user.id=601aa9e547aa4d42bef6753b26f48eaa&scope.project.id=1b647cccb30a427193fc62dbebe0c6f1&role.id=37e9c028ff614960bea9cb8941645e61 => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:08:13.992103 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ee60c1-3ea3-4d4f-85fe-58a6fe73c28b None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:13.992628 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ee60c1-3ea3-4d4f-85fe-58a6fe73c28b None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:13.992712 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ee60c1-3ea3-4d4f-85fe-58a6fe73c28b None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:13.994172 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 498/980] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 00:08:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:08:14.000261 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94999b14-332c-40cf-8867-4851f52e1e4f None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:14.000553 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94999b14-332c-40cf-8867-4851f52e1e4f None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:14.000816 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94999b14-332c-40cf-8867-4851f52e1e4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:14.019248 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-94999b14-332c-40cf-8867-4851f52e1e4f None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:08:14.020463 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-94999b14-332c-40cf-8867-4851f52e1e4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:08:14.092871 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 483/981] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 00:08:13 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:08:14.361140 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ee60c1-3ea3-4d4f-85fe-58a6fe73c28b None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:14.468913 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ee60c1-3ea3-4d4f-85fe-58a6fe73c28b None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:14.498021 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:14.507596 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5e8c4f-d9e8-4a02-80bb-8feeec8513f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:14.508262 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5e8c4f-d9e8-4a02-80bb-8feeec8513f9 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:14.508533 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5e8c4f-d9e8-4a02-80bb-8feeec8513f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:14.508803 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5e8c4f-d9e8-4a02-80bb-8feeec8513f9 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:14.509383 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5e8c4f-d9e8-4a02-80bb-8feeec8513f9 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:14.511357 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5e8c4f-d9e8-4a02-80bb-8feeec8513f9 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:14.520477 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-cc5e8c4f-d9e8-4a02-80bb-8feeec8513f9 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 00:08:14.520477 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:14.520477 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 00:08:14.520477 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 00:08:14.520477 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 00:08:14.520477 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 00:08:14.520477 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 00:08:14.520477 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:08:14.520477 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 00:08:14.520477 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Aug 31 00:08:14.520477 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 00:08:14.520477 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Aug 31 00:08:14.520477 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:14.520477 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:08:14.520477 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:08:14.520477 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:08:14.520477 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:08:14.521564 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:08:14.521564 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:08:14.521564 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:08:14.521564 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:08:14.521564 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:08:14.521564 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:08:14.521564 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 00:08:14.521564 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 00:08:14.521564 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 00:08:14.521564 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 00:08:14.521564 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:08:14.521564 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:08:14.521564 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:08:14.521564 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:08:14.521564 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:08:14.521564 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:08:14.522462 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:08:14.522462 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Aug 31 00:08:14.522462 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:08:14.522462 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:08:14.522462 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:08:14.522462 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:08:14.522462 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:08:14.522462 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:08:14.522462 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:08:14.522462 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:08:14.522462 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 00:08:14.522462 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:08:14.522462 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 00:08:14.522462 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Aug 31 00:08:14.524310 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 499/982] 10.222.0.47 () {56 vars in 1126 bytes} [Wed Aug 31 00:08:14 2022] GET /identity/v3/services/object-store => generated 93 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:08:14.527982 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94999b14-332c-40cf-8867-4851f52e1e4f None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:14.553645 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:14.589308 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79834ce-2af3-4b6b-9538-45f1fce2fccb None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:14.589620 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79834ce-2af3-4b6b-9538-45f1fce2fccb None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:14.589866 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79834ce-2af3-4b6b-9538-45f1fce2fccb None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:14.591220 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 500/983] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 00:08:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:08:14.597166 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18be812-fdc0-4b81-82ec-9d1bbd2f3679 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:14.597440 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18be812-fdc0-4b81-82ec-9d1bbd2f3679 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:14.597730 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18be812-fdc0-4b81-82ec-9d1bbd2f3679 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:14.616668 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-b18be812-fdc0-4b81-82ec-9d1bbd2f3679 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:08:14.618104 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-b18be812-fdc0-4b81-82ec-9d1bbd2f3679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:08:14.641748 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94999b14-332c-40cf-8867-4851f52e1e4f None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:14.685861 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677da012-d3bd-4b2a-9445-045718c7d45c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:14.686837 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677da012-d3bd-4b2a-9445-045718c7d45c None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:14.686837 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677da012-d3bd-4b2a-9445-045718c7d45c None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:14.686837 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677da012-d3bd-4b2a-9445-045718c7d45c None admin] PATH_INFO: `/v3/services` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:14.687374 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677da012-d3bd-4b2a-9445-045718c7d45c None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:14.687549 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677da012-d3bd-4b2a-9445-045718c7d45c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:14.689071 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677da012-d3bd-4b2a-9445-045718c7d45c None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:14.694383 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 484/984] 10.222.0.47 () {56 vars in 1122 bytes} [Wed Aug 31 00:08:14 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:14.703772 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677da012-d3bd-4b2a-9445-045718c7d45c None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:14.705544 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 501/985] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 00:08:14 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 00:08:14.799507 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:14.814171 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677da012-d3bd-4b2a-9445-045718c7d45c None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:14.855850 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4af33b4-c4ac-49ab-afcb-68fceaca38ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:14.856550 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4af33b4-c4ac-49ab-afcb-68fceaca38ae None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:14.856838 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4af33b4-c4ac-49ab-afcb-68fceaca38ae None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:14.857106 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4af33b4-c4ac-49ab-afcb-68fceaca38ae None admin] PATH_INFO: `/v3/services` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:14.857742 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4af33b4-c4ac-49ab-afcb-68fceaca38ae None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:14.858036 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4af33b4-c4ac-49ab-afcb-68fceaca38ae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:14.859414 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4af33b4-c4ac-49ab-afcb-68fceaca38ae None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:14.870147 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 485/986] 10.222.0.47 () {56 vars in 1122 bytes} [Wed Aug 31 00:08:14 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:08:14.871690 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18be812-fdc0-4b81-82ec-9d1bbd2f3679 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:14.975528 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4af33b4-c4ac-49ab-afcb-68fceaca38ae None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:14.990002 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18be812-fdc0-4b81-82ec-9d1bbd2f3679 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:15.021836 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:15.035659 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ff5652-ba75-4145-b265-21f4466c186e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:15.036314 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ff5652-ba75-4145-b265-21f4466c186e None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:15.036597 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ff5652-ba75-4145-b265-21f4466c186e None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:15.036868 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ff5652-ba75-4145-b265-21f4466c186e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:15.037610 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ff5652-ba75-4145-b265-21f4466c186e None admin] RBAC: Adding query filter params (interface=admin, service_id=f1723c70c78c42b2922a6ae3f6155af1, region_id=RegionOne) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:15.037924 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ff5652-ba75-4145-b265-21f4466c186e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:15.039314 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ff5652-ba75-4145-b265-21f4466c186e None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:15.045208 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 502/987] 10.222.0.47 () {56 vars in 1249 bytes} [Wed Aug 31 00:08:14 2022] GET /identity/v3/endpoints?service_id=f1723c70c78c42b2922a6ae3f6155af1&interface=admin®ion_id=RegionOne => generated 193 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:08:15.050826 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ff5652-ba75-4145-b265-21f4466c186e None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:15.093960 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4af33b4-c4ac-49ab-afcb-68fceaca38ae None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:15.132469 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1beec78-5da1-4453-9e76-2ec68b112ae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:15.132469 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1beec78-5da1-4453-9e76-2ec68b112ae0 None admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:15.132731 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1beec78-5da1-4453-9e76-2ec68b112ae0 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:15.132973 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1beec78-5da1-4453-9e76-2ec68b112ae0 None admin] PATH_INFO: `/v3/services` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:15.133607 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1beec78-5da1-4453-9e76-2ec68b112ae0 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:15.135001 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1beec78-5da1-4453-9e76-2ec68b112ae0 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:15.152650 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 486/988] 10.222.0.47 () {60 vars in 1141 bytes} [Wed Aug 31 00:08:14 2022] POST /identity/v3/services => generated 242 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:08:15.170843 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ff5652-ba75-4145-b265-21f4466c186e None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:15.252571 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c2f9b7-9f47-43ba-ae6a-728889501601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:15.254105 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c2f9b7-9f47-43ba-ae6a-728889501601 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:15.254918 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c2f9b7-9f47-43ba-ae6a-728889501601 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:15.255809 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c2f9b7-9f47-43ba-ae6a-728889501601 None admin] PATH_INFO: `/v3/services` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:15.257238 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c2f9b7-9f47-43ba-ae6a-728889501601 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:15.260400 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c2f9b7-9f47-43ba-ae6a-728889501601 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:15.274914 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 503/989] 10.222.0.47 () {56 vars in 1087 bytes} [Wed Aug 31 00:08:15 2022] GET /identity/v3/services => generated 1727 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 00:08:15.709422 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de11d4c9-1f4e-491c-a4a1-f6d10827215b None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:15.709980 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de11d4c9-1f4e-491c-a4a1-f6d10827215b None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:15.709980 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de11d4c9-1f4e-491c-a4a1-f6d10827215b None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:15.711319 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 487/990] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 00:08:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:08:15.717830 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9936ecf-a859-4faf-8cb5-b748ff00e697 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:15.718111 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9936ecf-a859-4faf-8cb5-b748ff00e697 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:15.718393 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9936ecf-a859-4faf-8cb5-b748ff00e697 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:15.736861 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-d9936ecf-a859-4faf-8cb5-b748ff00e697 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:08:15.738074 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-d9936ecf-a859-4faf-8cb5-b748ff00e697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:08:15.790791 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:15.821459 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 504/991] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 00:08:15 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:08:16.096974 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de11d4c9-1f4e-491c-a4a1-f6d10827215b None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:16.114757 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:16.220885 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de11d4c9-1f4e-491c-a4a1-f6d10827215b None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:16.257276 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1450fd-2e96-4878-b362-dacd7296554c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:16.257847 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1450fd-2e96-4878-b362-dacd7296554c None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:16.258119 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1450fd-2e96-4878-b362-dacd7296554c None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:16.258373 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1450fd-2e96-4878-b362-dacd7296554c None admin] PATH_INFO: `/v3/services/image` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:16.258958 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1450fd-2e96-4878-b362-dacd7296554c None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:16.261015 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1450fd-2e96-4878-b362-dacd7296554c None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:16.270990 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-4b1450fd-2e96-4878-b362-dacd7296554c None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 31 00:08:16.270990 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:16.270990 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 00:08:16.270990 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 00:08:16.270990 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 00:08:16.270990 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 00:08:16.270990 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 00:08:16.270990 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:08:16.270990 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 31 00:08:16.270990 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 31 00:08:16.270990 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 00:08:16.270990 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 31 00:08:16.270990 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:16.270990 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:08:16.270990 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:08:16.270990 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:08:16.270990 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:08:16.272243 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:08:16.272243 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:08:16.272243 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:08:16.272243 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:08:16.272243 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:08:16.272243 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:08:16.272243 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 00:08:16.272243 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 00:08:16.272243 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 00:08:16.272243 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 00:08:16.272243 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:08:16.272243 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:08:16.272243 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:08:16.272243 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:08:16.272243 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:08:16.272243 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:08:16.273126 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:08:16.273126 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 31 00:08:16.273126 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:08:16.273126 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:08:16.273126 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:08:16.273126 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:08:16.273126 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:08:16.273126 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:08:16.273126 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:08:16.273126 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:08:16.273126 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 00:08:16.273126 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:08:16.273126 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 31 00:08:16.273126 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 31 00:08:16.273126 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 488/992] 10.222.0.47 () {56 vars in 1105 bytes} [Wed Aug 31 00:08:16 2022] GET /identity/v3/services/image => generated 86 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:08:16.279081 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9936ecf-a859-4faf-8cb5-b748ff00e697 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:16.395705 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9936ecf-a859-4faf-8cb5-b748ff00e697 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:16.432446 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdee817-3395-4e40-89fd-f26798055fe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:16.433006 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdee817-3395-4e40-89fd-f26798055fe3 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:16.433230 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdee817-3395-4e40-89fd-f26798055fe3 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:16.433473 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdee817-3395-4e40-89fd-f26798055fe3 None admin] PATH_INFO: `/v3/services` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:16.434187 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdee817-3395-4e40-89fd-f26798055fe3 None admin] RBAC: Adding query filter params (name=image) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:16.434488 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdee817-3395-4e40-89fd-f26798055fe3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:16.436018 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdee817-3395-4e40-89fd-f26798055fe3 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:16.445931 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 505/993] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 00:08:16 2022] GET /identity/v3/services?name=image => generated 122 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:16.447209 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1450fd-2e96-4878-b362-dacd7296554c None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:16.529093 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:16.552575 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1450fd-2e96-4878-b362-dacd7296554c None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:16.588867 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc263958-65bf-430d-be4f-6cb9bd854554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:16.589478 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc263958-65bf-430d-be4f-6cb9bd854554 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:16.589754 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc263958-65bf-430d-be4f-6cb9bd854554 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:16.590020 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc263958-65bf-430d-be4f-6cb9bd854554 None admin] PATH_INFO: `/v3/services` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:16.590639 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc263958-65bf-430d-be4f-6cb9bd854554 None admin] RBAC: Adding query filter params (type=image) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:16.590935 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc263958-65bf-430d-be4f-6cb9bd854554 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:16.592319 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc263958-65bf-430d-be4f-6cb9bd854554 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:16.596942 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 489/994] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 00:08:16 2022] GET /identity/v3/services?type=image => generated 122 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:08:17.150600 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac97a69-d029-42a8-9581-0dc230c0ae73 None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:17.151657 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac97a69-d029-42a8-9581-0dc230c0ae73 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:17.151657 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac97a69-d029-42a8-9581-0dc230c0ae73 None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:17.152763 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 506/995] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 00:08:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:08:17.157890 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e19b96-854a-4c1d-be9b-34d116bcad4c None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:17.158360 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e19b96-854a-4c1d-be9b-34d116bcad4c None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:17.158444 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e19b96-854a-4c1d-be9b-34d116bcad4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:17.177755 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-c2e19b96-854a-4c1d-be9b-34d116bcad4c None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:08:17.178958 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-c2e19b96-854a-4c1d-be9b-34d116bcad4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:08:17.246018 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aa25d8-c45b-4813-93d5-e56406f325b5 None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:17.246200 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aa25d8-c45b-4813-93d5-e56406f325b5 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:17.246477 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aa25d8-c45b-4813-93d5-e56406f325b5 None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:17.247979 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 507/996] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 00:08:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 00:08:17.253105 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3b4546-b130-4836-8cc1-fb64cbfc3d81 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:17.253384 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3b4546-b130-4836-8cc1-fb64cbfc3d81 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:17.253652 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3b4546-b130-4836-8cc1-fb64cbfc3d81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:17.258089 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 490/997] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 00:08:17 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:08:17.273175 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-0e3b4546-b130-4836-8cc1-fb64cbfc3d81 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:08:17.274380 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-0e3b4546-b130-4836-8cc1-fb64cbfc3d81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:08:17.312192 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:17.349529 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 508/998] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 00:08:17 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 00:08:17.529701 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e19b96-854a-4c1d-be9b-34d116bcad4c None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:17.602965 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:17.624443 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3b4546-b130-4836-8cc1-fb64cbfc3d81 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:17.640267 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e19b96-854a-4c1d-be9b-34d116bcad4c None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:17.680491 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e028b4-2f97-45f6-b50d-58c444975570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:17.681138 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e028b4-2f97-45f6-b50d-58c444975570 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:17.681407 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e028b4-2f97-45f6-b50d-58c444975570 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:17.681675 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e028b4-2f97-45f6-b50d-58c444975570 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:17.682593 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e028b4-2f97-45f6-b50d-58c444975570 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:17.683898 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e028b4-2f97-45f6-b50d-58c444975570 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:17.693379 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-f9e028b4-2f97-45f6-b50d-58c444975570 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 31 00:08:17.693379 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:17.693379 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 00:08:17.693379 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 00:08:17.693379 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 00:08:17.693379 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 00:08:17.693379 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 00:08:17.693379 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:08:17.693379 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 31 00:08:17.693379 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 31 00:08:17.693379 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 00:08:17.693379 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 31 00:08:17.693379 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:17.693379 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:08:17.693379 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:08:17.693379 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:08:17.693379 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:08:17.694675 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:08:17.694675 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:08:17.694675 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:08:17.694675 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:08:17.694675 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:08:17.694675 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:08:17.694675 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 00:08:17.694675 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 00:08:17.694675 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 00:08:17.694675 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 00:08:17.694675 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:08:17.694675 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:08:17.694675 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:08:17.694675 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:08:17.694675 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:08:17.694675 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:08:17.695546 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:08:17.695546 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 31 00:08:17.695546 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:08:17.695546 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:08:17.695546 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:08:17.695546 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:08:17.695546 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:08:17.695546 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:08:17.695546 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:08:17.695546 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:08:17.695546 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 00:08:17.695546 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:08:17.695546 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 31 00:08:17.695546 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 31 00:08:17.695546 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 491/999] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 31 00:08:17 2022] GET /identity/v3/services/compute => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:08:17.701571 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e028b4-2f97-45f6-b50d-58c444975570 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:17.748510 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3b4546-b130-4836-8cc1-fb64cbfc3d81 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:17.787386 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa1044b-15fc-42c8-904d-f5b5d5166e9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:17.787929 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa1044b-15fc-42c8-904d-f5b5d5166e9d None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:17.788549 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa1044b-15fc-42c8-904d-f5b5d5166e9d None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:17.788829 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa1044b-15fc-42c8-904d-f5b5d5166e9d None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:17.789563 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa1044b-15fc-42c8-904d-f5b5d5166e9d None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:17.790920 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa1044b-15fc-42c8-904d-f5b5d5166e9d None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:17.800250 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-6fa1044b-15fc-42c8-904d-f5b5d5166e9d None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 00:08:17.800250 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:17.800250 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 00:08:17.800250 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 00:08:17.800250 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 00:08:17.800250 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 00:08:17.800250 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 00:08:17.800250 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:08:17.800250 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 00:08:17.800250 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Aug 31 00:08:17.800250 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 00:08:17.800250 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Aug 31 00:08:17.800250 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:17.800250 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:08:17.800250 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:08:17.800250 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:08:17.800250 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:08:17.801425 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:08:17.801425 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:08:17.801425 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:08:17.801425 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:08:17.801425 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:08:17.801425 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:08:17.801425 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 00:08:17.801425 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 00:08:17.801425 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 00:08:17.801425 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 00:08:17.801425 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:08:17.801425 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:08:17.801425 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:08:17.801425 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:08:17.801425 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:08:17.801425 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:08:17.803030 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:08:17.803030 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Aug 31 00:08:17.803030 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:08:17.803030 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:08:17.803030 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:08:17.803030 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:08:17.803030 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:08:17.803030 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:08:17.803030 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:08:17.803030 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:08:17.803030 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 00:08:17.803030 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:08:17.803030 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 00:08:17.803030 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Aug 31 00:08:17.803030 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 509/1000] 10.222.0.47 () {56 vars in 1126 bytes} [Wed Aug 31 00:08:17 2022] GET /identity/v3/services/object-store => generated 93 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:08:17.807493 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa1044b-15fc-42c8-904d-f5b5d5166e9d None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:17.814711 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e028b4-2f97-45f6-b50d-58c444975570 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:17.846848 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:17.851509 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6470f9-dd24-43b7-90d6-ee420720d8bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:17.852112 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6470f9-dd24-43b7-90d6-ee420720d8bc None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:17.852417 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6470f9-dd24-43b7-90d6-ee420720d8bc None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:17.852689 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6470f9-dd24-43b7-90d6-ee420720d8bc None admin] PATH_INFO: `/v3/services` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:17.853320 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6470f9-dd24-43b7-90d6-ee420720d8bc None admin] RBAC: Adding query filter params (name=compute) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:17.853990 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6470f9-dd24-43b7-90d6-ee420720d8bc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:17.855091 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6470f9-dd24-43b7-90d6-ee420720d8bc None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:17.856910 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:17.866342 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 492/1001] 10.222.0.47 () {56 vars in 1112 bytes} [Wed Aug 31 00:08:17 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:08:17.867532 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6470f9-dd24-43b7-90d6-ee420720d8bc None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:17.925155 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa1044b-15fc-42c8-904d-f5b5d5166e9d None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:17.961968 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cd961d-4420-4b7b-802a-5dc4a3bb776a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:17.962710 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cd961d-4420-4b7b-802a-5dc4a3bb776a None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:17.962998 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cd961d-4420-4b7b-802a-5dc4a3bb776a None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:17.963892 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cd961d-4420-4b7b-802a-5dc4a3bb776a None admin] PATH_INFO: `/v3/services` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:17.964596 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cd961d-4420-4b7b-802a-5dc4a3bb776a None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:17.964886 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cd961d-4420-4b7b-802a-5dc4a3bb776a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:17.966285 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cd961d-4420-4b7b-802a-5dc4a3bb776a None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:17.971450 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 510/1002] 10.222.0.47 () {56 vars in 1122 bytes} [Wed Aug 31 00:08:17 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:08:17.977037 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cd961d-4420-4b7b-802a-5dc4a3bb776a None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:17.990130 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6470f9-dd24-43b7-90d6-ee420720d8bc None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:18.029626 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d812ab9b-e8bd-4ff7-99b5-682c2ceca19a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:18.030707 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d812ab9b-e8bd-4ff7-99b5-682c2ceca19a None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:18.030995 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d812ab9b-e8bd-4ff7-99b5-682c2ceca19a None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:18.031272 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d812ab9b-e8bd-4ff7-99b5-682c2ceca19a None admin] PATH_INFO: `/v3/services` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:18.032357 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d812ab9b-e8bd-4ff7-99b5-682c2ceca19a None admin] RBAC: Adding query filter params (type=compute) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:18.032857 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d812ab9b-e8bd-4ff7-99b5-682c2ceca19a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:18.034897 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d812ab9b-e8bd-4ff7-99b5-682c2ceca19a None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:18.046630 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 493/1003] 10.222.0.47 () {56 vars in 1112 bytes} [Wed Aug 31 00:08:17 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:18.047920 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d812ab9b-e8bd-4ff7-99b5-682c2ceca19a None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:18.090090 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:18.095385 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cd961d-4420-4b7b-802a-5dc4a3bb776a None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:18.121580 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:18.136956 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0d61d9-5c1e-460d-8d24-dbced9ede90a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:18.137590 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0d61d9-5c1e-460d-8d24-dbced9ede90a None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:18.137869 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0d61d9-5c1e-460d-8d24-dbced9ede90a None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:18.138143 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0d61d9-5c1e-460d-8d24-dbced9ede90a None admin] PATH_INFO: `/v3/services` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:18.138791 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0d61d9-5c1e-460d-8d24-dbced9ede90a None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:18.139093 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0d61d9-5c1e-460d-8d24-dbced9ede90a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:18.140510 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0d61d9-5c1e-460d-8d24-dbced9ede90a None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:18.146087 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 511/1004] 10.222.0.47 () {56 vars in 1122 bytes} [Wed Aug 31 00:08:17 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:08:18.151835 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0d61d9-5c1e-460d-8d24-dbced9ede90a None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:18.171151 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d812ab9b-e8bd-4ff7-99b5-682c2ceca19a None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:18.212532 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4216ae7b-88dc-49f8-bef6-30a972e70330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:18.213255 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4216ae7b-88dc-49f8-bef6-30a972e70330 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:18.213570 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4216ae7b-88dc-49f8-bef6-30a972e70330 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:18.213836 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4216ae7b-88dc-49f8-bef6-30a972e70330 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:18.214677 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4216ae7b-88dc-49f8-bef6-30a972e70330 None admin] RBAC: Adding query filter params (interface=public, service_id=dc3eb638233a41d8b5ca06a24babab91, region_id=RegionOne) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:18.215097 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4216ae7b-88dc-49f8-bef6-30a972e70330 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:18.216509 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4216ae7b-88dc-49f8-bef6-30a972e70330 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:18.222513 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 494/1005] 10.222.0.47 () {56 vars in 1251 bytes} [Wed Aug 31 00:08:18 2022] GET /identity/v3/endpoints?service_id=dc3eb638233a41d8b5ca06a24babab91&interface=public®ion_id=RegionOne => generated 194 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:18.227952 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4216ae7b-88dc-49f8-bef6-30a972e70330 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:18.258293 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0d61d9-5c1e-460d-8d24-dbced9ede90a None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:18.296286 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfb9612-fbe7-46cd-81e3-2052b76572f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:18.296966 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfb9612-fbe7-46cd-81e3-2052b76572f1 None admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:18.297194 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfb9612-fbe7-46cd-81e3-2052b76572f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:18.297470 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfb9612-fbe7-46cd-81e3-2052b76572f1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:18.298147 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfb9612-fbe7-46cd-81e3-2052b76572f1 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:18.299535 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfb9612-fbe7-46cd-81e3-2052b76572f1 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:18.321941 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 512/1006] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 31 00:08:18 2022] POST /identity/v3/endpoints => generated 325 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:08:18.357787 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4216ae7b-88dc-49f8-bef6-30a972e70330 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:18.390201 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:18.409077 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f2c8cc-cb32-4910-9c9b-9a9cc9016880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:18.409966 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f2c8cc-cb32-4910-9c9b-9a9cc9016880 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:18.410244 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f2c8cc-cb32-4910-9c9b-9a9cc9016880 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:18.410517 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f2c8cc-cb32-4910-9c9b-9a9cc9016880 None admin] PATH_INFO: `/v3/services` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:18.411128 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f2c8cc-cb32-4910-9c9b-9a9cc9016880 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:18.412565 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f2c8cc-cb32-4910-9c9b-9a9cc9016880 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:18.428181 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 495/1007] 10.222.0.47 () {56 vars in 1087 bytes} [Wed Aug 31 00:08:18 2022] GET /identity/v3/services => generated 1727 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 00:08:18.560203 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd872cc-a7ba-4352-8a06-99e89e322d62 None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:18.560557 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd872cc-a7ba-4352-8a06-99e89e322d62 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:18.560707 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd872cc-a7ba-4352-8a06-99e89e322d62 None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:18.562253 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 513/1008] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 00:08:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:08:18.567689 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab6c3d0-6590-4353-bfc5-1324654d2fb8 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:18.568029 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab6c3d0-6590-4353-bfc5-1324654d2fb8 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:18.568252 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab6c3d0-6590-4353-bfc5-1324654d2fb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:18.587517 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-2ab6c3d0-6590-4353-bfc5-1324654d2fb8 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:08:18.588836 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-2ab6c3d0-6590-4353-bfc5-1324654d2fb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:08:18.673442 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 496/1009] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 00:08:18 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:08:18.942160 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd872cc-a7ba-4352-8a06-99e89e322d62 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:18.969083 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:19.063783 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd872cc-a7ba-4352-8a06-99e89e322d62 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:19.104312 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423bc8d5-d996-4ed0-b29f-bbcc32bd9ec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:19.104916 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423bc8d5-d996-4ed0-b29f-bbcc32bd9ec0 None admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:19.105195 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423bc8d5-d996-4ed0-b29f-bbcc32bd9ec0 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:19.105466 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423bc8d5-d996-4ed0-b29f-bbcc32bd9ec0 None admin] PATH_INFO: `/v3/services` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:19.106129 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423bc8d5-d996-4ed0-b29f-bbcc32bd9ec0 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:19.107497 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423bc8d5-d996-4ed0-b29f-bbcc32bd9ec0 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:19.124768 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 514/1010] 10.222.0.47 () {60 vars in 1141 bytes} [Wed Aug 31 00:08:18 2022] POST /identity/v3/services => generated 242 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:08:20.431489 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93549fe-a4a6-459a-a73f-b8728e757ef7 None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:20.432067 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93549fe-a4a6-459a-a73f-b8728e757ef7 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:20.432067 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93549fe-a4a6-459a-a73f-b8728e757ef7 None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:20.433455 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 497/1011] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 00:08:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 00:08:20.433957 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa1e005-ba95-4a7e-9b75-03a7e2a0df5a None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:20.433957 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa1e005-ba95-4a7e-9b75-03a7e2a0df5a None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:20.434461 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa1e005-ba95-4a7e-9b75-03a7e2a0df5a None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:20.435625 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 515/1012] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 00:08:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:08:20.439833 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37ed0e4-fa11-4ead-835a-5e66c40846d9 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:20.440765 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37ed0e4-fa11-4ead-835a-5e66c40846d9 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:20.441526 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37ed0e4-fa11-4ead-835a-5e66c40846d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:20.441683 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae07214e-1eae-4060-872c-a7f85c5c6aa9 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:20.441950 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae07214e-1eae-4060-872c-a7f85c5c6aa9 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:20.442210 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae07214e-1eae-4060-872c-a7f85c5c6aa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:20.461627 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-ae07214e-1eae-4060-872c-a7f85c5c6aa9 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:08:20.462843 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-ae07214e-1eae-4060-872c-a7f85c5c6aa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:08:20.482514 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-d37ed0e4-fa11-4ead-835a-5e66c40846d9 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:08:20.485788 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-d37ed0e4-fa11-4ead-835a-5e66c40846d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:08:20.560940 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 516/1013] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 00:08:20 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 00:08:20.590693 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 498/1014] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 00:08:20 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 00:08:20.831544 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae07214e-1eae-4060-872c-a7f85c5c6aa9 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:20.842739 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:20.872613 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37ed0e4-fa11-4ead-835a-5e66c40846d9 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:20.934354 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:20.943603 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae07214e-1eae-4060-872c-a7f85c5c6aa9 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:20.981526 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c80dde2-27b2-4e8a-a261-93d352f3e111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:20.982175 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c80dde2-27b2-4e8a-a261-93d352f3e111 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:20.982460 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c80dde2-27b2-4e8a-a261-93d352f3e111 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:20.982738 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c80dde2-27b2-4e8a-a261-93d352f3e111 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:20.983880 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c80dde2-27b2-4e8a-a261-93d352f3e111 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:20.985418 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c80dde2-27b2-4e8a-a261-93d352f3e111 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:20.987309 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 517/1015] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 00:08:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:20.992650 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c80dde2-27b2-4e8a-a261-93d352f3e111 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:21.004835 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37ed0e4-fa11-4ead-835a-5e66c40846d9 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:21.045468 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cb2f30-9ee3-49f9-b8f5-42a8bef858bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:21.046128 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cb2f30-9ee3-49f9-b8f5-42a8bef858bf None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:21.046398 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cb2f30-9ee3-49f9-b8f5-42a8bef858bf None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:21.046669 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cb2f30-9ee3-49f9-b8f5-42a8bef858bf None admin] PATH_INFO: `/v3/services/compute` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:21.047374 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cb2f30-9ee3-49f9-b8f5-42a8bef858bf None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:21.048909 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cb2f30-9ee3-49f9-b8f5-42a8bef858bf None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:21.060280 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-52cb2f30-9ee3-49f9-b8f5-42a8bef858bf None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 31 00:08:21.060280 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:21.060280 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 00:08:21.060280 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 00:08:21.060280 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 00:08:21.060280 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 00:08:21.060280 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 00:08:21.060280 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:08:21.060280 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 31 00:08:21.060280 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 31 00:08:21.060280 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 00:08:21.060280 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 31 00:08:21.060280 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:21.060280 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:08:21.060280 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:08:21.060280 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:08:21.060280 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:08:21.062128 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:08:21.062128 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:08:21.062128 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:08:21.062128 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:08:21.062128 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:08:21.062128 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:08:21.062128 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 00:08:21.062128 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 00:08:21.062128 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 00:08:21.062128 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 00:08:21.062128 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:08:21.062128 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:08:21.062128 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:08:21.062128 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:08:21.062128 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:08:21.062128 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:08:21.063362 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:08:21.063362 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 31 00:08:21.063362 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:08:21.063362 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:08:21.063362 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:08:21.063362 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:08:21.063362 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:08:21.063362 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:08:21.063362 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:08:21.063362 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:08:21.063362 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 00:08:21.063362 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:08:21.063362 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 31 00:08:21.063362 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 31 00:08:21.063362 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 499/1016] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 31 00:08:20 2022] GET /identity/v3/services/compute => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:08:21.068138 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cb2f30-9ee3-49f9-b8f5-42a8bef858bf None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:21.091108 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:21.118273 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c80dde2-27b2-4e8a-a261-93d352f3e111 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:21.154500 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5c9717-9dc8-4494-bf0a-3a1c666aa5bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:21.155120 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5c9717-9dc8-4494-bf0a-3a1c666aa5bd None admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:21.155399 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5c9717-9dc8-4494-bf0a-3a1c666aa5bd None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:21.156078 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5c9717-9dc8-4494-bf0a-3a1c666aa5bd None admin] PATH_INFO: `/v3/projects` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:21.156380 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5c9717-9dc8-4494-bf0a-3a1c666aa5bd None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:21.157942 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5c9717-9dc8-4494-bf0a-3a1c666aa5bd None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:21.185060 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cb2f30-9ee3-49f9-b8f5-42a8bef858bf None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:21.190746 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 518/1017] 10.222.0.47 () {60 vars in 1141 bytes} [Wed Aug 31 00:08:20 2022] POST /identity/v3/projects => generated 311 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:08:21.191823 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5570b4f8-5ce8-4ee0-9f92-d1a65748ba8f None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:21.192092 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5570b4f8-5ce8-4ee0-9f92-d1a65748ba8f None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:21.192407 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5570b4f8-5ce8-4ee0-9f92-d1a65748ba8f None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:21.193636 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 519/1018] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 00:08:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:08:21.200526 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59edd35e-c9cd-4201-9644-5eb5315764c2 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:21.200526 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59edd35e-c9cd-4201-9644-5eb5315764c2 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:21.200865 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59edd35e-c9cd-4201-9644-5eb5315764c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:21.202748 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:21.220578 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-59edd35e-c9cd-4201-9644-5eb5315764c2 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:08:21.221817 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-59edd35e-c9cd-4201-9644-5eb5315764c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:08:21.235482 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cd2f3d-75c5-4352-84ff-4ab5a8821ecc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:21.236116 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cd2f3d-75c5-4352-84ff-4ab5a8821ecc None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:21.236424 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cd2f3d-75c5-4352-84ff-4ab5a8821ecc None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:21.236694 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cd2f3d-75c5-4352-84ff-4ab5a8821ecc None admin] PATH_INFO: `/v3/services` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:21.237341 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cd2f3d-75c5-4352-84ff-4ab5a8821ecc None admin] RBAC: Adding query filter params (name=compute) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:21.237706 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cd2f3d-75c5-4352-84ff-4ab5a8821ecc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:21.239114 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cd2f3d-75c5-4352-84ff-4ab5a8821ecc None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:21.245683 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 500/1019] 10.222.0.47 () {56 vars in 1112 bytes} [Wed Aug 31 00:08:21 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:08:21.251241 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cd2f3d-75c5-4352-84ff-4ab5a8821ecc None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:21.309480 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 520/1020] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 00:08:21 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 00:08:21.373760 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cd2f3d-75c5-4352-84ff-4ab5a8821ecc None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:21.411135 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45458181-dfbb-4312-b7b9-7f781869e45d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:21.411749 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45458181-dfbb-4312-b7b9-7f781869e45d None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:21.412024 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45458181-dfbb-4312-b7b9-7f781869e45d None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:21.412338 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45458181-dfbb-4312-b7b9-7f781869e45d None admin] PATH_INFO: `/v3/services` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:21.412973 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45458181-dfbb-4312-b7b9-7f781869e45d None admin] RBAC: Adding query filter params (type=compute) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:21.413270 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45458181-dfbb-4312-b7b9-7f781869e45d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:21.414638 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45458181-dfbb-4312-b7b9-7f781869e45d None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:21.420121 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 501/1021] 10.222.0.47 () {56 vars in 1112 bytes} [Wed Aug 31 00:08:21 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:08:21.425866 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59edd35e-c9cd-4201-9644-5eb5315764c2 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:21.493112 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:21.540231 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59edd35e-c9cd-4201-9644-5eb5315764c2 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:21.576918 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0fbd8f-afd6-425b-95e0-2acd08f08208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:21.577538 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0fbd8f-afd6-425b-95e0-2acd08f08208 None admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:21.577812 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0fbd8f-afd6-425b-95e0-2acd08f08208 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:21.578078 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0fbd8f-afd6-425b-95e0-2acd08f08208 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:21.578781 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0fbd8f-afd6-425b-95e0-2acd08f08208 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:21.580140 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0fbd8f-afd6-425b-95e0-2acd08f08208 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:21.591855 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45458181-dfbb-4312-b7b9-7f781869e45d None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:21.602718 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 521/1022] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 31 00:08:21 2022] POST /identity/v3/endpoints => generated 334 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:08:21.643587 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:21.721953 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45458181-dfbb-4312-b7b9-7f781869e45d None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:21.767832 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2022fbc-69d4-47fd-b4ab-299755d32901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:21.768505 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2022fbc-69d4-47fd-b4ab-299755d32901 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:21.768785 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2022fbc-69d4-47fd-b4ab-299755d32901 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:21.769056 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2022fbc-69d4-47fd-b4ab-299755d32901 None admin] PATH_INFO: `/v3/services/image` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:21.769633 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2022fbc-69d4-47fd-b4ab-299755d32901 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:21.771022 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2022fbc-69d4-47fd-b4ab-299755d32901 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:21.780714 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-d2022fbc-69d4-47fd-b4ab-299755d32901 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 31 00:08:21.780714 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:21.780714 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 00:08:21.780714 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 00:08:21.780714 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 00:08:21.780714 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 00:08:21.780714 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 00:08:21.780714 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:08:21.780714 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 31 00:08:21.780714 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 31 00:08:21.780714 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 00:08:21.780714 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 31 00:08:21.780714 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:21.780714 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:08:21.780714 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:08:21.780714 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:08:21.780714 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:08:21.781983 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:08:21.781983 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:08:21.781983 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:08:21.781983 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:08:21.781983 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:08:21.781983 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:08:21.781983 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 00:08:21.781983 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 00:08:21.781983 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 00:08:21.781983 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 00:08:21.781983 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:08:21.781983 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:08:21.781983 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:08:21.781983 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:08:21.781983 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:08:21.781983 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:08:21.783036 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:08:21.783036 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 31 00:08:21.783036 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:08:21.783036 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:08:21.783036 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:08:21.783036 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:08:21.783036 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:08:21.783036 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:08:21.783036 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:08:21.783036 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:08:21.783036 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 00:08:21.783036 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:08:21.783036 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 31 00:08:21.783036 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 31 00:08:21.783036 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 502/1023] 10.222.0.47 () {56 vars in 1105 bytes} [Wed Aug 31 00:08:21 2022] GET /identity/v3/services/image => generated 86 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:08:21.789796 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0fbd8f-afd6-425b-95e0-2acd08f08208 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:21.910227 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0fbd8f-afd6-425b-95e0-2acd08f08208 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:21.927910 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:21.951908 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8723d942-ae1f-4234-b35f-f7f1eae964af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:21.952492 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8723d942-ae1f-4234-b35f-f7f1eae964af None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:21.952774 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8723d942-ae1f-4234-b35f-f7f1eae964af None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:21.953049 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8723d942-ae1f-4234-b35f-f7f1eae964af None admin] PATH_INFO: `/v3/services` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:21.953682 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8723d942-ae1f-4234-b35f-f7f1eae964af None admin] RBAC: Adding query filter params (name=image) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:21.953990 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8723d942-ae1f-4234-b35f-f7f1eae964af None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:21.955357 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8723d942-ae1f-4234-b35f-f7f1eae964af None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:21.960723 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 522/1024] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 00:08:21 2022] GET /identity/v3/services?name=image => generated 122 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:21.967381 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2022fbc-69d4-47fd-b4ab-299755d32901 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:22.084731 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:22.090550 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2022fbc-69d4-47fd-b4ab-299755d32901 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:22.129230 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807365b8-13fb-4ad5-9d75-8275dcf88882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:22.129848 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807365b8-13fb-4ad5-9d75-8275dcf88882 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:22.130132 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807365b8-13fb-4ad5-9d75-8275dcf88882 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:22.130398 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807365b8-13fb-4ad5-9d75-8275dcf88882 None admin] PATH_INFO: `/v3/services` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:22.131035 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807365b8-13fb-4ad5-9d75-8275dcf88882 None admin] RBAC: Adding query filter params (type=image) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:22.131336 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807365b8-13fb-4ad5-9d75-8275dcf88882 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:22.132764 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807365b8-13fb-4ad5-9d75-8275dcf88882 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:22.140265 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 503/1025] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 00:08:21 2022] GET /identity/v3/services?type=image => generated 350 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:22.145960 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8723d942-ae1f-4234-b35f-f7f1eae964af None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:22.273437 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8723d942-ae1f-4234-b35f-f7f1eae964af None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:22.311550 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6196d091-11a0-4dd1-b32b-c6579975e7e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:22.312180 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6196d091-11a0-4dd1-b32b-c6579975e7e2 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:22.312483 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6196d091-11a0-4dd1-b32b-c6579975e7e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:22.312761 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6196d091-11a0-4dd1-b32b-c6579975e7e2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:22.313472 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6196d091-11a0-4dd1-b32b-c6579975e7e2 None admin] RBAC: Adding query filter params (interface=public, service_id=ce4871b555604a448c593f91c82228b9, region_id=RegionOne) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:22.313847 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6196d091-11a0-4dd1-b32b-c6579975e7e2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:22.315228 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6196d091-11a0-4dd1-b32b-c6579975e7e2 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:22.325247 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 523/1026] 10.222.0.47 () {56 vars in 1251 bytes} [Wed Aug 31 00:08:22 2022] GET /identity/v3/endpoints?service_id=ce4871b555604a448c593f91c82228b9&interface=public®ion_id=RegionOne => generated 194 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:22.327067 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807365b8-13fb-4ad5-9d75-8275dcf88882 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:22.459640 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807365b8-13fb-4ad5-9d75-8275dcf88882 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:22.496983 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c95e207-d823-498a-b0cc-95deca0ea0b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:22.497603 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c95e207-d823-498a-b0cc-95deca0ea0b2 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:22.497886 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c95e207-d823-498a-b0cc-95deca0ea0b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:22.498156 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c95e207-d823-498a-b0cc-95deca0ea0b2 None admin] PATH_INFO: `/v3/services` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:22.498761 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c95e207-d823-498a-b0cc-95deca0ea0b2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:22.500207 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c95e207-d823-498a-b0cc-95deca0ea0b2 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:22.512400 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 504/1027] 10.222.0.47 () {56 vars in 1087 bytes} [Wed Aug 31 00:08:22 2022] GET /identity/v3/services => generated 1957 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 00:08:23.201522 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e18571-8a1c-4f9b-967c-f4f780d5291a None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:23.202058 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e18571-8a1c-4f9b-967c-f4f780d5291a None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:23.202058 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e18571-8a1c-4f9b-967c-f4f780d5291a None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:23.203545 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 524/1028] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 00:08:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:08:23.208772 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4fc481-0d62-4a7c-9b9e-b7f9f1efa366 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:23.209219 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4fc481-0d62-4a7c-9b9e-b7f9f1efa366 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:23.209298 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4fc481-0d62-4a7c-9b9e-b7f9f1efa366 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:23.227673 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-ff4fc481-0d62-4a7c-9b9e-b7f9f1efa366 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:08:23.229507 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-ff4fc481-0d62-4a7c-9b9e-b7f9f1efa366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:08:23.253256 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:23.314161 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 505/1029] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 00:08:23 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:08:23.594749 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e18571-8a1c-4f9b-967c-f4f780d5291a None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:23.644561 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:23.681404 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9da19e2-520b-4ea9-9276-0a0acb5b8bea None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:23.681685 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9da19e2-520b-4ea9-9276-0a0acb5b8bea None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:23.682021 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9da19e2-520b-4ea9-9276-0a0acb5b8bea None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:23.683732 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 506/1030] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 00:08:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 00:08:23.688555 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee1e6bd-659f-4f76-bd9a-59987d7ec766 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:23.689103 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee1e6bd-659f-4f76-bd9a-59987d7ec766 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:23.689575 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee1e6bd-659f-4f76-bd9a-59987d7ec766 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:23.709600 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-bee1e6bd-659f-4f76-bd9a-59987d7ec766 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:08:23.710818 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-bee1e6bd-659f-4f76-bd9a-59987d7ec766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:08:23.714272 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e18571-8a1c-4f9b-967c-f4f780d5291a None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:23.752073 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d296911-e0b3-47b7-a0f4-3fc286bbeb33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:23.752738 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d296911-e0b3-47b7-a0f4-3fc286bbeb33 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:23.753015 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d296911-e0b3-47b7-a0f4-3fc286bbeb33 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:23.753282 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d296911-e0b3-47b7-a0f4-3fc286bbeb33 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:23.754404 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d296911-e0b3-47b7-a0f4-3fc286bbeb33 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:23.755834 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d296911-e0b3-47b7-a0f4-3fc286bbeb33 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:23.757614 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 525/1031] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 00:08:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:23.763829 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d296911-e0b3-47b7-a0f4-3fc286bbeb33 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:23.793979 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 507/1032] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 00:08:23 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 00:08:23.890286 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d296911-e0b3-47b7-a0f4-3fc286bbeb33 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:23.903445 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:23.939926 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bad6dfd-640e-45c5-96ae-d4671aaab1b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:23.940983 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bad6dfd-640e-45c5-96ae-d4671aaab1b1 None admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:23.941457 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bad6dfd-640e-45c5-96ae-d4671aaab1b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:23.942004 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bad6dfd-640e-45c5-96ae-d4671aaab1b1 None admin] PATH_INFO: `/v3/users` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:23.943195 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bad6dfd-640e-45c5-96ae-d4671aaab1b1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:23.945817 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bad6dfd-640e-45c5-96ae-d4671aaab1b1 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:23.978826 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 526/1033] 10.222.0.47 () {60 vars in 1132 bytes} [Wed Aug 31 00:08:23 2022] POST /identity/v3/users => generated 285 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:08:24.072369 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee1e6bd-659f-4f76-bd9a-59987d7ec766 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:24.169944 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:24.189538 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee1e6bd-659f-4f76-bd9a-59987d7ec766 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:24.237198 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acaea86-e8be-4750-b80c-f457ed694fc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:24.238205 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acaea86-e8be-4750-b80c-f457ed694fc3 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:24.238634 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acaea86-e8be-4750-b80c-f457ed694fc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:24.239044 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acaea86-e8be-4750-b80c-f457ed694fc3 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:24.253468 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acaea86-e8be-4750-b80c-f457ed694fc3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:08:24.258428 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-4acaea86-e8be-4750-b80c-f457ed694fc3 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 00:08:24.258428 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:24.258428 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:08:24.258428 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:08:24.258428 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:08:24.258428 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:08:24.258428 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:08:24.258428 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:08:24.258428 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:08:24.258428 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:08:24.258428 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:08:24.258428 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:08:24.258428 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:08:24.258428 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:08:24.258428 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:08:24.258428 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:08:24.259581 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:08:24.259581 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:08:24.259581 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:08:24.259581 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:08:24.259581 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:08:24.259581 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:08:24.259581 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:08:24.259581 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:08:24.259581 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:08:24.259581 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:08:24.259581 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:08:24.259581 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 31 00:08:24.259581 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:08:24.259581 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:08:24.259581 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:08:24.259581 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:08:24.261197 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:08:24.261197 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:08:24.261197 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:08:24.261197 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:08:24.261197 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:08:24.261197 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:08:24.261197 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:08:24.261197 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:08:24.261197 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:08:24.261197 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:08:24.261197 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 00:08:24.261197 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 31 00:08:24.261197 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 508/1034] 10.222.0.47 () {56 vars in 1120 bytes} [Wed Aug 31 00:08:24 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:08:24.266422 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bad6dfd-640e-45c5-96ae-d4671aaab1b1 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:24.378002 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bad6dfd-640e-45c5-96ae-d4671aaab1b1 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:24.412865 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9e0419-5fac-4bc1-b580-aa8893c18efc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:24.413462 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9e0419-5fac-4bc1-b580-aa8893c18efc None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:24.413739 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9e0419-5fac-4bc1-b580-aa8893c18efc None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:24.414172 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9e0419-5fac-4bc1-b580-aa8893c18efc None admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:24.414710 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9e0419-5fac-4bc1-b580-aa8893c18efc None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:24.415009 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9e0419-5fac-4bc1-b580-aa8893c18efc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:24.416434 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9e0419-5fac-4bc1-b580-aa8893c18efc None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:24.430253 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 527/1035] 10.222.0.47 () {56 vars in 1115 bytes} [Wed Aug 31 00:08:24 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:24.431582 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acaea86-e8be-4750-b80c-f457ed694fc3 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:24.480757 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7b306b-5f43-49f0-95bd-615af92426b0 None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:24.481031 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7b306b-5f43-49f0-95bd-615af92426b0 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:24.481311 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7b306b-5f43-49f0-95bd-615af92426b0 None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:24.482688 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 528/1036] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 00:08:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:08:24.488360 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a0071b-e81e-4d5c-b5f8-6537c8d8285c None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:24.488646 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a0071b-e81e-4d5c-b5f8-6537c8d8285c None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:24.488929 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a0071b-e81e-4d5c-b5f8-6537c8d8285c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:24.508791 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-f2a0071b-e81e-4d5c-b5f8-6537c8d8285c None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:08:24.510187 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-f2a0071b-e81e-4d5c-b5f8-6537c8d8285c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:08:24.544061 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:24.546879 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acaea86-e8be-4750-b80c-f457ed694fc3 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:24.585198 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c485a2c-1296-4f2d-8e6a-c2a6b3f4d5fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:24.586001 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c485a2c-1296-4f2d-8e6a-c2a6b3f4d5fd None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:24.586277 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c485a2c-1296-4f2d-8e6a-c2a6b3f4d5fd None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:24.586882 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c485a2c-1296-4f2d-8e6a-c2a6b3f4d5fd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:24.594490 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 529/1037] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 00:08:24 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:08:24.598572 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c485a2c-1296-4f2d-8e6a-c2a6b3f4d5fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:24.601313 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c485a2c-1296-4f2d-8e6a-c2a6b3f4d5fd None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:24.609648 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:24.620295 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-7c485a2c-1296-4f2d-8e6a-c2a6b3f4d5fd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:08:24.620295 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:24.620295 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:08:24.620295 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:08:24.620295 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:08:24.620295 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:08:24.620295 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:08:24.620295 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:08:24.620295 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:08:24.620295 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:08:24.620295 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:08:24.620295 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:08:24.620295 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:08:24.620295 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:08:24.620295 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:08:24.620295 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:08:24.621434 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:08:24.621434 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:08:24.621434 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:08:24.621434 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:08:24.621434 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:08:24.621434 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:08:24.621434 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:08:24.621434 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 31 00:08:24.621434 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:08:24.621434 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:08:24.621434 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:08:24.621434 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:08:24.621434 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:08:24.621434 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:08:24.621434 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:08:24.621434 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:08:24.621434 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:08:24.622986 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:08:24.622986 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:08:24.622986 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 31 00:08:24.622986 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 509/1038] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 00:08:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:08:24.627276 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a0071b-e81e-4d5c-b5f8-6537c8d8285c None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:24.734348 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a0071b-e81e-4d5c-b5f8-6537c8d8285c None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:24.769234 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dde5261-1f65-44ef-a60c-d972dd422528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:24.769849 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dde5261-1f65-44ef-a60c-d972dd422528 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:24.770121 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dde5261-1f65-44ef-a60c-d972dd422528 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:24.770388 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dde5261-1f65-44ef-a60c-d972dd422528 None admin] PATH_INFO: `/v3/domains` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:24.771030 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dde5261-1f65-44ef-a60c-d972dd422528 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:24.771329 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dde5261-1f65-44ef-a60c-d972dd422528 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:24.772725 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dde5261-1f65-44ef-a60c-d972dd422528 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:24.786373 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 530/1039] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 31 00:08:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:24.792361 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c485a2c-1296-4f2d-8e6a-c2a6b3f4d5fd None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:24.870378 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dde5261-1f65-44ef-a60c-d972dd422528 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:24.890558 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:24.903882 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c485a2c-1296-4f2d-8e6a-c2a6b3f4d5fd None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:24.942439 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf64674-12eb-4f71-9519-1b8dfa46e87d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:24.943083 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf64674-12eb-4f71-9519-1b8dfa46e87d None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:24.943366 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf64674-12eb-4f71-9519-1b8dfa46e87d None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:24.943641 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf64674-12eb-4f71-9519-1b8dfa46e87d None admin] PATH_INFO: `/v3/users/nova` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:24.952772 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf64674-12eb-4f71-9519-1b8dfa46e87d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:24.954246 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf64674-12eb-4f71-9519-1b8dfa46e87d None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:24.967208 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-faf64674-12eb-4f71-9519-1b8dfa46e87d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 31 00:08:24.967208 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:24.967208 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:08:24.967208 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:08:24.967208 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:08:24.967208 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:08:24.967208 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:08:24.967208 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:08:24.967208 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:08:24.967208 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:08:24.967208 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:08:24.967208 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:08:24.967208 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 00:08:24.967208 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 00:08:24.967208 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 00:08:24.967208 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 00:08:24.968362 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:08:24.968362 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:08:24.968362 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:08:24.968362 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:08:24.968362 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:08:24.968362 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:08:24.968362 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:08:24.968362 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:08:24.968362 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:08:24.968362 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:08:24.968362 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:08:24.968362 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 31 00:08:24.968362 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:08:24.968362 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:08:24.968362 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:08:24.968362 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:08:24.968362 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:08:24.968362 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:08:24.970005 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:08:24.970005 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:08:24.970005 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 00:08:24.970005 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 00:08:24.970005 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 00:08:24.970005 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 00:08:24.970005 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 00:08:24.970005 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 00:08:24.970005 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 31 00:08:24.970005 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 31 00:08:24.970005 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 510/1040] 10.222.0.47 () {56 vars in 1093 bytes} [Wed Aug 31 00:08:24 2022] GET /identity/v3/users/nova => generated 82 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:08:24.974752 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf64674-12eb-4f71-9519-1b8dfa46e87d None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:24.993443 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dde5261-1f65-44ef-a60c-d972dd422528 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:25.031629 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f27fdc7-c31f-4afd-86ba-86a4052aee55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:25.032602 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f27fdc7-c31f-4afd-86ba-86a4052aee55 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:25.033046 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f27fdc7-c31f-4afd-86ba-86a4052aee55 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:25.033498 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f27fdc7-c31f-4afd-86ba-86a4052aee55 None admin] PATH_INFO: `/v3/services/image` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:25.034107 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f27fdc7-c31f-4afd-86ba-86a4052aee55 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:25.035929 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f27fdc7-c31f-4afd-86ba-86a4052aee55 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:25.046014 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-9f27fdc7-c31f-4afd-86ba-86a4052aee55 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 31 00:08:25.046014 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:25.046014 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 00:08:25.046014 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 00:08:25.046014 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 00:08:25.046014 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 00:08:25.046014 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 00:08:25.046014 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:08:25.046014 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 31 00:08:25.046014 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Aug 31 00:08:25.046014 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 00:08:25.046014 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Aug 31 00:08:25.046014 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:25.046014 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:08:25.046014 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:08:25.046014 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:08:25.046014 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:08:25.047108 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:08:25.047108 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:08:25.047108 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:08:25.047108 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:08:25.047108 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:08:25.047108 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:08:25.047108 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 00:08:25.047108 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 00:08:25.047108 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 00:08:25.047108 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 00:08:25.047108 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:08:25.047108 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:08:25.047108 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:08:25.047108 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:08:25.047108 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:08:25.047108 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:08:25.048582 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:08:25.048582 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Aug 31 00:08:25.048582 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:08:25.048582 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:08:25.048582 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:08:25.048582 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:08:25.048582 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:08:25.048582 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:08:25.048582 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:08:25.048582 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:08:25.048582 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 00:08:25.048582 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:08:25.048582 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 31 00:08:25.048582 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Aug 31 00:08:25.048582 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 531/1041] 10.222.0.47 () {56 vars in 1105 bytes} [Wed Aug 31 00:08:24 2022] GET /identity/v3/services/image => generated 86 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:08:25.051422 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:25.054549 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f27fdc7-c31f-4afd-86ba-86a4052aee55 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:25.109463 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf64674-12eb-4f71-9519-1b8dfa46e87d None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:25.144626 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:25.148288 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06515370-c025-4e09-885b-fcc9ecb287a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:25.148907 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06515370-c025-4e09-885b-fcc9ecb287a9 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:25.149175 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06515370-c025-4e09-885b-fcc9ecb287a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:25.149443 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06515370-c025-4e09-885b-fcc9ecb287a9 None admin] PATH_INFO: `/v3/users` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:25.150170 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06515370-c025-4e09-885b-fcc9ecb287a9 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:25.150471 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06515370-c025-4e09-885b-fcc9ecb287a9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:25.152730 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06515370-c025-4e09-885b-fcc9ecb287a9 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:25.167440 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f27fdc7-c31f-4afd-86ba-86a4052aee55 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:25.174430 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 511/1042] 10.222.0.47 () {56 vars in 1133 bytes} [Wed Aug 31 00:08:24 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:08:25.179762 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06515370-c025-4e09-885b-fcc9ecb287a9 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:25.206218 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad05c0c5-bd9f-4959-9414-d6cecf995452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:25.206833 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad05c0c5-bd9f-4959-9414-d6cecf995452 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:25.207107 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad05c0c5-bd9f-4959-9414-d6cecf995452 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:25.207373 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad05c0c5-bd9f-4959-9414-d6cecf995452 None admin] PATH_INFO: `/v3/services` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:25.208002 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad05c0c5-bd9f-4959-9414-d6cecf995452 None admin] RBAC: Adding query filter params (name=image) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:25.208335 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad05c0c5-bd9f-4959-9414-d6cecf995452 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:25.209704 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad05c0c5-bd9f-4959-9414-d6cecf995452 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:25.215867 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 532/1043] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 00:08:25 2022] GET /identity/v3/services?name=image => generated 122 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:25.221407 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad05c0c5-bd9f-4959-9414-d6cecf995452 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:25.298987 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06515370-c025-4e09-885b-fcc9ecb287a9 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:25.317798 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:25.339897 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445ff78b-93cb-4c55-8f7f-23d2dcded5d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:25.340552 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445ff78b-93cb-4c55-8f7f-23d2dcded5d5 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:25.340830 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445ff78b-93cb-4c55-8f7f-23d2dcded5d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:25.341096 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445ff78b-93cb-4c55-8f7f-23d2dcded5d5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:25.347084 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad05c0c5-bd9f-4959-9414-d6cecf995452 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:25.382707 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d086e12e-b112-464c-ac84-659c156bb9f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:25.383322 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d086e12e-b112-464c-ac84-659c156bb9f3 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:25.383610 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d086e12e-b112-464c-ac84-659c156bb9f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:25.383888 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d086e12e-b112-464c-ac84-659c156bb9f3 None admin] PATH_INFO: `/v3/services` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:25.384553 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d086e12e-b112-464c-ac84-659c156bb9f3 None admin] RBAC: Adding query filter params (type=image) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:25.384859 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d086e12e-b112-464c-ac84-659c156bb9f3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:25.386977 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d086e12e-b112-464c-ac84-659c156bb9f3 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:25.391870 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 533/1044] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 00:08:25 2022] GET /identity/v3/services?type=image => generated 350 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:08:25.397923 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d086e12e-b112-464c-ac84-659c156bb9f3 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:25.411933 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:25.422552 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445ff78b-93cb-4c55-8f7f-23d2dcded5d5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:25.424258 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445ff78b-93cb-4c55-8f7f-23d2dcded5d5 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:25.520088 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d086e12e-b112-464c-ac84-659c156bb9f3 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:25.548910 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 512/1045] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 31 00:08:25 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 31 00:08:25.555888 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445ff78b-93cb-4c55-8f7f-23d2dcded5d5 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:25.566103 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a2604a-14c5-43fc-b36b-7c06e4eb4bb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:25.566736 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a2604a-14c5-43fc-b36b-7c06e4eb4bb3 None admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:25.567015 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a2604a-14c5-43fc-b36b-7c06e4eb4bb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:25.567288 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a2604a-14c5-43fc-b36b-7c06e4eb4bb3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:25.568371 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a2604a-14c5-43fc-b36b-7c06e4eb4bb3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:25.569453 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a2604a-14c5-43fc-b36b-7c06e4eb4bb3 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:25.578375 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:25.593884 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 534/1046] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 31 00:08:25 2022] POST /identity/v3/endpoints => generated 327 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:08:25.700314 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445ff78b-93cb-4c55-8f7f-23d2dcded5d5 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:25.751652 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca3fc1a-4a59-42c5-afb5-a402894e2e37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:25.752322 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca3fc1a-4a59-42c5-afb5-a402894e2e37 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:25.752600 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca3fc1a-4a59-42c5-afb5-a402894e2e37 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:25.752868 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca3fc1a-4a59-42c5-afb5-a402894e2e37 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:25.765388 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca3fc1a-4a59-42c5-afb5-a402894e2e37 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:25.766869 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca3fc1a-4a59-42c5-afb5-a402894e2e37 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:25.784124 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-eca3fc1a-4a59-42c5-afb5-a402894e2e37 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:08:25.784124 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:25.784124 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:08:25.784124 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:08:25.784124 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:08:25.784124 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:08:25.784124 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:08:25.784124 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:08:25.784124 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:08:25.784124 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:08:25.784124 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:08:25.784124 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:08:25.784124 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:08:25.784124 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:08:25.784124 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:08:25.784124 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:08:25.785502 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:08:25.785502 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:08:25.785502 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:08:25.785502 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:08:25.785502 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:08:25.785502 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:08:25.785502 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:08:25.785502 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 31 00:08:25.785502 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:08:25.785502 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:08:25.785502 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:08:25.785502 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:08:25.785502 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:08:25.785502 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:08:25.785502 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:08:25.785502 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:08:25.785502 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:08:25.786654 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:08:25.786654 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:08:25.786654 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 31 00:08:25.786654 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 513/1047] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 00:08:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:08:25.792146 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a2604a-14c5-43fc-b36b-7c06e4eb4bb3 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:25.864310 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:25.904420 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a2604a-14c5-43fc-b36b-7c06e4eb4bb3 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:25.940026 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d4ac9b-928a-4cfe-bf06-1ed0a79f7099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:25.940672 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d4ac9b-928a-4cfe-bf06-1ed0a79f7099 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:25.940954 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d4ac9b-928a-4cfe-bf06-1ed0a79f7099 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:25.941228 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d4ac9b-928a-4cfe-bf06-1ed0a79f7099 None admin] PATH_INFO: `/v3/domains` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:25.941874 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d4ac9b-928a-4cfe-bf06-1ed0a79f7099 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:25.942177 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d4ac9b-928a-4cfe-bf06-1ed0a79f7099 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:25.943552 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d4ac9b-928a-4cfe-bf06-1ed0a79f7099 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:25.958057 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 535/1048] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 31 00:08:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:25.965452 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca3fc1a-4a59-42c5-afb5-a402894e2e37 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:26.046291 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:26.088085 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca3fc1a-4a59-42c5-afb5-a402894e2e37 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:26.108818 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f27bfad-aeb6-4c28-93db-df39db38b5bc None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:26.109152 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f27bfad-aeb6-4c28-93db-df39db38b5bc None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:26.109368 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f27bfad-aeb6-4c28-93db-df39db38b5bc None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:26.110842 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 536/1049] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 00:08:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:08:26.116077 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cb5106-0045-4ad6-9528-4524037f67f8 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:26.116358 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cb5106-0045-4ad6-9528-4524037f67f8 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:26.116634 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cb5106-0045-4ad6-9528-4524037f67f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:26.128040 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3428be4e-d43d-42de-a414-86b84279d430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:26.128708 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3428be4e-d43d-42de-a414-86b84279d430 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:26.128987 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3428be4e-d43d-42de-a414-86b84279d430 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:26.129257 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3428be4e-d43d-42de-a414-86b84279d430 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:26.136540 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-c7cb5106-0045-4ad6-9528-4524037f67f8 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:08:26.137841 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-c7cb5106-0045-4ad6-9528-4524037f67f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:08:26.138220 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3428be4e-d43d-42de-a414-86b84279d430 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:26.142438 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3428be4e-d43d-42de-a414-86b84279d430 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:26.161913 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-3428be4e-d43d-42de-a414-86b84279d430 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:08:26.161913 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:26.161913 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:08:26.161913 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:08:26.161913 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:08:26.161913 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:08:26.161913 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:08:26.161913 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:08:26.161913 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:08:26.161913 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:08:26.161913 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:08:26.161913 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:08:26.161913 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 00:08:26.161913 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 00:08:26.161913 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 00:08:26.163323 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 00:08:26.163323 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:08:26.163323 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:08:26.163323 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:08:26.163323 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:08:26.163323 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:08:26.163323 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:08:26.163323 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:08:26.163323 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 31 00:08:26.163323 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:08:26.163323 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:08:26.163323 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:08:26.163323 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:08:26.163323 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:08:26.163323 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:08:26.163323 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:08:26.163323 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:08:26.164837 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 00:08:26.164837 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 00:08:26.164837 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:08:26.164837 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:08:26.164837 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:08:26.164837 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:08:26.164837 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:08:26.164837 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 31 00:08:26.165294 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 514/1050] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 31 00:08:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:08:26.171277 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3428be4e-d43d-42de-a414-86b84279d430 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:26.222346 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 537/1051] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 00:08:26 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 00:08:26.287837 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3428be4e-d43d-42de-a414-86b84279d430 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:26.313236 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:26.325914 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97100bc-7847-4eb1-a209-3ddcfe38e594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:26.326524 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97100bc-7847-4eb1-a209-3ddcfe38e594 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:26.326795 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97100bc-7847-4eb1-a209-3ddcfe38e594 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:26.327062 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97100bc-7847-4eb1-a209-3ddcfe38e594 None admin] PATH_INFO: `/v3/projects` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:26.327746 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97100bc-7847-4eb1-a209-3ddcfe38e594 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:26.328040 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97100bc-7847-4eb1-a209-3ddcfe38e594 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:26.329507 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97100bc-7847-4eb1-a209-3ddcfe38e594 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:26.342680 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 515/1052] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Aug 31 00:08:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:08:26.348642 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cb5106-0045-4ad6-9528-4524037f67f8 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:26.405923 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:26.452904 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cb5106-0045-4ad6-9528-4524037f67f8 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:26.488511 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54db0e88-2441-4b02-b865-df994aac19ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:26.489124 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54db0e88-2441-4b02-b865-df994aac19ff None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:26.489402 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54db0e88-2441-4b02-b865-df994aac19ff None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:26.489673 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54db0e88-2441-4b02-b865-df994aac19ff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:26.490405 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54db0e88-2441-4b02-b865-df994aac19ff None admin] RBAC: Adding query filter params (role.id=37e9c028ff614960bea9cb8941645e61, scope.project.id=1b647cccb30a427193fc62dbebe0c6f1, user.id=9ea002bf49c248dbae7147665fa10fd1) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:26.490715 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54db0e88-2441-4b02-b865-df994aac19ff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:26.492182 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54db0e88-2441-4b02-b865-df994aac19ff None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:26.497806 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97100bc-7847-4eb1-a209-3ddcfe38e594 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:26.508450 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 538/1053] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 31 00:08:26 2022] GET /identity/v3/role_assignments?user.id=9ea002bf49c248dbae7147665fa10fd1&scope.project.id=1b647cccb30a427193fc62dbebe0c6f1&role.id=37e9c028ff614960bea9cb8941645e61 => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:26.625986 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97100bc-7847-4eb1-a209-3ddcfe38e594 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:26.670955 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd983ee7-f7b2-4b5f-ac5e-f52981b21e6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:26.671510 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd983ee7-f7b2-4b5f-ac5e-f52981b21e6d None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:26.671790 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd983ee7-f7b2-4b5f-ac5e-f52981b21e6d None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:26.672053 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd983ee7-f7b2-4b5f-ac5e-f52981b21e6d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:26.685373 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd983ee7-f7b2-4b5f-ac5e-f52981b21e6d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:08:26.690408 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-cd983ee7-f7b2-4b5f-ac5e-f52981b21e6d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:08:26.690408 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:26.690408 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:08:26.690408 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:08:26.690408 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:08:26.690408 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:08:26.690408 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:08:26.690408 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:08:26.690408 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:08:26.690408 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:08:26.690408 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:08:26.690408 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:08:26.690408 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:08:26.690408 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:08:26.690408 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:08:26.690408 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:08:26.691385 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:08:26.691385 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:08:26.691385 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:08:26.691385 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:08:26.691385 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:08:26.691385 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:08:26.691385 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:08:26.691385 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:08:26.691385 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:08:26.691385 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:08:26.691385 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:08:26.691385 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 31 00:08:26.691385 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:08:26.691385 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:08:26.691385 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:08:26.691385 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:08:26.692545 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:08:26.692545 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:08:26.692545 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:08:26.692545 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:08:26.692545 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:08:26.692545 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:08:26.692545 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:08:26.692545 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:08:26.692545 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:08:26.692545 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:08:26.692545 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:08:26.692545 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 31 00:08:26.692545 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 516/1054] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Aug 31 00:08:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:08:26.698866 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54db0e88-2441-4b02-b865-df994aac19ff None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:26.812515 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54db0e88-2441-4b02-b865-df994aac19ff None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:26.834146 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:26.850592 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35354be-4bcb-4247-8d70-0225819f3983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:26.851567 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35354be-4bcb-4247-8d70-0225819f3983 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:26.852033 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35354be-4bcb-4247-8d70-0225819f3983 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:26.852511 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35354be-4bcb-4247-8d70-0225819f3983 None admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:26.853460 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35354be-4bcb-4247-8d70-0225819f3983 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:26.853981 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35354be-4bcb-4247-8d70-0225819f3983 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:26.855558 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35354be-4bcb-4247-8d70-0225819f3983 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:26.864948 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 539/1055] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 31 00:08:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:26.871035 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd983ee7-f7b2-4b5f-ac5e-f52981b21e6d None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:26.924706 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:26.994732 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd983ee7-f7b2-4b5f-ac5e-f52981b21e6d None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:27.037337 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46d30f0-9abb-4582-9455-418f27f39043 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:27.037977 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46d30f0-9abb-4582-9455-418f27f39043 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:27.038257 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46d30f0-9abb-4582-9455-418f27f39043 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:27.038532 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46d30f0-9abb-4582-9455-418f27f39043 None admin] PATH_INFO: `/v3/users/355c06037e2d4c4da05f8b964a467d3a` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:27.053607 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46d30f0-9abb-4582-9455-418f27f39043 None admin] RBAC: Authorizing `identity:get_user(user_id=355c06037e2d4c4da05f8b964a467d3a)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:27.055067 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46d30f0-9abb-4582-9455-418f27f39043 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:27.063334 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 517/1056] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 31 00:08:26 2022] GET /identity/v3/users/355c06037e2d4c4da05f8b964a467d3a => generated 285 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:27.063503 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35354be-4bcb-4247-8d70-0225819f3983 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:27.180523 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35354be-4bcb-4247-8d70-0225819f3983 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:27.226562 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daca903-07f2-4b1b-b4e3-a1c83dfb0bac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:27.227203 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daca903-07f2-4b1b-b4e3-a1c83dfb0bac None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:27.227483 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daca903-07f2-4b1b-b4e3-a1c83dfb0bac None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:27.227758 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daca903-07f2-4b1b-b4e3-a1c83dfb0bac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:27.283967 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:27.304921 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2daca903-07f2-4b1b-b4e3-a1c83dfb0bac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:27.306380 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2daca903-07f2-4b1b-b4e3-a1c83dfb0bac None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:27.414724 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 540/1057] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 31 00:08:27 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 00:08:27.415979 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46d30f0-9abb-4582-9455-418f27f39043 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:27.531331 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46d30f0-9abb-4582-9455-418f27f39043 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:27.532873 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:27.569395 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff7e95c-dfb5-440e-87cb-bb22158487fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:27.570033 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff7e95c-dfb5-440e-87cb-bb22158487fa None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:27.571106 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff7e95c-dfb5-440e-87cb-bb22158487fa None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:27.571106 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff7e95c-dfb5-440e-87cb-bb22158487fa None admin] PATH_INFO: `/v3/projects/fc658444791b4f9a8a5a90bdfba5518f` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:27.571711 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff7e95c-dfb5-440e-87cb-bb22158487fa None admin] RBAC: Authorizing `identity:get_project(project_id=fc658444791b4f9a8a5a90bdfba5518f)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:27.573851 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff7e95c-dfb5-440e-87cb-bb22158487fa None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:27.580601 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 518/1058] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 31 00:08:27 2022] GET /identity/v3/projects/fc658444791b4f9a8a5a90bdfba5518f => generated 311 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:08:27.581869 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daca903-07f2-4b1b-b4e3-a1c83dfb0bac None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:27.615211 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51e1786-5d90-4d53-98f2-80a629e283d9 None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:27.615530 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51e1786-5d90-4d53-98f2-80a629e283d9 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:27.615760 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51e1786-5d90-4d53-98f2-80a629e283d9 None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:27.617133 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 519/1059] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 00:08:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 00:08:27.622342 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf21cd60-ae4e-4a00-a9d5-e163306297e2 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:27.622623 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf21cd60-ae4e-4a00-a9d5-e163306297e2 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:27.622894 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf21cd60-ae4e-4a00-a9d5-e163306297e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:27.641745 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-bf21cd60-ae4e-4a00-a9d5-e163306297e2 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:08:27.642957 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-bf21cd60-ae4e-4a00-a9d5-e163306297e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:08:27.674686 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:27.695762 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daca903-07f2-4b1b-b4e3-a1c83dfb0bac None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:27.727854 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 520/1060] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 00:08:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 00:08:27.737708 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ab862f-d4ed-46fb-b95d-d66d6179497f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:27.738446 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ab862f-d4ed-46fb-b95d-d66d6179497f None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:27.738744 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ab862f-d4ed-46fb-b95d-d66d6179497f None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:27.739110 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ab862f-d4ed-46fb-b95d-d66d6179497f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:27.739900 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ab862f-d4ed-46fb-b95d-d66d6179497f None admin] RBAC: Adding query filter params (role.id=12f6817f9aaa4e2bb477095a6bed5d0f, scope.project.id=fc658444791b4f9a8a5a90bdfba5518f, user.id=355c06037e2d4c4da05f8b964a467d3a) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:27.740322 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ab862f-d4ed-46fb-b95d-d66d6179497f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:27.741811 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ab862f-d4ed-46fb-b95d-d66d6179497f None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:27.748059 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 541/1061] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 31 00:08:27 2022] GET /identity/v3/role_assignments?user.id=355c06037e2d4c4da05f8b964a467d3a&scope.project.id=fc658444791b4f9a8a5a90bdfba5518f&role.id=12f6817f9aaa4e2bb477095a6bed5d0f => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:08:28.001907 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf21cd60-ae4e-4a00-a9d5-e163306297e2 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:28.106156 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:28.110217 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf21cd60-ae4e-4a00-a9d5-e163306297e2 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:28.149424 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd57e300-7041-42fb-b70f-db49271f2fdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:28.150420 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd57e300-7041-42fb-b70f-db49271f2fdc None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:28.151107 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd57e300-7041-42fb-b70f-db49271f2fdc None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:28.151625 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd57e300-7041-42fb-b70f-db49271f2fdc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:28.231589 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd57e300-7041-42fb-b70f-db49271f2fdc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:28.233525 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd57e300-7041-42fb-b70f-db49271f2fdc None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:28.337762 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:28.342594 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 521/1062] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 31 00:08:28 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 00:08:28.348814 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ab862f-d4ed-46fb-b95d-d66d6179497f None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:28.433707 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c8fb68-cd22-48e7-ad17-d855aca23e4a None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:28.434621 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c8fb68-cd22-48e7-ad17-d855aca23e4a None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:28.434915 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c8fb68-cd22-48e7-ad17-d855aca23e4a None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:28.437085 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 522/1063] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 00:08:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 00:08:28.444185 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0bc590-3d35-4aa8-aa63-d3395674b9f3 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:28.444185 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0bc590-3d35-4aa8-aa63-d3395674b9f3 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:28.444185 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0bc590-3d35-4aa8-aa63-d3395674b9f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:28.461072 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-ba0bc590-3d35-4aa8-aa63-d3395674b9f3 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:08:28.462212 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-ba0bc590-3d35-4aa8-aa63-d3395674b9f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:08:28.464271 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ab862f-d4ed-46fb-b95d-d66d6179497f None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:28.506035 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0a7db6-1017-4399-b73b-d754c3491bb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:28.506672 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0a7db6-1017-4399-b73b-d754c3491bb3 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:28.506954 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0a7db6-1017-4399-b73b-d754c3491bb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:28.507229 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0a7db6-1017-4399-b73b-d754c3491bb3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:28.520855 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0a7db6-1017-4399-b73b-d754c3491bb3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:28.522807 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0a7db6-1017-4399-b73b-d754c3491bb3 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:28.530980 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:28.540973 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-ce0a7db6-1017-4399-b73b-d754c3491bb3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:08:28.540973 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:28.540973 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:08:28.540973 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:08:28.540973 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:08:28.540973 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:08:28.540973 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:08:28.540973 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:08:28.540973 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:08:28.540973 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:08:28.540973 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:08:28.540973 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:08:28.540973 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:08:28.540973 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:08:28.540973 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:08:28.540973 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:08:28.543084 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:08:28.543084 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:08:28.543084 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:08:28.543084 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:08:28.543084 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:08:28.543084 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:08:28.543084 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:08:28.543084 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Aug 31 00:08:28.543084 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:08:28.543084 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:08:28.543084 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:08:28.543084 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:08:28.543084 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:08:28.543084 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:08:28.543084 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:08:28.543084 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:08:28.543084 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:08:28.544052 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:08:28.544052 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:08:28.544052 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Aug 31 00:08:28.544052 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 542/1064] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 00:08:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:08:28.548829 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0a7db6-1017-4399-b73b-d754c3491bb3 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:28.559372 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 523/1065] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 00:08:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 00:08:28.658956 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0a7db6-1017-4399-b73b-d754c3491bb3 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:28.695210 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8734d229-b15f-4f46-91de-46fc7cd4188f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:28.695917 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8734d229-b15f-4f46-91de-46fc7cd4188f None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:28.696111 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8734d229-b15f-4f46-91de-46fc7cd4188f None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:28.696394 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8734d229-b15f-4f46-91de-46fc7cd4188f None admin] PATH_INFO: `/v3/domains` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:28.697040 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8734d229-b15f-4f46-91de-46fc7cd4188f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:28.697859 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8734d229-b15f-4f46-91de-46fc7cd4188f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:28.698963 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8734d229-b15f-4f46-91de-46fc7cd4188f None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:28.711838 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 543/1066] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 31 00:08:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:28.834273 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0bc590-3d35-4aa8-aa63-d3395674b9f3 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:28.949461 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0bc590-3d35-4aa8-aa63-d3395674b9f3 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:28.983696 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:28.994326 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c72cc9f-4b53-44cd-bdf9-e3793829463e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:28.994987 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c72cc9f-4b53-44cd-bdf9-e3793829463e None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:28.995270 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c72cc9f-4b53-44cd-bdf9-e3793829463e None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:28.995545 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c72cc9f-4b53-44cd-bdf9-e3793829463e None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:29.008414 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c72cc9f-4b53-44cd-bdf9-e3793829463e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:08:29.014093 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-4c72cc9f-4b53-44cd-bdf9-e3793829463e None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 00:08:29.014093 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:29.014093 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:08:29.014093 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:08:29.014093 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:08:29.014093 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:08:29.014093 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:08:29.014093 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:08:29.014093 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:08:29.014093 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:08:29.014093 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:08:29.014093 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:08:29.014093 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:08:29.014093 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:08:29.014093 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:08:29.014093 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:08:29.015260 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:08:29.015260 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:08:29.015260 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:08:29.015260 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:08:29.015260 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:08:29.015260 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:08:29.015260 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:08:29.015260 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:08:29.015260 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:08:29.015260 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:08:29.015260 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:08:29.015260 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 31 00:08:29.015260 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:08:29.015260 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:08:29.015260 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:08:29.015260 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:08:29.016352 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:08:29.016352 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:08:29.016352 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:08:29.016352 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:08:29.016352 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:08:29.016352 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:08:29.016352 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:08:29.016352 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:08:29.016352 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:08:29.016352 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:08:29.016352 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 00:08:29.016352 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 31 00:08:29.016352 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 524/1067] 10.222.0.47 () {56 vars in 1120 bytes} [Wed Aug 31 00:08:28 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:08:29.021467 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8734d229-b15f-4f46-91de-46fc7cd4188f None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:29.085429 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:29.129664 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8734d229-b15f-4f46-91de-46fc7cd4188f None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:29.164178 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea82c0dd-af9f-4520-be9f-e79b57a62a7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:29.164813 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea82c0dd-af9f-4520-be9f-e79b57a62a7a None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:29.165095 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea82c0dd-af9f-4520-be9f-e79b57a62a7a None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:29.165370 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea82c0dd-af9f-4520-be9f-e79b57a62a7a None admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:29.166036 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea82c0dd-af9f-4520-be9f-e79b57a62a7a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:29.167335 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea82c0dd-af9f-4520-be9f-e79b57a62a7a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:29.168757 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea82c0dd-af9f-4520-be9f-e79b57a62a7a None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:29.177196 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 544/1068] 10.222.0.47 () {56 vars in 1115 bytes} [Wed Aug 31 00:08:29 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:29.184484 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c72cc9f-4b53-44cd-bdf9-e3793829463e None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:29.291936 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c72cc9f-4b53-44cd-bdf9-e3793829463e None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:29.327332 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e55133c-558a-49a1-8383-3c6558d61018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:29.327971 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e55133c-558a-49a1-8383-3c6558d61018 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:29.328277 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e55133c-558a-49a1-8383-3c6558d61018 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:29.328551 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e55133c-558a-49a1-8383-3c6558d61018 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:29.343070 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e55133c-558a-49a1-8383-3c6558d61018 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:29.344590 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e55133c-558a-49a1-8383-3c6558d61018 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:29.361343 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-6e55133c-558a-49a1-8383-3c6558d61018 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:08:29.361343 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:29.361343 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:08:29.361343 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:08:29.361343 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:08:29.361343 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:08:29.361343 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:08:29.361343 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:08:29.361343 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:08:29.361343 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:08:29.361343 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:08:29.361343 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:08:29.361343 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:08:29.361343 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:08:29.361343 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:08:29.361343 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:08:29.362540 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:08:29.362540 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:08:29.362540 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:08:29.362540 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:08:29.362540 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:08:29.362540 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:08:29.362540 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:08:29.362540 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 31 00:08:29.362540 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:08:29.362540 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:08:29.362540 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:08:29.362540 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:08:29.362540 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:08:29.362540 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:08:29.362540 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:08:29.362540 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:08:29.362540 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:08:29.363494 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:08:29.363494 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:08:29.363494 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 31 00:08:29.363494 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 525/1069] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 00:08:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:08:29.368422 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea82c0dd-af9f-4520-be9f-e79b57a62a7a None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:29.470724 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea82c0dd-af9f-4520-be9f-e79b57a62a7a None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:29.492104 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:29.506801 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56417aaa-2d3b-4f1c-b601-769ca73dba48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:29.507407 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56417aaa-2d3b-4f1c-b601-769ca73dba48 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:29.507688 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56417aaa-2d3b-4f1c-b601-769ca73dba48 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:29.507966 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56417aaa-2d3b-4f1c-b601-769ca73dba48 None admin] PATH_INFO: `/v3/domains` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:29.508646 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56417aaa-2d3b-4f1c-b601-769ca73dba48 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:29.508950 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56417aaa-2d3b-4f1c-b601-769ca73dba48 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:29.510616 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56417aaa-2d3b-4f1c-b601-769ca73dba48 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:29.522506 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 545/1070] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 31 00:08:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:29.528978 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e55133c-558a-49a1-8383-3c6558d61018 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:29.572658 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:29.631490 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e55133c-558a-49a1-8383-3c6558d61018 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:29.665967 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a187834-af57-41ba-a114-caa16ada87e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:29.667184 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a187834-af57-41ba-a114-caa16ada87e8 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:29.667462 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a187834-af57-41ba-a114-caa16ada87e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:29.667731 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a187834-af57-41ba-a114-caa16ada87e8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:29.675635 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a187834-af57-41ba-a114-caa16ada87e8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:29.677162 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a187834-af57-41ba-a114-caa16ada87e8 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:29.682261 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba66729-bf6b-46da-9880-8a020fa23346 None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:29.682693 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba66729-bf6b-46da-9880-8a020fa23346 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:29.682979 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba66729-bf6b-46da-9880-8a020fa23346 None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:29.684341 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 546/1071] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 00:08:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 00:08:29.689490 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be68f57-1966-4d01-8f0e-8d316548c264 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:29.689650 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-5a187834-af57-41ba-a114-caa16ada87e8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 31 00:08:29.689650 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:29.689650 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:08:29.689650 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:08:29.689650 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:08:29.689650 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:08:29.689650 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:08:29.689650 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:08:29.689650 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:08:29.689650 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:08:29.689650 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:08:29.689650 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:08:29.689650 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 00:08:29.689650 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 00:08:29.689650 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 00:08:29.689650 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 00:08:29.690640 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:08:29.690640 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:08:29.690640 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:08:29.690640 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:08:29.690640 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:08:29.690640 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:08:29.690640 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:08:29.690640 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:08:29.690640 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:08:29.690640 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:08:29.690640 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:08:29.690640 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 31 00:08:29.690640 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:08:29.690640 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:08:29.690640 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:08:29.690640 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:08:29.690640 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:08:29.690640 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:08:29.691618 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:08:29.691618 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:08:29.691618 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 00:08:29.691618 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 00:08:29.691618 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 00:08:29.691618 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 00:08:29.691618 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 00:08:29.691618 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 00:08:29.691618 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 31 00:08:29.691618 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 31 00:08:29.692206 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be68f57-1966-4d01-8f0e-8d316548c264 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:29.692206 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be68f57-1966-4d01-8f0e-8d316548c264 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:29.692356 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 526/1072] 10.222.0.47 () {56 vars in 1093 bytes} [Wed Aug 31 00:08:29 2022] GET /identity/v3/users/nova => generated 82 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:08:29.696496 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a187834-af57-41ba-a114-caa16ada87e8 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:29.709359 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-1be68f57-1966-4d01-8f0e-8d316548c264 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:08:29.710539 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-1be68f57-1966-4d01-8f0e-8d316548c264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:08:29.783823 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 547/1073] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 00:08:29 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 00:08:29.800704 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a187834-af57-41ba-a114-caa16ada87e8 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:29.802330 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:29.836901 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abee9fc7-cd94-4238-8040-bfb61d3b364e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:29.837398 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abee9fc7-cd94-4238-8040-bfb61d3b364e None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:29.837672 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abee9fc7-cd94-4238-8040-bfb61d3b364e None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:29.838032 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abee9fc7-cd94-4238-8040-bfb61d3b364e None admin] PATH_INFO: `/v3/users` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:29.839504 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abee9fc7-cd94-4238-8040-bfb61d3b364e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:29.839803 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abee9fc7-cd94-4238-8040-bfb61d3b364e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:29.841256 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abee9fc7-cd94-4238-8040-bfb61d3b364e None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:29.858669 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 527/1074] 10.222.0.47 () {56 vars in 1133 bytes} [Wed Aug 31 00:08:29 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:08:29.864436 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be68f57-1966-4d01-8f0e-8d316548c264 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:29.966426 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be68f57-1966-4d01-8f0e-8d316548c264 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:29.978050 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:30.004123 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cb3049-5899-45c7-bbc3-728186d90688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:30.004879 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cb3049-5899-45c7-bbc3-728186d90688 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:30.005233 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cb3049-5899-45c7-bbc3-728186d90688 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:30.005567 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cb3049-5899-45c7-bbc3-728186d90688 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:30.017206 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cb3049-5899-45c7-bbc3-728186d90688 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:30.018679 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cb3049-5899-45c7-bbc3-728186d90688 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:30.034919 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-55cb3049-5899-45c7-bbc3-728186d90688 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:08:30.034919 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:30.034919 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:08:30.034919 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:08:30.034919 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:08:30.034919 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:08:30.034919 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:08:30.034919 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:08:30.034919 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:08:30.034919 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:08:30.034919 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:08:30.034919 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:08:30.034919 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:08:30.034919 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:08:30.034919 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:08:30.034919 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:08:30.035982 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:08:30.035982 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:08:30.035982 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:08:30.035982 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:08:30.035982 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:08:30.035982 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:08:30.035982 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:08:30.035982 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Aug 31 00:08:30.035982 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:08:30.035982 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:08:30.035982 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:08:30.035982 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:08:30.035982 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:08:30.035982 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:08:30.035982 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:08:30.035982 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:08:30.035982 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:08:30.036956 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:08:30.036956 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:08:30.036956 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Aug 31 00:08:30.036956 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 548/1075] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 00:08:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:08:30.042241 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abee9fc7-cd94-4238-8040-bfb61d3b364e None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:30.056113 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cb3049-5899-45c7-bbc3-728186d90688 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:30.154020 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abee9fc7-cd94-4238-8040-bfb61d3b364e None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:30.171867 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cb3049-5899-45c7-bbc3-728186d90688 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:30.191624 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53052f1f-6ff1-4fc2-af7b-dd3cfe94c8f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:30.192276 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53052f1f-6ff1-4fc2-af7b-dd3cfe94c8f6 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:30.192557 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53052f1f-6ff1-4fc2-af7b-dd3cfe94c8f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:30.192829 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53052f1f-6ff1-4fc2-af7b-dd3cfe94c8f6 None admin] PATH_INFO: `/v3/domains` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:30.193470 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53052f1f-6ff1-4fc2-af7b-dd3cfe94c8f6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:30.193775 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53052f1f-6ff1-4fc2-af7b-dd3cfe94c8f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:30.195156 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53052f1f-6ff1-4fc2-af7b-dd3cfe94c8f6 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:30.206623 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 528/1076] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 31 00:08:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:30.210698 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b6b65f-8fa1-4db1-9747-2cb71822cd49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:30.211671 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b6b65f-8fa1-4db1-9747-2cb71822cd49 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:30.211953 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b6b65f-8fa1-4db1-9747-2cb71822cd49 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:30.212253 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b6b65f-8fa1-4db1-9747-2cb71822cd49 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:30.212404 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53052f1f-6ff1-4fc2-af7b-dd3cfe94c8f6 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:30.224759 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b6b65f-8fa1-4db1-9747-2cb71822cd49 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:08:30.230154 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-16b6b65f-8fa1-4db1-9747-2cb71822cd49 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:08:30.230154 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:30.230154 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:08:30.230154 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:08:30.230154 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:08:30.230154 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:08:30.230154 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:08:30.230154 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:08:30.230154 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:08:30.230154 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:08:30.230154 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:08:30.230154 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:08:30.230154 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:08:30.230154 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:08:30.230154 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:08:30.230154 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:08:30.231331 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:08:30.231331 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:08:30.231331 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:08:30.231331 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:08:30.231331 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:08:30.231331 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:08:30.231331 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:08:30.231331 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:08:30.231331 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:08:30.231331 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:08:30.231331 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:08:30.231331 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Aug 31 00:08:30.231331 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:08:30.231331 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:08:30.231331 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:08:30.231331 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:08:30.232341 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:08:30.232341 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:08:30.232341 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:08:30.232341 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:08:30.232341 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:08:30.232341 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:08:30.232341 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:08:30.232341 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:08:30.232341 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:08:30.232341 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:08:30.232341 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:08:30.232341 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Aug 31 00:08:30.232341 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 549/1077] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Aug 31 00:08:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:08:30.237342 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b6b65f-8fa1-4db1-9747-2cb71822cd49 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:30.237842 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:30.264642 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:30.318555 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53052f1f-6ff1-4fc2-af7b-dd3cfe94c8f6 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:30.345336 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b6b65f-8fa1-4db1-9747-2cb71822cd49 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:30.356059 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43b0fe3-f489-4bea-9af9-0d49d9360b47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:30.357023 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43b0fe3-f489-4bea-9af9-0d49d9360b47 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:30.357308 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43b0fe3-f489-4bea-9af9-0d49d9360b47 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:30.357720 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43b0fe3-f489-4bea-9af9-0d49d9360b47 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:30.364733 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43b0fe3-f489-4bea-9af9-0d49d9360b47 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:30.366194 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43b0fe3-f489-4bea-9af9-0d49d9360b47 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:30.378436 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-a43b0fe3-f489-4bea-9af9-0d49d9360b47 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:08:30.378436 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:30.378436 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:08:30.378436 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:08:30.378436 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:08:30.378436 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:08:30.378436 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:08:30.378436 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:08:30.378436 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:08:30.378436 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:08:30.378436 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:08:30.378436 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:08:30.378436 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 00:08:30.378436 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 00:08:30.378436 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 00:08:30.379536 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 00:08:30.379536 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:08:30.379536 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:08:30.379536 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:08:30.379536 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:08:30.379536 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:08:30.379536 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:08:30.379536 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:08:30.379536 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 31 00:08:30.379536 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:08:30.379536 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:08:30.379536 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:08:30.379536 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:08:30.379536 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:08:30.379536 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:08:30.379536 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:08:30.379536 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:08:30.381366 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 00:08:30.381366 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 00:08:30.381366 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:08:30.381366 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:08:30.381366 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:08:30.381366 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:08:30.381366 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:08:30.381366 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 31 00:08:30.381366 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 529/1078] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 31 00:08:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:08:30.385989 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43b0fe3-f489-4bea-9af9-0d49d9360b47 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:30.388328 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388286e7-6754-4543-811e-0f896a83a849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:30.388964 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388286e7-6754-4543-811e-0f896a83a849 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:30.389252 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388286e7-6754-4543-811e-0f896a83a849 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:30.389532 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388286e7-6754-4543-811e-0f896a83a849 None admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:30.390213 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388286e7-6754-4543-811e-0f896a83a849 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:30.390613 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388286e7-6754-4543-811e-0f896a83a849 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:30.392398 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388286e7-6754-4543-811e-0f896a83a849 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:30.402813 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 550/1079] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 31 00:08:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:08:30.409223 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388286e7-6754-4543-811e-0f896a83a849 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:30.481074 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:30.502935 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:30.504645 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43b0fe3-f489-4bea-9af9-0d49d9360b47 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:30.519701 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388286e7-6754-4543-811e-0f896a83a849 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:30.547840 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c562eb5-976e-40ff-aa10-280cc25a76a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:30.548475 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c562eb5-976e-40ff-aa10-280cc25a76a9 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:30.548753 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c562eb5-976e-40ff-aa10-280cc25a76a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:30.549022 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c562eb5-976e-40ff-aa10-280cc25a76a9 None admin] PATH_INFO: `/v3/projects` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:30.549717 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c562eb5-976e-40ff-aa10-280cc25a76a9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:30.550023 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c562eb5-976e-40ff-aa10-280cc25a76a9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:30.551464 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c562eb5-976e-40ff-aa10-280cc25a76a9 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:30.555470 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aedd20d-db50-4127-9d41-afe9111d1430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:30.556097 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aedd20d-db50-4127-9d41-afe9111d1430 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:30.556400 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aedd20d-db50-4127-9d41-afe9111d1430 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:30.556671 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aedd20d-db50-4127-9d41-afe9111d1430 None admin] PATH_INFO: `/v3/users/355c06037e2d4c4da05f8b964a467d3a` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:30.558370 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aedd20d-db50-4127-9d41-afe9111d1430 None admin] RBAC: Authorizing `identity:get_user(user_id=355c06037e2d4c4da05f8b964a467d3a)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:30.559792 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aedd20d-db50-4127-9d41-afe9111d1430 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:30.561482 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 551/1080] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 31 00:08:30 2022] GET /identity/v3/users/355c06037e2d4c4da05f8b964a467d3a => generated 285 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:08:30.570250 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 530/1081] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Aug 31 00:08:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:08:30.570430 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aedd20d-db50-4127-9d41-afe9111d1430 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:30.571253 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c562eb5-976e-40ff-aa10-280cc25a76a9 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:30.674107 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aedd20d-db50-4127-9d41-afe9111d1430 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:30.681552 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c562eb5-976e-40ff-aa10-280cc25a76a9 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:30.714555 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe596d6-0fb6-45df-ac79-d6b8f8f93f85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:30.715300 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe596d6-0fb6-45df-ac79-d6b8f8f93f85 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:30.715647 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe596d6-0fb6-45df-ac79-d6b8f8f93f85 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:30.715989 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe596d6-0fb6-45df-ac79-d6b8f8f93f85 None admin] PATH_INFO: `/v3/projects/fc658444791b4f9a8a5a90bdfba5518f` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:30.717130 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe596d6-0fb6-45df-ac79-d6b8f8f93f85 None admin] RBAC: Authorizing `identity:get_project(project_id=fc658444791b4f9a8a5a90bdfba5518f)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:30.718545 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef6f442-dbf1-4f43-bcb4-fb51e96371cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:30.718663 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe596d6-0fb6-45df-ac79-d6b8f8f93f85 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:30.719210 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef6f442-dbf1-4f43-bcb4-fb51e96371cd None admin] REQUEST_METHOD: `PUT` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:30.719488 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef6f442-dbf1-4f43-bcb4-fb51e96371cd None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:30.719759 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef6f442-dbf1-4f43-bcb4-fb51e96371cd None admin] PATH_INFO: `/v3/projects/1b647cccb30a427193fc62dbebe0c6f1/users/9ea002bf49c248dbae7147665fa10fd1/roles/37e9c028ff614960bea9cb8941645e61` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:30.725320 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 552/1082] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 31 00:08:30 2022] GET /identity/v3/projects/fc658444791b4f9a8a5a90bdfba5518f => generated 311 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:30.725464 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef6f442-dbf1-4f43-bcb4-fb51e96371cd None admin] RBAC: Authorizing `identity:create_grant(project_id=1b647cccb30a427193fc62dbebe0c6f1, user_id=9ea002bf49c248dbae7147665fa10fd1, role_id=37e9c028ff614960bea9cb8941645e61)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:30.725464 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef6f442-dbf1-4f43-bcb4-fb51e96371cd None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:30.726066 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe596d6-0fb6-45df-ac79-d6b8f8f93f85 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:30.733738 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:30.738980 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 531/1083] 10.222.0.47 () {58 vars in 1439 bytes} [Wed Aug 31 00:08:30 2022] PUT /identity/v3/projects/1b647cccb30a427193fc62dbebe0c6f1/users/9ea002bf49c248dbae7147665fa10fd1/roles/37e9c028ff614960bea9cb8941645e61 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:08:30.752517 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:30.844019 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe596d6-0fb6-45df-ac79-d6b8f8f93f85 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:30.891691 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ecf831-2fc8-471a-aeae-a678988f85bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:30.892385 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ecf831-2fc8-471a-aeae-a678988f85bb None admin] REQUEST_METHOD: `PUT` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:30.892666 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ecf831-2fc8-471a-aeae-a678988f85bb None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:30.892940 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ecf831-2fc8-471a-aeae-a678988f85bb None admin] PATH_INFO: `/v3/projects/fc658444791b4f9a8a5a90bdfba5518f/users/355c06037e2d4c4da05f8b964a467d3a/roles/12f6817f9aaa4e2bb477095a6bed5d0f` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:30.894860 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ecf831-2fc8-471a-aeae-a678988f85bb None admin] RBAC: Authorizing `identity:create_grant(project_id=fc658444791b4f9a8a5a90bdfba5518f, user_id=355c06037e2d4c4da05f8b964a467d3a, role_id=12f6817f9aaa4e2bb477095a6bed5d0f)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:30.896333 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ecf831-2fc8-471a-aeae-a678988f85bb None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:30.910918 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 553/1084] 10.222.0.47 () {58 vars in 1439 bytes} [Wed Aug 31 00:08:30 2022] PUT /identity/v3/projects/fc658444791b4f9a8a5a90bdfba5518f/users/355c06037e2d4c4da05f8b964a467d3a/roles/12f6817f9aaa4e2bb477095a6bed5d0f => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:08:32.675313 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99b50c0-8872-4fa7-a9d6-ef1fe55159ad None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:32.675854 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99b50c0-8872-4fa7-a9d6-ef1fe55159ad None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:32.675854 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99b50c0-8872-4fa7-a9d6-ef1fe55159ad None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:32.677206 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 532/1085] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 00:08:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:08:32.683304 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257c2b79-7d77-4d16-b62f-65c78e89c144 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:32.683753 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257c2b79-7d77-4d16-b62f-65c78e89c144 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:32.683839 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257c2b79-7d77-4d16-b62f-65c78e89c144 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:32.702743 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-257c2b79-7d77-4d16-b62f-65c78e89c144 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:08:32.703945 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-257c2b79-7d77-4d16-b62f-65c78e89c144 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:08:32.773210 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 554/1086] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 00:08:32 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:08:32.849517 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c22152-7301-4b81-a75c-64c26d3076db None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:32.849793 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c22152-7301-4b81-a75c-64c26d3076db None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:32.850135 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c22152-7301-4b81-a75c-64c26d3076db None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:32.851445 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 533/1087] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 00:08:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:08:32.857408 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08db54e-c33b-46b5-901d-a789f0364ca4 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:32.857705 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08db54e-c33b-46b5-901d-a789f0364ca4 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:32.857957 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08db54e-c33b-46b5-901d-a789f0364ca4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:32.877161 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-d08db54e-c33b-46b5-901d-a789f0364ca4 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:08:32.878337 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-d08db54e-c33b-46b5-901d-a789f0364ca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:08:32.881310 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:32.947839 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 555/1088] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 00:08:32 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:08:33.045812 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c22152-7301-4b81-a75c-64c26d3076db None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:33.149690 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c22152-7301-4b81-a75c-64c26d3076db None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:33.185638 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159f1e53-27a4-489c-ab62-6c43c2f2eb66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:33.185888 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159f1e53-27a4-489c-ab62-6c43c2f2eb66 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:33.185985 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159f1e53-27a4-489c-ab62-6c43c2f2eb66 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:33.186250 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159f1e53-27a4-489c-ab62-6c43c2f2eb66 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:33.199129 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159f1e53-27a4-489c-ab62-6c43c2f2eb66 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:08:33.203968 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-159f1e53-27a4-489c-ab62-6c43c2f2eb66 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 00:08:33.203968 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:33.203968 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:08:33.203968 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:08:33.203968 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:08:33.203968 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:08:33.203968 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:08:33.203968 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:08:33.203968 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:08:33.203968 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:08:33.203968 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:08:33.203968 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:08:33.203968 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:08:33.203968 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:08:33.203968 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:08:33.203968 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:08:33.205087 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:08:33.205087 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:08:33.205087 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:08:33.205087 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:08:33.205087 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:08:33.205087 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:08:33.205087 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:08:33.205087 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:08:33.205087 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:08:33.205087 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:08:33.205087 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:08:33.205087 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 31 00:08:33.205087 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:08:33.205087 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:08:33.205087 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:08:33.205087 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:08:33.206131 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:08:33.206131 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:08:33.206131 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:08:33.206131 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:08:33.206131 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:08:33.206131 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:08:33.206131 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:08:33.206131 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:08:33.206131 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:08:33.206131 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:08:33.206131 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 00:08:33.206131 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 31 00:08:33.207220 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 534/1089] 10.222.0.47 () {56 vars in 1120 bytes} [Wed Aug 31 00:08:33 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:08:33.211044 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08db54e-c33b-46b5-901d-a789f0364ca4 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:33.217185 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159f1e53-27a4-489c-ab62-6c43c2f2eb66 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:33.277906 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:33.318065 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08db54e-c33b-46b5-901d-a789f0364ca4 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:33.319230 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159f1e53-27a4-489c-ab62-6c43c2f2eb66 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:33.354207 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c57fffd-34ea-4b16-8d7a-d43830e00617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:33.354422 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbb3a8f-524a-4ebe-af84-86519232b676 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:33.354872 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbb3a8f-524a-4ebe-af84-86519232b676 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:33.355010 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c57fffd-34ea-4b16-8d7a-d43830e00617 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:33.355220 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbb3a8f-524a-4ebe-af84-86519232b676 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:33.355309 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c57fffd-34ea-4b16-8d7a-d43830e00617 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:33.355422 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbb3a8f-524a-4ebe-af84-86519232b676 None admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:33.355577 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c57fffd-34ea-4b16-8d7a-d43830e00617 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:33.356083 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbb3a8f-524a-4ebe-af84-86519232b676 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:33.356414 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbb3a8f-524a-4ebe-af84-86519232b676 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:33.357783 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbb3a8f-524a-4ebe-af84-86519232b676 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:33.366015 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c57fffd-34ea-4b16-8d7a-d43830e00617 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:08:33.366339 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 556/1090] 10.222.0.47 () {56 vars in 1115 bytes} [Wed Aug 31 00:08:33 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:33.371841 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-8c57fffd-34ea-4b16-8d7a-d43830e00617 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:08:33.371841 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:33.371841 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:08:33.371841 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:08:33.371841 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:08:33.371841 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:08:33.371841 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:08:33.371841 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:08:33.371841 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:08:33.371841 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:08:33.371841 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:08:33.371841 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:08:33.371841 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:08:33.371841 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:08:33.371841 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:08:33.371841 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:08:33.373010 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:08:33.373010 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:08:33.373010 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:08:33.373010 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:08:33.373010 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:08:33.373010 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:08:33.373010 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:08:33.373010 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:08:33.373010 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:08:33.373010 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:08:33.373010 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:08:33.373010 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 31 00:08:33.373010 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:08:33.373010 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:08:33.373010 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:08:33.373010 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:08:33.373940 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:08:33.373940 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:08:33.373940 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:08:33.373940 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:08:33.373940 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:08:33.373940 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:08:33.373940 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:08:33.373940 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:08:33.373940 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:08:33.373940 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:08:33.373940 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:08:33.373940 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 31 00:08:33.374606 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbb3a8f-524a-4ebe-af84-86519232b676 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:33.374683 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 535/1091] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Aug 31 00:08:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:08:33.375662 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:33.379132 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c57fffd-34ea-4b16-8d7a-d43830e00617 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:33.483320 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c57fffd-34ea-4b16-8d7a-d43830e00617 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:33.489764 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbb3a8f-524a-4ebe-af84-86519232b676 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:33.508624 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:33.524184 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc14328-e8cd-4cc9-a4d1-2fdf36fd944a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:33.524484 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f37551-168c-4c71-95ef-9c5f1920c356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:33.524809 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc14328-e8cd-4cc9-a4d1-2fdf36fd944a None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:33.525088 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc14328-e8cd-4cc9-a4d1-2fdf36fd944a None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:33.525194 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f37551-168c-4c71-95ef-9c5f1920c356 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:33.525360 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc14328-e8cd-4cc9-a4d1-2fdf36fd944a None admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:33.525504 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f37551-168c-4c71-95ef-9c5f1920c356 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:33.525852 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f37551-168c-4c71-95ef-9c5f1920c356 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:33.526239 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc14328-e8cd-4cc9-a4d1-2fdf36fd944a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:33.526550 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc14328-e8cd-4cc9-a4d1-2fdf36fd944a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:33.527933 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc14328-e8cd-4cc9-a4d1-2fdf36fd944a None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:33.536879 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 536/1092] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 31 00:08:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:08:33.537405 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f37551-168c-4c71-95ef-9c5f1920c356 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:33.538861 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f37551-168c-4c71-95ef-9c5f1920c356 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:33.543895 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc14328-e8cd-4cc9-a4d1-2fdf36fd944a None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:33.554278 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-16f37551-168c-4c71-95ef-9c5f1920c356 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:08:33.554278 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:33.554278 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:08:33.554278 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:08:33.554278 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:08:33.554278 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:08:33.554278 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:08:33.554278 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:08:33.554278 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:08:33.554278 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:08:33.554278 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:08:33.554278 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:08:33.554278 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:08:33.554278 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:08:33.554278 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:08:33.554278 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:08:33.555359 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:08:33.555359 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:08:33.555359 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:08:33.555359 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:08:33.555359 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:08:33.555359 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:08:33.555359 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:08:33.555359 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Aug 31 00:08:33.555359 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:08:33.555359 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:08:33.555359 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:08:33.555359 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:08:33.555359 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:08:33.555359 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:08:33.555359 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:08:33.555359 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:08:33.555359 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:08:33.557451 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:08:33.557451 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:08:33.557451 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Aug 31 00:08:33.557451 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 557/1093] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 00:08:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:08:33.564298 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f37551-168c-4c71-95ef-9c5f1920c356 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:33.620828 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:33.650054 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc14328-e8cd-4cc9-a4d1-2fdf36fd944a None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:33.670455 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f37551-168c-4c71-95ef-9c5f1920c356 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:33.686639 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa15c632-ecbf-4f28-8fc4-9e3c65439a05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:33.687279 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa15c632-ecbf-4f28-8fc4-9e3c65439a05 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:33.687557 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa15c632-ecbf-4f28-8fc4-9e3c65439a05 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:33.687824 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa15c632-ecbf-4f28-8fc4-9e3c65439a05 None admin] PATH_INFO: `/v3/users/355c06037e2d4c4da05f8b964a467d3a` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:33.688993 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa15c632-ecbf-4f28-8fc4-9e3c65439a05 None admin] RBAC: Authorizing `identity:get_user(user_id=355c06037e2d4c4da05f8b964a467d3a)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:33.690437 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa15c632-ecbf-4f28-8fc4-9e3c65439a05 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:33.692034 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 537/1094] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 31 00:08:33 2022] GET /identity/v3/users/355c06037e2d4c4da05f8b964a467d3a => generated 285 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:08:33.698068 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa15c632-ecbf-4f28-8fc4-9e3c65439a05 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:33.711044 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db4a27d-66b6-4799-a1da-b4e569d74294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:33.711662 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db4a27d-66b6-4799-a1da-b4e569d74294 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:33.711937 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db4a27d-66b6-4799-a1da-b4e569d74294 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:33.712236 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db4a27d-66b6-4799-a1da-b4e569d74294 None admin] PATH_INFO: `/v3/domains` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:33.712883 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db4a27d-66b6-4799-a1da-b4e569d74294 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:33.713395 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db4a27d-66b6-4799-a1da-b4e569d74294 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:33.714894 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db4a27d-66b6-4799-a1da-b4e569d74294 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:33.726949 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 558/1095] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 31 00:08:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:08:33.733096 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db4a27d-66b6-4799-a1da-b4e569d74294 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:33.755658 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:33.808020 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa15c632-ecbf-4f28-8fc4-9e3c65439a05 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:33.835716 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db4a27d-66b6-4799-a1da-b4e569d74294 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:33.842619 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cff130-2963-4260-bf29-6ac866dc5a13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:33.843233 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cff130-2963-4260-bf29-6ac866dc5a13 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:33.843510 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cff130-2963-4260-bf29-6ac866dc5a13 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:33.843783 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cff130-2963-4260-bf29-6ac866dc5a13 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:33.851331 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:33.875029 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77fef57-d72a-4a28-a26f-b0b147aa90d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:33.875645 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77fef57-d72a-4a28-a26f-b0b147aa90d6 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:33.875930 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77fef57-d72a-4a28-a26f-b0b147aa90d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:33.876230 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77fef57-d72a-4a28-a26f-b0b147aa90d6 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:33.883720 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77fef57-d72a-4a28-a26f-b0b147aa90d6 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:33.888902 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77fef57-d72a-4a28-a26f-b0b147aa90d6 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:33.898342 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-b77fef57-d72a-4a28-a26f-b0b147aa90d6 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 31 00:08:33.898342 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:33.898342 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:08:33.898342 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:08:33.898342 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:08:33.898342 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:08:33.898342 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:08:33.898342 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:08:33.898342 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:08:33.898342 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:08:33.898342 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:08:33.898342 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:08:33.898342 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 00:08:33.898342 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 00:08:33.898342 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 00:08:33.898342 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 00:08:33.900119 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:08:33.900119 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:08:33.900119 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:08:33.900119 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:08:33.900119 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:08:33.900119 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:08:33.900119 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:08:33.900119 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:08:33.900119 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:08:33.900119 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:08:33.900119 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:08:33.900119 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Aug 31 00:08:33.900119 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:08:33.900119 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:08:33.900119 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:08:33.900119 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:08:33.900119 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:08:33.900119 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:08:33.902332 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:08:33.902332 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:08:33.902332 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 00:08:33.902332 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 00:08:33.902332 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 00:08:33.902332 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 00:08:33.902332 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 00:08:33.902332 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 00:08:33.902332 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 31 00:08:33.902332 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Aug 31 00:08:33.904572 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 559/1096] 10.222.0.47 () {56 vars in 1093 bytes} [Wed Aug 31 00:08:33 2022] GET /identity/v3/users/nova => generated 82 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:08:33.905804 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77fef57-d72a-4a28-a26f-b0b147aa90d6 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:33.923855 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cff130-2963-4260-bf29-6ac866dc5a13 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:33.925414 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cff130-2963-4260-bf29-6ac866dc5a13 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:33.978600 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:34.017979 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77fef57-d72a-4a28-a26f-b0b147aa90d6 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:34.033987 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 538/1097] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 31 00:08:33 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 31 00:08:34.040230 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cff130-2963-4260-bf29-6ac866dc5a13 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:34.053152 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08700a4d-24f6-4cff-8a7e-be1e1a39f4f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:34.053766 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08700a4d-24f6-4cff-8a7e-be1e1a39f4f2 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:34.054046 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08700a4d-24f6-4cff-8a7e-be1e1a39f4f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:34.054322 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08700a4d-24f6-4cff-8a7e-be1e1a39f4f2 None admin] PATH_INFO: `/v3/users` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:34.055062 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08700a4d-24f6-4cff-8a7e-be1e1a39f4f2 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:34.055374 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08700a4d-24f6-4cff-8a7e-be1e1a39f4f2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:34.057370 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08700a4d-24f6-4cff-8a7e-be1e1a39f4f2 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:34.076686 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 560/1098] 10.222.0.47 () {56 vars in 1133 bytes} [Wed Aug 31 00:08:33 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:08:34.082480 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08700a4d-24f6-4cff-8a7e-be1e1a39f4f2 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:34.115785 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:34.140993 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cff130-2963-4260-bf29-6ac866dc5a13 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:34.176759 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159d68aa-1460-4f16-a30c-5c0eac620af0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:34.177399 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159d68aa-1460-4f16-a30c-5c0eac620af0 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:34.177677 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159d68aa-1460-4f16-a30c-5c0eac620af0 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:34.177943 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159d68aa-1460-4f16-a30c-5c0eac620af0 None admin] PATH_INFO: `/v3/projects/fc658444791b4f9a8a5a90bdfba5518f` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:34.179079 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159d68aa-1460-4f16-a30c-5c0eac620af0 None admin] RBAC: Authorizing `identity:get_project(project_id=fc658444791b4f9a8a5a90bdfba5518f)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:34.180552 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159d68aa-1460-4f16-a30c-5c0eac620af0 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:34.182749 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 539/1099] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 31 00:08:34 2022] GET /identity/v3/projects/fc658444791b4f9a8a5a90bdfba5518f => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:08:34.189138 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159d68aa-1460-4f16-a30c-5c0eac620af0 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:34.192375 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08700a4d-24f6-4cff-8a7e-be1e1a39f4f2 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:34.210501 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:34.230780 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04067b92-4393-4c34-aed4-7af02198b5be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:34.231396 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04067b92-4393-4c34-aed4-7af02198b5be None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:34.231667 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04067b92-4393-4c34-aed4-7af02198b5be None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:34.231933 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04067b92-4393-4c34-aed4-7af02198b5be None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:34.294656 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159d68aa-1460-4f16-a30c-5c0eac620af0 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:34.303072 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04067b92-4393-4c34-aed4-7af02198b5be None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:34.304662 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04067b92-4393-4c34-aed4-7af02198b5be None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:34.333287 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa6e8b2-db8b-4cea-aa01-5ead7220ad6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:34.333890 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa6e8b2-db8b-4cea-aa01-5ead7220ad6b None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:34.334164 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa6e8b2-db8b-4cea-aa01-5ead7220ad6b None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:34.334432 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa6e8b2-db8b-4cea-aa01-5ead7220ad6b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:34.335163 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa6e8b2-db8b-4cea-aa01-5ead7220ad6b None admin] RBAC: Adding query filter params (role.id=12f6817f9aaa4e2bb477095a6bed5d0f, scope.project.id=fc658444791b4f9a8a5a90bdfba5518f, user.id=355c06037e2d4c4da05f8b964a467d3a) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:34.335471 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa6e8b2-db8b-4cea-aa01-5ead7220ad6b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:34.335608 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:34.337125 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa6e8b2-db8b-4cea-aa01-5ead7220ad6b None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:34.343499 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 540/1100] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 31 00:08:34 2022] GET /identity/v3/role_assignments?user.id=355c06037e2d4c4da05f8b964a467d3a&scope.project.id=fc658444791b4f9a8a5a90bdfba5518f&role.id=12f6817f9aaa4e2bb477095a6bed5d0f => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:08:34.418644 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 561/1101] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 31 00:08:34 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 00:08:34.424784 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa6e8b2-db8b-4cea-aa01-5ead7220ad6b None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:34.519340 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:34.538864 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa6e8b2-db8b-4cea-aa01-5ead7220ad6b None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:34.574940 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145459d1-55f0-4392-ae44-e08bcda9d0b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:34.575490 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145459d1-55f0-4392-ae44-e08bcda9d0b8 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:34.575771 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145459d1-55f0-4392-ae44-e08bcda9d0b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:34.576044 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145459d1-55f0-4392-ae44-e08bcda9d0b8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:34.587336 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145459d1-55f0-4392-ae44-e08bcda9d0b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:34.589361 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145459d1-55f0-4392-ae44-e08bcda9d0b8 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:34.605052 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-145459d1-55f0-4392-ae44-e08bcda9d0b8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:08:34.605052 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:34.605052 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:08:34.605052 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:08:34.605052 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:08:34.605052 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:08:34.605052 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:08:34.605052 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:08:34.605052 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:08:34.605052 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:08:34.605052 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:08:34.605052 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:08:34.605052 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:08:34.605052 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:08:34.605052 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:08:34.605052 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:08:34.606293 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:08:34.606293 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:08:34.606293 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:08:34.606293 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:08:34.606293 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:08:34.606293 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:08:34.606293 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:08:34.606293 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 31 00:08:34.606293 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:08:34.606293 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:08:34.606293 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:08:34.606293 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:08:34.606293 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:08:34.606293 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:08:34.606293 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:08:34.606293 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:08:34.606293 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:08:34.607218 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:08:34.607218 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:08:34.607218 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 31 00:08:34.607218 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 541/1102] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 00:08:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:08:34.612256 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04067b92-4393-4c34-aed4-7af02198b5be None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:34.725923 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04067b92-4393-4c34-aed4-7af02198b5be None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:34.757995 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:34.764409 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4759d1cb-86b9-422b-a14b-da1a33589851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:34.765046 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4759d1cb-86b9-422b-a14b-da1a33589851 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:34.765360 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4759d1cb-86b9-422b-a14b-da1a33589851 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:34.765592 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4759d1cb-86b9-422b-a14b-da1a33589851 None admin] PATH_INFO: `/v3/domains` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:34.766263 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4759d1cb-86b9-422b-a14b-da1a33589851 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:34.766566 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4759d1cb-86b9-422b-a14b-da1a33589851 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:34.768043 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4759d1cb-86b9-422b-a14b-da1a33589851 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:34.782456 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 562/1103] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 31 00:08:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:34.788702 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145459d1-55f0-4392-ae44-e08bcda9d0b8 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:34.899165 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145459d1-55f0-4392-ae44-e08bcda9d0b8 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:34.937035 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f87793-43d8-4d0c-97a3-a900c95a7d06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:34.937666 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f87793-43d8-4d0c-97a3-a900c95a7d06 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:34.937938 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f87793-43d8-4d0c-97a3-a900c95a7d06 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:34.938201 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f87793-43d8-4d0c-97a3-a900c95a7d06 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:34.940123 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:34.946120 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f87793-43d8-4d0c-97a3-a900c95a7d06 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:34.948550 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f87793-43d8-4d0c-97a3-a900c95a7d06 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:34.960832 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-b6f87793-43d8-4d0c-97a3-a900c95a7d06 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:08:34.960832 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:34.960832 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:08:34.960832 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:08:34.960832 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:08:34.960832 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:08:34.960832 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:08:34.960832 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:08:34.960832 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:08:34.960832 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:08:34.960832 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:08:34.960832 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:08:34.960832 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 00:08:34.960832 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 00:08:34.960832 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 00:08:34.961939 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 00:08:34.961939 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:08:34.961939 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:08:34.961939 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:08:34.961939 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:08:34.961939 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:08:34.961939 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:08:34.961939 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:08:34.961939 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 31 00:08:34.961939 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:08:34.961939 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:08:34.961939 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:08:34.961939 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:08:34.961939 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:08:34.961939 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:08:34.961939 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:08:34.961939 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:08:34.963437 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 00:08:34.963437 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 00:08:34.963437 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:08:34.963437 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:08:34.963437 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:08:34.963437 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:08:34.963437 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:08:34.963437 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 31 00:08:34.963437 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 542/1104] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 31 00:08:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:08:34.967899 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4759d1cb-86b9-422b-a14b-da1a33589851 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:35.078462 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4759d1cb-86b9-422b-a14b-da1a33589851 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:35.114081 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c280d6a-27e6-4af2-897d-88d309cc4132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:35.114849 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c280d6a-27e6-4af2-897d-88d309cc4132 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:35.115129 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c280d6a-27e6-4af2-897d-88d309cc4132 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:35.115400 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c280d6a-27e6-4af2-897d-88d309cc4132 None admin] PATH_INFO: `/v3/projects` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:35.116087 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c280d6a-27e6-4af2-897d-88d309cc4132 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:35.116424 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c280d6a-27e6-4af2-897d-88d309cc4132 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:35.117854 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c280d6a-27e6-4af2-897d-88d309cc4132 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:35.138535 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 563/1105] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Aug 31 00:08:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:35.139792 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f87793-43d8-4d0c-97a3-a900c95a7d06 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:35.240555 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f87793-43d8-4d0c-97a3-a900c95a7d06 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:35.275479 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba50f26d-9b34-442e-8460-c0dea39fa7a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:35.276755 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba50f26d-9b34-442e-8460-c0dea39fa7a5 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:35.277037 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba50f26d-9b34-442e-8460-c0dea39fa7a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:35.277340 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba50f26d-9b34-442e-8460-c0dea39fa7a5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:35.278060 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba50f26d-9b34-442e-8460-c0dea39fa7a5 None admin] RBAC: Adding query filter params (role.id=37e9c028ff614960bea9cb8941645e61, scope.project.id=1b647cccb30a427193fc62dbebe0c6f1, user.id=9ea002bf49c248dbae7147665fa10fd1) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:35.278368 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba50f26d-9b34-442e-8460-c0dea39fa7a5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:35.279837 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba50f26d-9b34-442e-8460-c0dea39fa7a5 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:35.287057 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 543/1106] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 31 00:08:35 2022] GET /identity/v3/role_assignments?user.id=9ea002bf49c248dbae7147665fa10fd1&scope.project.id=1b647cccb30a427193fc62dbebe0c6f1&role.id=37e9c028ff614960bea9cb8941645e61 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:36.373909 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05780b9d-a800-48b1-a733-a1698c8adbfb None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:36.374417 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05780b9d-a800-48b1-a733-a1698c8adbfb None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:36.374417 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05780b9d-a800-48b1-a733-a1698c8adbfb None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:36.375732 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 564/1107] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 00:08:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:08:36.380983 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c50483-67a6-43a6-a6d8-2e3d3f345ecc None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:36.381413 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c50483-67a6-43a6-a6d8-2e3d3f345ecc None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:36.381534 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c50483-67a6-43a6-a6d8-2e3d3f345ecc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:36.400024 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-82c50483-67a6-43a6-a6d8-2e3d3f345ecc None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:08:36.401367 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-82c50483-67a6-43a6-a6d8-2e3d3f345ecc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:08:36.456246 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:36.470437 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 544/1108] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 00:08:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 00:08:36.744711 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05780b9d-a800-48b1-a733-a1698c8adbfb None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:36.800082 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:36.848389 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05780b9d-a800-48b1-a733-a1698c8adbfb None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:36.882815 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5970d1ac-e138-4cb9-917a-ee9e7c6709de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:36.883443 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5970d1ac-e138-4cb9-917a-ee9e7c6709de None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:36.883724 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5970d1ac-e138-4cb9-917a-ee9e7c6709de None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:36.883999 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5970d1ac-e138-4cb9-917a-ee9e7c6709de None admin] PATH_INFO: `/v3/domains/default` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:36.885148 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5970d1ac-e138-4cb9-917a-ee9e7c6709de None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:36.886596 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5970d1ac-e138-4cb9-917a-ee9e7c6709de None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:36.888174 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 565/1109] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 00:08:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:36.893924 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c50483-67a6-43a6-a6d8-2e3d3f345ecc None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:36.993608 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c50483-67a6-43a6-a6d8-2e3d3f345ecc None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:37.028568 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74589c2a-2f6f-407b-8e7f-0dd1fde14aea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:37.029103 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74589c2a-2f6f-407b-8e7f-0dd1fde14aea None admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:37.029381 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74589c2a-2f6f-407b-8e7f-0dd1fde14aea None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:37.029655 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74589c2a-2f6f-407b-8e7f-0dd1fde14aea None admin] PATH_INFO: `/v3/users` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:37.030310 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74589c2a-2f6f-407b-8e7f-0dd1fde14aea None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:37.031745 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74589c2a-2f6f-407b-8e7f-0dd1fde14aea None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:37.054197 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 545/1110] 10.222.0.47 () {60 vars in 1132 bytes} [Wed Aug 31 00:08:36 2022] POST /identity/v3/users => generated 286 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:08:39.022938 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5494395d-3acb-408d-b25c-8a1afec51fc6 None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:39.023499 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5494395d-3acb-408d-b25c-8a1afec51fc6 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:39.023499 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5494395d-3acb-408d-b25c-8a1afec51fc6 None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:39.024860 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 566/1111] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 00:08:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:08:39.030844 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2170b136-c9b0-4702-be89-73ebc7457d2d None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:39.031290 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2170b136-c9b0-4702-be89-73ebc7457d2d None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:39.031402 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2170b136-c9b0-4702-be89-73ebc7457d2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:39.051868 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-2170b136-c9b0-4702-be89-73ebc7457d2d None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:08:39.053103 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-2170b136-c9b0-4702-be89-73ebc7457d2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:08:39.094176 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:39.122565 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 546/1112] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 00:08:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:08:39.392035 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5494395d-3acb-408d-b25c-8a1afec51fc6 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:39.498585 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5494395d-3acb-408d-b25c-8a1afec51fc6 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:39.522138 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:39.537130 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa0bc25-d364-4d23-b430-693c52b15fc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:39.537781 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa0bc25-d364-4d23-b430-693c52b15fc0 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:39.538066 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa0bc25-d364-4d23-b430-693c52b15fc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:39.538343 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa0bc25-d364-4d23-b430-693c52b15fc0 None admin] PATH_INFO: `/v3/roles/89f25837440e4981bad54fe74d242232` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:39.539766 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa0bc25-d364-4d23-b430-693c52b15fc0 None admin] RBAC: Authorizing `identity:get_role(role_id=89f25837440e4981bad54fe74d242232)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:39.541880 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa0bc25-d364-4d23-b430-693c52b15fc0 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:39.543271 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 567/1113] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 31 00:08:39 2022] GET /identity/v3/roles/89f25837440e4981bad54fe74d242232 => generated 223 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:39.549293 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2170b136-c9b0-4702-be89-73ebc7457d2d None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:39.659180 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2170b136-c9b0-4702-be89-73ebc7457d2d None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:39.695685 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bf74ad-b052-4745-b7aa-2c3549f59f7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:39.696339 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bf74ad-b052-4745-b7aa-2c3549f59f7c None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:39.696616 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bf74ad-b052-4745-b7aa-2c3549f59f7c None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:39.696885 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bf74ad-b052-4745-b7aa-2c3549f59f7c None admin] PATH_INFO: `/v3/users/708d9b9a00c94e27aaf3a438413a0ddb` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:39.710544 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bf74ad-b052-4745-b7aa-2c3549f59f7c None admin] RBAC: Authorizing `identity:get_user(user_id=708d9b9a00c94e27aaf3a438413a0ddb)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:39.711997 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bf74ad-b052-4745-b7aa-2c3549f59f7c None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:39.714114 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 547/1114] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 31 00:08:39 2022] GET /identity/v3/users/708d9b9a00c94e27aaf3a438413a0ddb => generated 286 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:39.720058 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa0bc25-d364-4d23-b430-693c52b15fc0 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:39.821573 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa0bc25-d364-4d23-b430-693c52b15fc0 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:39.855008 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d10846d-ca43-4d03-9227-3fc247a0eb24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:39.855604 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d10846d-ca43-4d03-9227-3fc247a0eb24 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:39.855880 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d10846d-ca43-4d03-9227-3fc247a0eb24 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:39.856178 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d10846d-ca43-4d03-9227-3fc247a0eb24 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:39.912863 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:39.926362 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d10846d-ca43-4d03-9227-3fc247a0eb24 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:39.927833 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d10846d-ca43-4d03-9227-3fc247a0eb24 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:40.027003 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 568/1115] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 31 00:08:39 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 00:08:40.033064 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bf74ad-b052-4745-b7aa-2c3549f59f7c None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:40.064907 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:40.135916 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bf74ad-b052-4745-b7aa-2c3549f59f7c None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:40.171598 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7fbeb9-3772-40c6-8a3a-6c6c14da54a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:40.172195 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7fbeb9-3772-40c6-8a3a-6c6c14da54a6 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:40.172471 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7fbeb9-3772-40c6-8a3a-6c6c14da54a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:40.172746 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7fbeb9-3772-40c6-8a3a-6c6c14da54a6 None admin] PATH_INFO: `/v3/projects/fc658444791b4f9a8a5a90bdfba5518f` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:40.173972 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7fbeb9-3772-40c6-8a3a-6c6c14da54a6 None admin] RBAC: Authorizing `identity:get_project(project_id=fc658444791b4f9a8a5a90bdfba5518f)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:40.175457 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7fbeb9-3772-40c6-8a3a-6c6c14da54a6 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:40.177231 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 548/1116] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 31 00:08:40 2022] GET /identity/v3/projects/fc658444791b4f9a8a5a90bdfba5518f => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:40.184695 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d10846d-ca43-4d03-9227-3fc247a0eb24 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:40.285901 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:40.298832 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d10846d-ca43-4d03-9227-3fc247a0eb24 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:40.336533 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cae1a4-5fae-4933-9191-2fba05c72dcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:40.337156 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cae1a4-5fae-4933-9191-2fba05c72dcf None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:40.337438 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cae1a4-5fae-4933-9191-2fba05c72dcf None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:40.337712 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cae1a4-5fae-4933-9191-2fba05c72dcf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:40.339330 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cae1a4-5fae-4933-9191-2fba05c72dcf None admin] RBAC: Adding query filter params (role.id=89f25837440e4981bad54fe74d242232, scope.project.id=fc658444791b4f9a8a5a90bdfba5518f, user.id=708d9b9a00c94e27aaf3a438413a0ddb) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:40.339643 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cae1a4-5fae-4933-9191-2fba05c72dcf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:40.341125 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cae1a4-5fae-4933-9191-2fba05c72dcf None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:40.347055 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 569/1117] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 31 00:08:40 2022] GET /identity/v3/role_assignments?user.id=708d9b9a00c94e27aaf3a438413a0ddb&scope.project.id=fc658444791b4f9a8a5a90bdfba5518f&role.id=89f25837440e4981bad54fe74d242232 => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:42.251993 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fe3e7c-3849-450b-9705-174fefa47118 None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:42.252556 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fe3e7c-3849-450b-9705-174fefa47118 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:42.252556 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fe3e7c-3849-450b-9705-174fefa47118 None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:42.253829 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 549/1118] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 00:08:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:08:42.259214 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7bff52-1fb4-4b68-b94c-9d88af3e6539 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:42.259691 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7bff52-1fb4-4b68-b94c-9d88af3e6539 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:42.259815 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7bff52-1fb4-4b68-b94c-9d88af3e6539 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:42.279159 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-be7bff52-1fb4-4b68-b94c-9d88af3e6539 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:08:42.280389 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-be7bff52-1fb4-4b68-b94c-9d88af3e6539 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:08:42.347875 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 570/1119] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 00:08:42 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 00:08:42.625373 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fe3e7c-3849-450b-9705-174fefa47118 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:42.733635 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:42.737934 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fe3e7c-3849-450b-9705-174fefa47118 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:42.775781 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702ee909-c4a5-425b-96da-19442e4e28a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:42.776541 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702ee909-c4a5-425b-96da-19442e4e28a9 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:42.776826 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702ee909-c4a5-425b-96da-19442e4e28a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:42.777104 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702ee909-c4a5-425b-96da-19442e4e28a9 None admin] PATH_INFO: `/v3/roles/89f25837440e4981bad54fe74d242232` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:42.778610 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702ee909-c4a5-425b-96da-19442e4e28a9 None admin] RBAC: Authorizing `identity:get_role(role_id=89f25837440e4981bad54fe74d242232)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:42.780035 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702ee909-c4a5-425b-96da-19442e4e28a9 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:42.781478 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 550/1120] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 31 00:08:42 2022] GET /identity/v3/roles/89f25837440e4981bad54fe74d242232 => generated 223 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:42.787884 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7bff52-1fb4-4b68-b94c-9d88af3e6539 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:42.882238 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:42.902062 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7bff52-1fb4-4b68-b94c-9d88af3e6539 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:42.939845 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6eb8ab1-7d8a-4de5-953e-e9d9fabf04ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:42.940515 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eb8ab1-7d8a-4de5-953e-e9d9fabf04ba None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:42.940798 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eb8ab1-7d8a-4de5-953e-e9d9fabf04ba None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:42.941078 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eb8ab1-7d8a-4de5-953e-e9d9fabf04ba None admin] PATH_INFO: `/v3/users/708d9b9a00c94e27aaf3a438413a0ddb` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:42.942251 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6eb8ab1-7d8a-4de5-953e-e9d9fabf04ba None admin] RBAC: Authorizing `identity:get_user(user_id=708d9b9a00c94e27aaf3a438413a0ddb)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:42.943746 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6eb8ab1-7d8a-4de5-953e-e9d9fabf04ba None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:42.945410 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 571/1121] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 31 00:08:42 2022] GET /identity/v3/users/708d9b9a00c94e27aaf3a438413a0ddb => generated 286 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:42.951912 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702ee909-c4a5-425b-96da-19442e4e28a9 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:43.053845 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702ee909-c4a5-425b-96da-19442e4e28a9 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:43.088719 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076d554a-1331-42d5-b599-3adeb364a8a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:43.089350 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076d554a-1331-42d5-b599-3adeb364a8a2 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:43.089622 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076d554a-1331-42d5-b599-3adeb364a8a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:43.089893 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076d554a-1331-42d5-b599-3adeb364a8a2 None admin] PATH_INFO: `/v3/projects/fc658444791b4f9a8a5a90bdfba5518f` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:43.091007 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076d554a-1331-42d5-b599-3adeb364a8a2 None admin] RBAC: Authorizing `identity:get_project(project_id=fc658444791b4f9a8a5a90bdfba5518f)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:43.092477 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076d554a-1331-42d5-b599-3adeb364a8a2 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:43.094203 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 551/1122] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 31 00:08:42 2022] GET /identity/v3/projects/fc658444791b4f9a8a5a90bdfba5518f => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:43.100208 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6eb8ab1-7d8a-4de5-953e-e9d9fabf04ba None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:43.201574 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6eb8ab1-7d8a-4de5-953e-e9d9fabf04ba None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:43.235344 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae67de7-01f3-472d-9ef4-ae01c556260b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:43.236003 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae67de7-01f3-472d-9ef4-ae01c556260b None admin] REQUEST_METHOD: `PUT` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:43.236321 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae67de7-01f3-472d-9ef4-ae01c556260b None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:43.236600 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae67de7-01f3-472d-9ef4-ae01c556260b None admin] PATH_INFO: `/v3/projects/fc658444791b4f9a8a5a90bdfba5518f/users/708d9b9a00c94e27aaf3a438413a0ddb/roles/89f25837440e4981bad54fe74d242232` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:43.238736 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae67de7-01f3-472d-9ef4-ae01c556260b None admin] RBAC: Authorizing `identity:create_grant(project_id=fc658444791b4f9a8a5a90bdfba5518f, user_id=708d9b9a00c94e27aaf3a438413a0ddb, role_id=89f25837440e4981bad54fe74d242232)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:43.240181 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae67de7-01f3-472d-9ef4-ae01c556260b None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:43.253219 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 572/1123] 10.222.0.47 () {58 vars in 1439 bytes} [Wed Aug 31 00:08:43 2022] PUT /identity/v3/projects/fc658444791b4f9a8a5a90bdfba5518f/users/708d9b9a00c94e27aaf3a438413a0ddb/roles/89f25837440e4981bad54fe74d242232 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:08:45.172787 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159247c6-2caa-4572-922f-0ab0491bd2ba None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:45.173346 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159247c6-2caa-4572-922f-0ab0491bd2ba None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:45.173346 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159247c6-2caa-4572-922f-0ab0491bd2ba None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:45.174667 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 552/1124] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 00:08:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:08:45.180325 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9a2924-61b0-4f85-a57c-34fcda656438 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:45.180801 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9a2924-61b0-4f85-a57c-34fcda656438 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:45.180904 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9a2924-61b0-4f85-a57c-34fcda656438 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:45.201064 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-ad9a2924-61b0-4f85-a57c-34fcda656438 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:08:45.202264 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-ad9a2924-61b0-4f85-a57c-34fcda656438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:08:45.205385 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:45.275083 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 573/1125] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 00:08:45 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:08:45.557412 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159247c6-2caa-4572-922f-0ab0491bd2ba None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:45.595626 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:45.663213 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159247c6-2caa-4572-922f-0ab0491bd2ba None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:45.698804 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6146a04-e666-43aa-a059-992be82db720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:45.699440 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6146a04-e666-43aa-a059-992be82db720 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:45.699720 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6146a04-e666-43aa-a059-992be82db720 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:45.699992 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6146a04-e666-43aa-a059-992be82db720 None admin] PATH_INFO: `/v3/roles/89f25837440e4981bad54fe74d242232` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:45.701420 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6146a04-e666-43aa-a059-992be82db720 None admin] RBAC: Authorizing `identity:get_role(role_id=89f25837440e4981bad54fe74d242232)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:45.702805 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6146a04-e666-43aa-a059-992be82db720 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:45.704174 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 553/1126] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 31 00:08:45 2022] GET /identity/v3/roles/89f25837440e4981bad54fe74d242232 => generated 223 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:45.709993 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9a2924-61b0-4f85-a57c-34fcda656438 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:45.809830 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9a2924-61b0-4f85-a57c-34fcda656438 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:45.843438 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300400b4-3446-444a-acf7-4480715d47d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:45.844066 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300400b4-3446-444a-acf7-4480715d47d5 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:45.844377 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300400b4-3446-444a-acf7-4480715d47d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:45.844661 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300400b4-3446-444a-acf7-4480715d47d5 None admin] PATH_INFO: `/v3/users/708d9b9a00c94e27aaf3a438413a0ddb` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:45.846644 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300400b4-3446-444a-acf7-4480715d47d5 None admin] RBAC: Authorizing `identity:get_user(user_id=708d9b9a00c94e27aaf3a438413a0ddb)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:45.848078 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300400b4-3446-444a-acf7-4480715d47d5 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:45.849692 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 574/1127] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 31 00:08:45 2022] GET /identity/v3/users/708d9b9a00c94e27aaf3a438413a0ddb => generated 286 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:45.857347 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6146a04-e666-43aa-a059-992be82db720 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:45.960852 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6146a04-e666-43aa-a059-992be82db720 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:45.963745 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:45.997261 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc96f0c-f7c5-4bab-b50e-215a70783730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:45.997880 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc96f0c-f7c5-4bab-b50e-215a70783730 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:45.998167 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc96f0c-f7c5-4bab-b50e-215a70783730 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:45.998439 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc96f0c-f7c5-4bab-b50e-215a70783730 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:46.068124 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc96f0c-f7c5-4bab-b50e-215a70783730 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:46.069540 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc96f0c-f7c5-4bab-b50e-215a70783730 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:46.171700 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 554/1128] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 31 00:08:45 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 00:08:46.177724 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300400b4-3446-444a-acf7-4480715d47d5 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:46.189379 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:46.280421 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300400b4-3446-444a-acf7-4480715d47d5 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:46.316340 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cf3282-7010-412d-bfcc-54c9f0b010ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:46.316971 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cf3282-7010-412d-bfcc-54c9f0b010ca None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:46.317250 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cf3282-7010-412d-bfcc-54c9f0b010ca None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:46.317536 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cf3282-7010-412d-bfcc-54c9f0b010ca None admin] PATH_INFO: `/v3/projects/fc658444791b4f9a8a5a90bdfba5518f` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:46.318786 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cf3282-7010-412d-bfcc-54c9f0b010ca None admin] RBAC: Authorizing `identity:get_project(project_id=fc658444791b4f9a8a5a90bdfba5518f)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:46.320547 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cf3282-7010-412d-bfcc-54c9f0b010ca None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:46.322825 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 575/1129] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 31 00:08:46 2022] GET /identity/v3/projects/fc658444791b4f9a8a5a90bdfba5518f => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:46.329360 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc96f0c-f7c5-4bab-b50e-215a70783730 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:46.332590 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:46.436515 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc96f0c-f7c5-4bab-b50e-215a70783730 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:46.478046 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d2bcec-d8a3-4235-88c8-fa5250b6de98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:46.478987 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d2bcec-d8a3-4235-88c8-fa5250b6de98 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:46.479356 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d2bcec-d8a3-4235-88c8-fa5250b6de98 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:46.479671 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d2bcec-d8a3-4235-88c8-fa5250b6de98 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:46.480436 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d2bcec-d8a3-4235-88c8-fa5250b6de98 None admin] RBAC: Adding query filter params (role.id=89f25837440e4981bad54fe74d242232, scope.project.id=fc658444791b4f9a8a5a90bdfba5518f, user.id=708d9b9a00c94e27aaf3a438413a0ddb) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:46.480741 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d2bcec-d8a3-4235-88c8-fa5250b6de98 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:46.482194 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d2bcec-d8a3-4235-88c8-fa5250b6de98 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:46.488558 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 555/1130] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 31 00:08:46 2022] GET /identity/v3/role_assignments?user.id=708d9b9a00c94e27aaf3a438413a0ddb&scope.project.id=fc658444791b4f9a8a5a90bdfba5518f&role.id=89f25837440e4981bad54fe74d242232 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:48.423038 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec00dda-4487-498b-9a3a-da738ead0757 None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:48.423615 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec00dda-4487-498b-9a3a-da738ead0757 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:48.423899 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec00dda-4487-498b-9a3a-da738ead0757 None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:48.425452 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 576/1131] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 00:08:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:08:48.430678 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7d739c-ba10-4f60-882e-185e1c229dd2 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:48.431120 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7d739c-ba10-4f60-882e-185e1c229dd2 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:48.431221 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7d739c-ba10-4f60-882e-185e1c229dd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:48.450840 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-3d7d739c-ba10-4f60-882e-185e1c229dd2 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:08:48.452021 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-3d7d739c-ba10-4f60-882e-185e1c229dd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:08:48.515344 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:48.521483 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 556/1132] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 00:08:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:08:48.792475 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec00dda-4487-498b-9a3a-da738ead0757 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:48.871293 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:48.895894 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec00dda-4487-498b-9a3a-da738ead0757 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:48.930266 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef6cd8c-0569-42fc-95a0-253be41dad44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:48.930899 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef6cd8c-0569-42fc-95a0-253be41dad44 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:48.931182 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef6cd8c-0569-42fc-95a0-253be41dad44 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:48.931998 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef6cd8c-0569-42fc-95a0-253be41dad44 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:48.933349 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef6cd8c-0569-42fc-95a0-253be41dad44 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:48.934832 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef6cd8c-0569-42fc-95a0-253be41dad44 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:48.936591 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 577/1133] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 00:08:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:48.942756 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7d739c-ba10-4f60-882e-185e1c229dd2 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:49.043623 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7d739c-ba10-4f60-882e-185e1c229dd2 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:49.077893 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a101c25c-8c81-4d65-ba91-1ebdce7c52cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:49.078500 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a101c25c-8c81-4d65-ba91-1ebdce7c52cb None admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:49.078772 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a101c25c-8c81-4d65-ba91-1ebdce7c52cb None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:49.079040 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a101c25c-8c81-4d65-ba91-1ebdce7c52cb None admin] PATH_INFO: `/v3/projects` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:49.079692 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a101c25c-8c81-4d65-ba91-1ebdce7c52cb None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:49.081145 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a101c25c-8c81-4d65-ba91-1ebdce7c52cb None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:49.110142 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 557/1134] 10.222.0.47 () {60 vars in 1141 bytes} [Wed Aug 31 00:08:48 2022] POST /identity/v3/projects => generated 311 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:08:51.072961 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1b0c34-e69e-4a97-a16e-290a01c8865f None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:51.073535 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1b0c34-e69e-4a97-a16e-290a01c8865f None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:51.073700 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1b0c34-e69e-4a97-a16e-290a01c8865f None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:51.075068 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 578/1135] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 00:08:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:08:51.080572 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d211c75-382b-4814-87cc-1a260b34293d None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:51.080999 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d211c75-382b-4814-87cc-1a260b34293d None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:51.081113 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d211c75-382b-4814-87cc-1a260b34293d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:51.100553 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-4d211c75-382b-4814-87cc-1a260b34293d None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:08:51.101746 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-4d211c75-382b-4814-87cc-1a260b34293d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:08:51.151472 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:51.180104 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 558/1136] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 00:08:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:08:51.453044 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1b0c34-e69e-4a97-a16e-290a01c8865f None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:51.559357 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1b0c34-e69e-4a97-a16e-290a01c8865f None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:51.592642 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7beb885f-9096-4df0-89af-55739b819ee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:51.593186 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beb885f-9096-4df0-89af-55739b819ee1 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:51.593463 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beb885f-9096-4df0-89af-55739b819ee1 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:51.593736 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beb885f-9096-4df0-89af-55739b819ee1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:51.594864 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7beb885f-9096-4df0-89af-55739b819ee1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:51.596317 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7beb885f-9096-4df0-89af-55739b819ee1 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:51.597877 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 579/1137] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 00:08:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:51.604257 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d211c75-382b-4814-87cc-1a260b34293d None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:51.703619 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d211c75-382b-4814-87cc-1a260b34293d None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:51.737811 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63856b37-7539-442a-95b6-d3d239cddb79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:51.738417 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63856b37-7539-442a-95b6-d3d239cddb79 None admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:51.738696 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63856b37-7539-442a-95b6-d3d239cddb79 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:51.738967 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63856b37-7539-442a-95b6-d3d239cddb79 None admin] PATH_INFO: `/v3/users` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:51.739612 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63856b37-7539-442a-95b6-d3d239cddb79 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:51.741080 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63856b37-7539-442a-95b6-d3d239cddb79 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:51.764181 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 559/1138] 10.222.0.47 () {60 vars in 1132 bytes} [Wed Aug 31 00:08:51 2022] POST /identity/v3/users => generated 286 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:08:53.734160 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227b4ef8-4bc4-40af-bbe6-5d6fd41b5efd None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:53.734733 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227b4ef8-4bc4-40af-bbe6-5d6fd41b5efd None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:53.734733 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227b4ef8-4bc4-40af-bbe6-5d6fd41b5efd None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:53.736030 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 580/1139] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 00:08:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:08:53.741158 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed53736c-3c61-434c-a4f7-34bac1d2cb86 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:53.741544 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed53736c-3c61-434c-a4f7-34bac1d2cb86 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:53.741703 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed53736c-3c61-434c-a4f7-34bac1d2cb86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:53.760348 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-ed53736c-3c61-434c-a4f7-34bac1d2cb86 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:08:53.761507 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-ed53736c-3c61-434c-a4f7-34bac1d2cb86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:08:53.790545 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:53.830495 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 560/1140] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 00:08:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:08:54.098781 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227b4ef8-4bc4-40af-bbe6-5d6fd41b5efd None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:54.113859 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:54.209728 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227b4ef8-4bc4-40af-bbe6-5d6fd41b5efd None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:54.242779 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fad946c-5831-4b5b-9d17-707b67ca4486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:54.243324 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fad946c-5831-4b5b-9d17-707b67ca4486 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:54.243601 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fad946c-5831-4b5b-9d17-707b67ca4486 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:54.244420 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fad946c-5831-4b5b-9d17-707b67ca4486 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:54.254239 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fad946c-5831-4b5b-9d17-707b67ca4486 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:08:54.259040 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-9fad946c-5831-4b5b-9d17-707b67ca4486 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:08:54.259040 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:54.259040 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:08:54.259040 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:08:54.259040 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:08:54.259040 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:08:54.259040 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:08:54.259040 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:08:54.259040 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:08:54.259040 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:08:54.259040 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:08:54.259040 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:08:54.259040 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:08:54.259040 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:08:54.259040 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:08:54.259040 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:08:54.261151 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:08:54.261151 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:08:54.261151 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:08:54.261151 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:08:54.261151 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:08:54.261151 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:08:54.261151 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:08:54.261151 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:08:54.261151 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:08:54.261151 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:08:54.261151 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:08:54.261151 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Aug 31 00:08:54.261151 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:08:54.261151 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:08:54.261151 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:08:54.261151 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:08:54.262348 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:08:54.262348 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:08:54.262348 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:08:54.262348 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:08:54.262348 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:08:54.262348 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:08:54.262348 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:08:54.262348 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:08:54.262348 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:08:54.262348 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:08:54.262348 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:08:54.262348 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Aug 31 00:08:54.262348 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 581/1141] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Aug 31 00:08:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:08:54.266826 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed53736c-3c61-434c-a4f7-34bac1d2cb86 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:54.364791 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed53736c-3c61-434c-a4f7-34bac1d2cb86 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:54.403054 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c6d9f2-e522-4bb2-811a-f83ba6ddbfb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:54.403054 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c6d9f2-e522-4bb2-811a-f83ba6ddbfb0 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:54.403054 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c6d9f2-e522-4bb2-811a-f83ba6ddbfb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:54.403054 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c6d9f2-e522-4bb2-811a-f83ba6ddbfb0 None admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:54.403639 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c6d9f2-e522-4bb2-811a-f83ba6ddbfb0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:54.403639 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c6d9f2-e522-4bb2-811a-f83ba6ddbfb0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:54.403639 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c6d9f2-e522-4bb2-811a-f83ba6ddbfb0 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:54.411152 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 561/1142] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 31 00:08:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:54.419233 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fad946c-5831-4b5b-9d17-707b67ca4486 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:54.493157 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:54.522703 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fad946c-5831-4b5b-9d17-707b67ca4486 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:54.557925 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d90f4b0-dec6-4b61-b90c-a045f22a6ae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:54.558553 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d90f4b0-dec6-4b61-b90c-a045f22a6ae5 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:54.558827 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d90f4b0-dec6-4b61-b90c-a045f22a6ae5 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:54.559098 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d90f4b0-dec6-4b61-b90c-a045f22a6ae5 None admin] PATH_INFO: `/v3/users/ba5c3e208ea443748564975162a0f78e` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:54.572500 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d90f4b0-dec6-4b61-b90c-a045f22a6ae5 None admin] RBAC: Authorizing `identity:get_user(user_id=ba5c3e208ea443748564975162a0f78e)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:54.574126 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d90f4b0-dec6-4b61-b90c-a045f22a6ae5 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:54.575772 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 582/1143] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 31 00:08:54 2022] GET /identity/v3/users/ba5c3e208ea443748564975162a0f78e => generated 286 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:54.581790 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c6d9f2-e522-4bb2-811a-f83ba6ddbfb0 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:54.611338 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:54.685277 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c6d9f2-e522-4bb2-811a-f83ba6ddbfb0 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:54.718802 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26afa156-0650-44c5-97e6-b61c7e013e45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:54.719408 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26afa156-0650-44c5-97e6-b61c7e013e45 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:54.719688 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26afa156-0650-44c5-97e6-b61c7e013e45 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:54.719958 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26afa156-0650-44c5-97e6-b61c7e013e45 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:54.787856 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26afa156-0650-44c5-97e6-b61c7e013e45 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:54.789262 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26afa156-0650-44c5-97e6-b61c7e013e45 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:54.817152 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:54.893306 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 562/1144] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 31 00:08:54 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 00:08:54.899520 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d90f4b0-dec6-4b61-b90c-a045f22a6ae5 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:55.001783 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d90f4b0-dec6-4b61-b90c-a045f22a6ae5 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:55.030468 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:55.036862 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17e7a22-7058-4ca8-978e-3ce6c20eb220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:55.037494 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17e7a22-7058-4ca8-978e-3ce6c20eb220 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:55.037771 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17e7a22-7058-4ca8-978e-3ce6c20eb220 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:55.038096 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17e7a22-7058-4ca8-978e-3ce6c20eb220 None admin] PATH_INFO: `/v3/projects/dca8adecb18e439fbf5ce3254926a672` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:55.039154 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17e7a22-7058-4ca8-978e-3ce6c20eb220 None admin] RBAC: Authorizing `identity:get_project(project_id=dca8adecb18e439fbf5ce3254926a672)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:55.040627 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17e7a22-7058-4ca8-978e-3ce6c20eb220 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:55.042931 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 583/1145] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 31 00:08:54 2022] GET /identity/v3/projects/dca8adecb18e439fbf5ce3254926a672 => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:55.049133 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26afa156-0650-44c5-97e6-b61c7e013e45 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:55.152059 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26afa156-0650-44c5-97e6-b61c7e013e45 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:55.179546 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:55.188780 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf65160-67fe-4910-bbda-e59d49deec6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:55.189394 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf65160-67fe-4910-bbda-e59d49deec6a None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:55.189700 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf65160-67fe-4910-bbda-e59d49deec6a None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:55.189942 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf65160-67fe-4910-bbda-e59d49deec6a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:55.190665 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf65160-67fe-4910-bbda-e59d49deec6a None admin] RBAC: Adding query filter params (role.id=12f6817f9aaa4e2bb477095a6bed5d0f, scope.project.id=dca8adecb18e439fbf5ce3254926a672, user.id=ba5c3e208ea443748564975162a0f78e) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:55.190971 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf65160-67fe-4910-bbda-e59d49deec6a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:55.192504 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf65160-67fe-4910-bbda-e59d49deec6a None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:55.199037 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 563/1146] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 31 00:08:55 2022] GET /identity/v3/role_assignments?user.id=ba5c3e208ea443748564975162a0f78e&scope.project.id=dca8adecb18e439fbf5ce3254926a672&role.id=12f6817f9aaa4e2bb477095a6bed5d0f => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:57.115918 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b11860-f13f-4a49-bcea-7cf20193b8cb None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:57.116489 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b11860-f13f-4a49-bcea-7cf20193b8cb None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:57.116489 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b11860-f13f-4a49-bcea-7cf20193b8cb None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:57.117824 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 584/1147] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 00:08:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:08:57.123575 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec6851e-fdd3-41ec-8abf-22ae12d289db None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:57.124045 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec6851e-fdd3-41ec-8abf-22ae12d289db None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:57.124137 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec6851e-fdd3-41ec-8abf-22ae12d289db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:57.143009 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-5ec6851e-fdd3-41ec-8abf-22ae12d289db None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:08:57.144247 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-5ec6851e-fdd3-41ec-8abf-22ae12d289db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:08:57.217505 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 564/1148] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 00:08:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:08:57.494759 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b11860-f13f-4a49-bcea-7cf20193b8cb None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:57.596657 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b11860-f13f-4a49-bcea-7cf20193b8cb None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:57.630557 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdbac71-6322-42b3-bdba-dbd32abe4f9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:57.631179 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdbac71-6322-42b3-bdba-dbd32abe4f9e None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:57.631460 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdbac71-6322-42b3-bdba-dbd32abe4f9e None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:57.631738 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdbac71-6322-42b3-bdba-dbd32abe4f9e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:57.642618 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdbac71-6322-42b3-bdba-dbd32abe4f9e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:08:57.647510 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-8bdbac71-6322-42b3-bdba-dbd32abe4f9e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:08:57.647510 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:08:57.647510 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:08:57.647510 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:08:57.647510 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:08:57.647510 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:08:57.647510 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:08:57.647510 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:08:57.647510 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:08:57.647510 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:08:57.647510 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:08:57.647510 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:08:57.647510 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:08:57.647510 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:08:57.647510 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:08:57.647510 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:08:57.648677 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:08:57.648677 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:08:57.648677 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:08:57.648677 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:08:57.648677 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:08:57.648677 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:08:57.648677 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:08:57.648677 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:08:57.648677 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:08:57.648677 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:08:57.648677 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:08:57.648677 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Aug 31 00:08:57.648677 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:08:57.648677 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:08:57.648677 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:08:57.648677 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:08:57.649924 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:08:57.649924 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:08:57.649924 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:08:57.649924 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:08:57.649924 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:08:57.649924 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:08:57.649924 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:08:57.649924 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:08:57.649924 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:08:57.649924 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:08:57.649924 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:08:57.649924 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Aug 31 00:08:57.649924 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 585/1149] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Aug 31 00:08:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:08:57.655437 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec6851e-fdd3-41ec-8abf-22ae12d289db None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:57.755748 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec6851e-fdd3-41ec-8abf-22ae12d289db None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:57.779132 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:57.791797 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed65241-99d3-4c5d-b89f-3326a972dbbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:57.792428 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed65241-99d3-4c5d-b89f-3326a972dbbd None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:57.792707 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed65241-99d3-4c5d-b89f-3326a972dbbd None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:57.792977 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed65241-99d3-4c5d-b89f-3326a972dbbd None admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:57.793639 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed65241-99d3-4c5d-b89f-3326a972dbbd None admin] RBAC: Adding query filter params (name=admin) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:08:57.793941 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed65241-99d3-4c5d-b89f-3326a972dbbd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:57.795303 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed65241-99d3-4c5d-b89f-3326a972dbbd None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:57.803588 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 565/1150] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 31 00:08:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:57.809714 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdbac71-6322-42b3-bdba-dbd32abe4f9e None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:57.873932 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:57.920085 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdbac71-6322-42b3-bdba-dbd32abe4f9e None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:57.959237 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cea1b93-bf7a-47b9-a17a-a6ca47e80681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:57.959885 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cea1b93-bf7a-47b9-a17a-a6ca47e80681 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:57.960191 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cea1b93-bf7a-47b9-a17a-a6ca47e80681 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:57.960474 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cea1b93-bf7a-47b9-a17a-a6ca47e80681 None admin] PATH_INFO: `/v3/users/ba5c3e208ea443748564975162a0f78e` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:57.961648 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cea1b93-bf7a-47b9-a17a-a6ca47e80681 None admin] RBAC: Authorizing `identity:get_user(user_id=ba5c3e208ea443748564975162a0f78e)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:57.963335 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cea1b93-bf7a-47b9-a17a-a6ca47e80681 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:57.965064 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 586/1151] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 31 00:08:57 2022] GET /identity/v3/users/ba5c3e208ea443748564975162a0f78e => generated 286 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:57.971148 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed65241-99d3-4c5d-b89f-3326a972dbbd None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:58.078925 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed65241-99d3-4c5d-b89f-3326a972dbbd None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:58.112023 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296eb0e9-85ad-4b16-9527-5b67dc3491f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:58.112688 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296eb0e9-85ad-4b16-9527-5b67dc3491f5 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:58.112976 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296eb0e9-85ad-4b16-9527-5b67dc3491f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:58.113247 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296eb0e9-85ad-4b16-9527-5b67dc3491f5 None admin] PATH_INFO: `/v3/projects/dca8adecb18e439fbf5ce3254926a672` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:58.114359 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296eb0e9-85ad-4b16-9527-5b67dc3491f5 None admin] RBAC: Authorizing `identity:get_project(project_id=dca8adecb18e439fbf5ce3254926a672)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:58.115806 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296eb0e9-85ad-4b16-9527-5b67dc3491f5 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:58.117475 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 566/1152] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 31 00:08:57 2022] GET /identity/v3/projects/dca8adecb18e439fbf5ce3254926a672 => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:08:58.124416 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cea1b93-bf7a-47b9-a17a-a6ca47e80681 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:08:58.230883 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cea1b93-bf7a-47b9-a17a-a6ca47e80681 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:08:58.256469 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:08:58.265172 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee27d9c-2d50-40c7-9828-6fd709d4f211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:08:58.265834 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee27d9c-2d50-40c7-9828-6fd709d4f211 None admin] REQUEST_METHOD: `PUT` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:08:58.266114 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee27d9c-2d50-40c7-9828-6fd709d4f211 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:08:58.266389 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee27d9c-2d50-40c7-9828-6fd709d4f211 None admin] PATH_INFO: `/v3/projects/dca8adecb18e439fbf5ce3254926a672/users/ba5c3e208ea443748564975162a0f78e/roles/12f6817f9aaa4e2bb477095a6bed5d0f` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:08:58.268286 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee27d9c-2d50-40c7-9828-6fd709d4f211 None admin] RBAC: Authorizing `identity:create_grant(project_id=dca8adecb18e439fbf5ce3254926a672, user_id=ba5c3e208ea443748564975162a0f78e, role_id=12f6817f9aaa4e2bb477095a6bed5d0f)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:08:58.269732 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee27d9c-2d50-40c7-9828-6fd709d4f211 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:08:58.282882 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 587/1153] 10.222.0.47 () {58 vars in 1439 bytes} [Wed Aug 31 00:08:58 2022] PUT /identity/v3/projects/dca8adecb18e439fbf5ce3254926a672/users/ba5c3e208ea443748564975162a0f78e/roles/12f6817f9aaa4e2bb477095a6bed5d0f => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:09:00.205507 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba3d503-aa6c-45dd-828e-b37b97b17178 None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:00.206033 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba3d503-aa6c-45dd-828e-b37b97b17178 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:00.206033 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba3d503-aa6c-45dd-828e-b37b97b17178 None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:00.207386 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 567/1154] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 00:09:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:09:00.213171 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3f6e07-87c9-4be2-992a-689528211e91 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:00.213702 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3f6e07-87c9-4be2-992a-689528211e91 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:00.213702 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3f6e07-87c9-4be2-992a-689528211e91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:00.232418 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-7a3f6e07-87c9-4be2-992a-689528211e91 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:09:00.233615 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-7a3f6e07-87c9-4be2-992a-689528211e91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:09:00.301313 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 588/1155] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 00:09:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:09:00.568023 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba3d503-aa6c-45dd-828e-b37b97b17178 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:00.623285 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:00.674640 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba3d503-aa6c-45dd-828e-b37b97b17178 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:00.709400 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b7b291-b46c-478a-8526-3d89ad1664a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:00.710028 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b7b291-b46c-478a-8526-3d89ad1664a6 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:00.710309 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b7b291-b46c-478a-8526-3d89ad1664a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:00.710581 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b7b291-b46c-478a-8526-3d89ad1664a6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:00.720903 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b7b291-b46c-478a-8526-3d89ad1664a6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:09:00.726128 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-54b7b291-b46c-478a-8526-3d89ad1664a6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:09:00.726128 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:09:00.726128 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:09:00.726128 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:09:00.726128 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:09:00.726128 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:09:00.726128 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:09:00.726128 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:09:00.726128 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:09:00.726128 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:09:00.726128 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:09:00.726128 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:09:00.726128 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:09:00.726128 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:09:00.726128 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:09:00.726128 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:09:00.727240 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:09:00.727240 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:09:00.727240 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:09:00.727240 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:09:00.727240 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:09:00.727240 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:09:00.727240 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:09:00.727240 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:09:00.727240 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:09:00.727240 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:09:00.727240 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:09:00.727240 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 31 00:09:00.727240 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:09:00.727240 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:09:00.727240 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:09:00.727240 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:09:00.728935 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:09:00.728935 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:09:00.728935 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:09:00.728935 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:09:00.728935 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:09:00.728935 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:09:00.728935 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:09:00.728935 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:09:00.728935 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:09:00.728935 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:09:00.728935 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:09:00.728935 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 31 00:09:00.728935 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 568/1156] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Aug 31 00:09:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:09:00.734270 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3f6e07-87c9-4be2-992a-689528211e91 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:00.833625 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3f6e07-87c9-4be2-992a-689528211e91 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:00.850519 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:00.870315 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8e5722-f1d1-4721-ad0d-16105964ddaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:00.870926 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8e5722-f1d1-4721-ad0d-16105964ddaf None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:00.871206 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8e5722-f1d1-4721-ad0d-16105964ddaf None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:00.871477 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8e5722-f1d1-4721-ad0d-16105964ddaf None admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:00.872135 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8e5722-f1d1-4721-ad0d-16105964ddaf None admin] RBAC: Adding query filter params (name=admin) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:09:00.872468 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8e5722-f1d1-4721-ad0d-16105964ddaf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:00.873854 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8e5722-f1d1-4721-ad0d-16105964ddaf None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:00.881854 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 589/1157] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 31 00:09:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:09:00.887771 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b7b291-b46c-478a-8526-3d89ad1664a6 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:00.989749 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b7b291-b46c-478a-8526-3d89ad1664a6 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:01.004096 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:01.026652 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ea0c8b-21c6-443d-9964-2aaf5eec1eaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:01.027283 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ea0c8b-21c6-443d-9964-2aaf5eec1eaa None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:01.027560 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ea0c8b-21c6-443d-9964-2aaf5eec1eaa None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:01.027827 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ea0c8b-21c6-443d-9964-2aaf5eec1eaa None admin] PATH_INFO: `/v3/users/ba5c3e208ea443748564975162a0f78e` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:01.028972 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ea0c8b-21c6-443d-9964-2aaf5eec1eaa None admin] RBAC: Authorizing `identity:get_user(user_id=ba5c3e208ea443748564975162a0f78e)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:01.030403 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ea0c8b-21c6-443d-9964-2aaf5eec1eaa None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:01.031993 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 569/1158] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 31 00:09:00 2022] GET /identity/v3/users/ba5c3e208ea443748564975162a0f78e => generated 286 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:09:01.038248 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8e5722-f1d1-4721-ad0d-16105964ddaf None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:01.140580 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8e5722-f1d1-4721-ad0d-16105964ddaf None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:01.180647 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83695910-98c4-4cdc-96dd-27e04e9505a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:01.181333 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83695910-98c4-4cdc-96dd-27e04e9505a6 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:01.182304 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83695910-98c4-4cdc-96dd-27e04e9505a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:01.182596 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83695910-98c4-4cdc-96dd-27e04e9505a6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:01.235805 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:01.260772 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83695910-98c4-4cdc-96dd-27e04e9505a6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:01.262258 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83695910-98c4-4cdc-96dd-27e04e9505a6 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:01.366322 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 590/1159] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 31 00:09:01 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 00:09:01.372706 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ea0c8b-21c6-443d-9964-2aaf5eec1eaa None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:01.473021 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ea0c8b-21c6-443d-9964-2aaf5eec1eaa None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:01.506133 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7286cb73-6a87-4684-b924-f71ad5fc3d3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:01.506759 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7286cb73-6a87-4684-b924-f71ad5fc3d3b None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:01.507043 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7286cb73-6a87-4684-b924-f71ad5fc3d3b None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:01.507313 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7286cb73-6a87-4684-b924-f71ad5fc3d3b None admin] PATH_INFO: `/v3/projects/dca8adecb18e439fbf5ce3254926a672` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:01.508442 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7286cb73-6a87-4684-b924-f71ad5fc3d3b None admin] RBAC: Authorizing `identity:get_project(project_id=dca8adecb18e439fbf5ce3254926a672)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:01.510595 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7286cb73-6a87-4684-b924-f71ad5fc3d3b None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:01.512255 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 570/1160] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 31 00:09:01 2022] GET /identity/v3/projects/dca8adecb18e439fbf5ce3254926a672 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:09:01.518564 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83695910-98c4-4cdc-96dd-27e04e9505a6 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:01.605451 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:01.628457 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83695910-98c4-4cdc-96dd-27e04e9505a6 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:01.669009 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbcefec-b528-48ad-b211-322fa6631650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:01.669977 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbcefec-b528-48ad-b211-322fa6631650 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:01.670317 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbcefec-b528-48ad-b211-322fa6631650 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:01.670662 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbcefec-b528-48ad-b211-322fa6631650 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:01.671829 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbcefec-b528-48ad-b211-322fa6631650 None admin] RBAC: Adding query filter params (role.id=12f6817f9aaa4e2bb477095a6bed5d0f, scope.project.id=dca8adecb18e439fbf5ce3254926a672, user.id=ba5c3e208ea443748564975162a0f78e) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:09:01.672212 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbcefec-b528-48ad-b211-322fa6631650 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:01.674111 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbcefec-b528-48ad-b211-322fa6631650 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:01.682472 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 591/1161] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 31 00:09:01 2022] GET /identity/v3/role_assignments?user.id=ba5c3e208ea443748564975162a0f78e&scope.project.id=dca8adecb18e439fbf5ce3254926a672&role.id=12f6817f9aaa4e2bb477095a6bed5d0f => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:09:03.646292 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e78f595-4fcc-4694-b867-9a2ff1ff1174 None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:03.646829 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e78f595-4fcc-4694-b867-9a2ff1ff1174 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:03.646829 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e78f595-4fcc-4694-b867-9a2ff1ff1174 None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:03.648205 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 571/1162] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 00:09:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:09:03.654107 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc3de3f-62a2-4e36-84b9-840b996cab98 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:03.654555 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc3de3f-62a2-4e36-84b9-840b996cab98 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:03.654647 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc3de3f-62a2-4e36-84b9-840b996cab98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:03.673857 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-bfc3de3f-62a2-4e36-84b9-840b996cab98 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:09:03.675051 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-bfc3de3f-62a2-4e36-84b9-840b996cab98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:09:03.742627 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 592/1163] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 00:09:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:09:04.017286 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e78f595-4fcc-4694-b867-9a2ff1ff1174 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:04.068760 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:04.124644 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e78f595-4fcc-4694-b867-9a2ff1ff1174 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:04.159905 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64627a76-0be9-40d9-8cbf-d854c1e982a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:04.160567 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64627a76-0be9-40d9-8cbf-d854c1e982a5 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:04.160831 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64627a76-0be9-40d9-8cbf-d854c1e982a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:04.161110 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64627a76-0be9-40d9-8cbf-d854c1e982a5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:04.229445 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64627a76-0be9-40d9-8cbf-d854c1e982a5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:04.230905 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64627a76-0be9-40d9-8cbf-d854c1e982a5 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:04.280958 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:04.333391 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 572/1164] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 31 00:09:04 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 31 00:09:04.339421 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc3de3f-62a2-4e36-84b9-840b996cab98 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:04.409117 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:04.440639 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc3de3f-62a2-4e36-84b9-840b996cab98 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:04.473536 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506d91c2-f4c8-4326-b232-b7e4c824c894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:04.474178 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506d91c2-f4c8-4326-b232-b7e4c824c894 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:04.474444 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506d91c2-f4c8-4326-b232-b7e4c824c894 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:04.474750 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506d91c2-f4c8-4326-b232-b7e4c824c894 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:04.482483 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506d91c2-f4c8-4326-b232-b7e4c824c894 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:04.483924 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506d91c2-f4c8-4326-b232-b7e4c824c894 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:04.496868 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-506d91c2-f4c8-4326-b232-b7e4c824c894 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 31 00:09:04.496868 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:09:04.496868 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 31 00:09:04.496868 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 31 00:09:04.496868 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:09:04.496868 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:09:04.496868 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:09:04.496868 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:09:04.496868 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 31 00:09:04.496868 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Aug 31 00:09:04.496868 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 00:09:04.496868 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Aug 31 00:09:04.496868 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:09:04.496868 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:09:04.496868 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:09:04.496868 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:09:04.496868 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:09:04.498121 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:09:04.498121 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:09:04.498121 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:09:04.498121 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:09:04.498121 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:09:04.498121 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:09:04.498121 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:09:04.498121 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:09:04.498121 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:09:04.498121 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:09:04.498121 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:09:04.498121 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:09:04.498121 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:09:04.498121 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:09:04.498121 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:09:04.498121 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:09:04.499434 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:09:04.499434 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Aug 31 00:09:04.499434 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:09:04.499434 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:09:04.499434 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:09:04.499434 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:09:04.499434 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:09:04.499434 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:09:04.499434 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:09:04.499434 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:09:04.499434 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 31 00:09:04.499434 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:09:04.499434 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 31 00:09:04.499434 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Aug 31 00:09:04.499434 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 593/1165] 10.222.0.47 () {56 vars in 1117 bytes} [Wed Aug 31 00:09:04 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:09:04.504021 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64627a76-0be9-40d9-8cbf-d854c1e982a5 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:04.601675 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64627a76-0be9-40d9-8cbf-d854c1e982a5 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:04.636476 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b01c9aa-fb83-440a-bacc-507edd717ebe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:04.637076 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b01c9aa-fb83-440a-bacc-507edd717ebe None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:04.637349 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b01c9aa-fb83-440a-bacc-507edd717ebe None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:04.637615 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b01c9aa-fb83-440a-bacc-507edd717ebe None admin] PATH_INFO: `/v3/domains` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:04.638243 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b01c9aa-fb83-440a-bacc-507edd717ebe None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:09:04.638540 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b01c9aa-fb83-440a-bacc-507edd717ebe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:04.639906 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b01c9aa-fb83-440a-bacc-507edd717ebe None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:04.647050 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 573/1166] 10.222.0.47 () {56 vars in 1115 bytes} [Wed Aug 31 00:09:04 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:09:06.549563 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee1ac06-ac47-4121-a6a6-c97f4e26b91d None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:06.550132 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee1ac06-ac47-4121-a6a6-c97f4e26b91d None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:06.550132 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee1ac06-ac47-4121-a6a6-c97f4e26b91d None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:06.551458 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 594/1167] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 00:09:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:09:06.557392 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704f4ea4-2a02-46d2-be2a-51f80ef08347 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:06.557796 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704f4ea4-2a02-46d2-be2a-51f80ef08347 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:06.557940 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704f4ea4-2a02-46d2-be2a-51f80ef08347 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:06.576624 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-704f4ea4-2a02-46d2-be2a-51f80ef08347 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:09:06.577824 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-704f4ea4-2a02-46d2-be2a-51f80ef08347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:09:06.585230 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:06.646030 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 574/1168] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 00:09:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:09:06.914745 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee1ac06-ac47-4121-a6a6-c97f4e26b91d None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:07.017739 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee1ac06-ac47-4121-a6a6-c97f4e26b91d None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:07.047909 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:07.053255 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cbcb68-6b54-4ec4-9799-2fb0fda191a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:07.053861 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cbcb68-6b54-4ec4-9799-2fb0fda191a1 None admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:07.054143 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cbcb68-6b54-4ec4-9799-2fb0fda191a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:07.054419 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cbcb68-6b54-4ec4-9799-2fb0fda191a1 None admin] PATH_INFO: `/v3/domains` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:07.055087 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cbcb68-6b54-4ec4-9799-2fb0fda191a1 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:07.056708 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cbcb68-6b54-4ec4-9799-2fb0fda191a1 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:07.072808 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 595/1169] 10.222.0.47 () {60 vars in 1138 bytes} [Wed Aug 31 00:09:06 2022] POST /identity/v3/domains => generated 267 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:09:09.047461 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896c6f47-aabb-41eb-9188-b3d29a71c2c8 None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:09.047989 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896c6f47-aabb-41eb-9188-b3d29a71c2c8 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:09.047989 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896c6f47-aabb-41eb-9188-b3d29a71c2c8 None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:09.049390 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 575/1170] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 00:09:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:09:09.054852 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfed9d01-9dad-4d4d-a09f-4c84fdd7dfdf None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:09.055308 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfed9d01-9dad-4d4d-a09f-4c84fdd7dfdf None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:09.055434 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfed9d01-9dad-4d4d-a09f-4c84fdd7dfdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:09.073785 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-dfed9d01-9dad-4d4d-a09f-4c84fdd7dfdf None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:09:09.074965 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-dfed9d01-9dad-4d4d-a09f-4c84fdd7dfdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:09:09.147853 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 596/1171] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 00:09:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:09:09.417930 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896c6f47-aabb-41eb-9188-b3d29a71c2c8 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:09.529268 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896c6f47-aabb-41eb-9188-b3d29a71c2c8 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:09.569679 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb325083-45a1-4254-a6c4-9085e299702d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:09.570407 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb325083-45a1-4254-a6c4-9085e299702d None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:09.570610 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb325083-45a1-4254-a6c4-9085e299702d None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:09.570880 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb325083-45a1-4254-a6c4-9085e299702d None admin] PATH_INFO: `/v3/domains/81784029fed449f9ad75a06efa0677fa` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:09.581751 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb325083-45a1-4254-a6c4-9085e299702d None admin] RBAC: Authorizing `identity:get_domain(domain_id=81784029fed449f9ad75a06efa0677fa)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:09.583196 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb325083-45a1-4254-a6c4-9085e299702d None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:09.584829 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 576/1172] 10.222.0.47 () {56 vars in 1183 bytes} [Wed Aug 31 00:09:09 2022] GET /identity/v3/domains/81784029fed449f9ad75a06efa0677fa => generated 267 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:09:09.591782 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfed9d01-9dad-4d4d-a09f-4c84fdd7dfdf None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:09.690511 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfed9d01-9dad-4d4d-a09f-4c84fdd7dfdf None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:09.714171 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:09.726748 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b3d69d-e2f3-48c7-8c40-d3bf8fcd3aa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:09.727361 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b3d69d-e2f3-48c7-8c40-d3bf8fcd3aa9 None admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:09.727654 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b3d69d-e2f3-48c7-8c40-d3bf8fcd3aa9 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:09.727934 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b3d69d-e2f3-48c7-8c40-d3bf8fcd3aa9 None admin] PATH_INFO: `/v3/projects` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:09.728809 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b3d69d-e2f3-48c7-8c40-d3bf8fcd3aa9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:09.730261 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b3d69d-e2f3-48c7-8c40-d3bf8fcd3aa9 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:09.756135 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 597/1173] 10.222.0.47 () {60 vars in 1141 bytes} [Wed Aug 31 00:09:09 2022] POST /identity/v3/projects => generated 361 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:09:11.724838 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35da390e-158f-4c97-9ceb-598a0340b718 None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:11.725401 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35da390e-158f-4c97-9ceb-598a0340b718 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:11.725401 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35da390e-158f-4c97-9ceb-598a0340b718 None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:11.726744 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 577/1174] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 00:09:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:09:11.733057 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc4ff96-33b1-4774-9e3c-5766642c4750 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:11.733506 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc4ff96-33b1-4774-9e3c-5766642c4750 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:11.733611 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc4ff96-33b1-4774-9e3c-5766642c4750 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:11.753067 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-edc4ff96-33b1-4774-9e3c-5766642c4750 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:09:11.754254 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-edc4ff96-33b1-4774-9e3c-5766642c4750 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:09:11.820363 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 598/1175] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 00:09:11 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:09:12.093375 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35da390e-158f-4c97-9ceb-598a0340b718 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:12.096336 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:12.196731 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35da390e-158f-4c97-9ceb-598a0340b718 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:12.231196 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497c3877-3bd5-484c-9901-9c4ef658b182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:12.231817 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497c3877-3bd5-484c-9901-9c4ef658b182 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:12.232091 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497c3877-3bd5-484c-9901-9c4ef658b182 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:12.232382 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497c3877-3bd5-484c-9901-9c4ef658b182 None admin] PATH_INFO: `/v3/domains/81784029fed449f9ad75a06efa0677fa` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:12.233479 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497c3877-3bd5-484c-9901-9c4ef658b182 None admin] RBAC: Authorizing `identity:get_domain(domain_id=81784029fed449f9ad75a06efa0677fa)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:12.235012 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497c3877-3bd5-484c-9901-9c4ef658b182 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:12.236552 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 578/1176] 10.222.0.47 () {56 vars in 1183 bytes} [Wed Aug 31 00:09:12 2022] GET /identity/v3/domains/81784029fed449f9ad75a06efa0677fa => generated 267 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:09:12.242568 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc4ff96-33b1-4774-9e3c-5766642c4750 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:12.342173 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc4ff96-33b1-4774-9e3c-5766642c4750 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:12.344488 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:12.377882 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b87fc35-8601-424d-bc94-4b9730d11822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:12.378491 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b87fc35-8601-424d-bc94-4b9730d11822 None admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:12.378774 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b87fc35-8601-424d-bc94-4b9730d11822 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:12.379048 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b87fc35-8601-424d-bc94-4b9730d11822 None admin] PATH_INFO: `/v3/users` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:12.379706 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b87fc35-8601-424d-bc94-4b9730d11822 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:12.381166 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b87fc35-8601-424d-bc94-4b9730d11822 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:12.402796 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 599/1177] 10.222.0.47 () {60 vars in 1132 bytes} [Wed Aug 31 00:09:12 2022] POST /identity/v3/users => generated 311 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:09:14.419989 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1ded6b-a514-4c3e-bbb6-5d2642d4f3f5 None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:14.420596 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1ded6b-a514-4c3e-bbb6-5d2642d4f3f5 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:14.420596 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1ded6b-a514-4c3e-bbb6-5d2642d4f3f5 None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:14.421907 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 579/1178] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 00:09:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:09:14.427175 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29c7e53-0dc2-418e-9205-79b4581430d4 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:14.427592 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29c7e53-0dc2-418e-9205-79b4581430d4 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:14.427733 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29c7e53-0dc2-418e-9205-79b4581430d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:14.445979 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-a29c7e53-0dc2-418e-9205-79b4581430d4 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:09:14.447324 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-a29c7e53-0dc2-418e-9205-79b4581430d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:09:14.516255 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 600/1179] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 00:09:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:09:14.785972 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1ded6b-a514-4c3e-bbb6-5d2642d4f3f5 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:14.856592 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:14.890102 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1ded6b-a514-4c3e-bbb6-5d2642d4f3f5 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:14.924628 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc8b2a1-b494-42f4-ac4d-6c569215a2a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:14.925281 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc8b2a1-b494-42f4-ac4d-6c569215a2a1 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:14.925555 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc8b2a1-b494-42f4-ac4d-6c569215a2a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:14.925820 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc8b2a1-b494-42f4-ac4d-6c569215a2a1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:14.935940 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc8b2a1-b494-42f4-ac4d-6c569215a2a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:09:14.940782 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-cfc8b2a1-b494-42f4-ac4d-6c569215a2a1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:09:14.940782 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:09:14.940782 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:09:14.940782 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:09:14.940782 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:09:14.940782 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:09:14.940782 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:09:14.940782 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:09:14.940782 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:09:14.940782 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:09:14.940782 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:09:14.940782 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:09:14.940782 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:09:14.940782 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:09:14.940782 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:09:14.940782 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:09:14.941990 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:09:14.941990 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:09:14.941990 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:09:14.941990 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:09:14.941990 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:09:14.941990 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:09:14.941990 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:09:14.941990 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:09:14.941990 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:09:14.941990 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:09:14.941990 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:09:14.941990 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 31 00:09:14.941990 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:09:14.941990 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:09:14.941990 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:09:14.941990 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:09:14.943285 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:09:14.943285 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:09:14.943285 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:09:14.943285 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:09:14.943285 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:09:14.943285 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:09:14.943285 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:09:14.943285 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:09:14.943285 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:09:14.943285 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:09:14.943285 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:09:14.943285 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 31 00:09:14.943285 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 580/1180] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Aug 31 00:09:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:09:14.949093 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29c7e53-0dc2-418e-9205-79b4581430d4 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:15.039869 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:15.050890 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29c7e53-0dc2-418e-9205-79b4581430d4 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:15.085697 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff099c17-6c51-4081-914d-23e068e7b525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:15.086326 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff099c17-6c51-4081-914d-23e068e7b525 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:15.086597 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff099c17-6c51-4081-914d-23e068e7b525 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:15.086871 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff099c17-6c51-4081-914d-23e068e7b525 None admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:15.088122 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff099c17-6c51-4081-914d-23e068e7b525 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:09:15.088631 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff099c17-6c51-4081-914d-23e068e7b525 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:15.090005 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff099c17-6c51-4081-914d-23e068e7b525 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:15.098040 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 601/1181] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 31 00:09:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:09:15.104710 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc8b2a1-b494-42f4-ac4d-6c569215a2a1 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:15.205267 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc8b2a1-b494-42f4-ac4d-6c569215a2a1 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:15.235011 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:15.241178 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a915886-e637-42e2-be10-67db5aa498af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:15.241809 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a915886-e637-42e2-be10-67db5aa498af None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:15.242086 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a915886-e637-42e2-be10-67db5aa498af None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:15.242365 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a915886-e637-42e2-be10-67db5aa498af None admin] PATH_INFO: `/v3/users/2c38eaaf3e9f42df9f9de1f6645a624c` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:15.256489 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a915886-e637-42e2-be10-67db5aa498af None admin] RBAC: Authorizing `identity:get_user(user_id=2c38eaaf3e9f42df9f9de1f6645a624c)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:15.257946 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a915886-e637-42e2-be10-67db5aa498af None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:15.259627 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 581/1182] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 31 00:09:15 2022] GET /identity/v3/users/2c38eaaf3e9f42df9f9de1f6645a624c => generated 311 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:09:15.265892 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff099c17-6c51-4081-914d-23e068e7b525 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:15.369189 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff099c17-6c51-4081-914d-23e068e7b525 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:15.402210 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbecde3a-ea02-4f81-a972-ceae67e7c762 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:15.402811 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbecde3a-ea02-4f81-a972-ceae67e7c762 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:15.403089 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbecde3a-ea02-4f81-a972-ceae67e7c762 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:15.403358 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbecde3a-ea02-4f81-a972-ceae67e7c762 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:15.424661 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:15.470756 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbecde3a-ea02-4f81-a972-ceae67e7c762 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:15.472226 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbecde3a-ea02-4f81-a972-ceae67e7c762 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:15.570886 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 602/1183] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 31 00:09:15 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 00:09:15.577530 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a915886-e637-42e2-be10-67db5aa498af None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:15.681294 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a915886-e637-42e2-be10-67db5aa498af None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:15.716953 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f75f25-a048-4720-955e-fc0570535647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:15.717590 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f75f25-a048-4720-955e-fc0570535647 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:15.717871 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f75f25-a048-4720-955e-fc0570535647 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:15.718142 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f75f25-a048-4720-955e-fc0570535647 None admin] PATH_INFO: `/v3/projects/88057b215bfd47c29c8688468e6be6d6` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:15.719270 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f75f25-a048-4720-955e-fc0570535647 None admin] RBAC: Authorizing `identity:get_project(project_id=88057b215bfd47c29c8688468e6be6d6)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:15.720751 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f75f25-a048-4720-955e-fc0570535647 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:15.722406 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 582/1184] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 31 00:09:15 2022] GET /identity/v3/projects/88057b215bfd47c29c8688468e6be6d6 => generated 361 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:09:15.728871 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbecde3a-ea02-4f81-a972-ceae67e7c762 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:15.781483 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:15.827953 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbecde3a-ea02-4f81-a972-ceae67e7c762 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:15.861460 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8647031d-1b96-4f76-867a-c3e379636e9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:15.862059 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8647031d-1b96-4f76-867a-c3e379636e9e None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:15.862338 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8647031d-1b96-4f76-867a-c3e379636e9e None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:15.862611 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8647031d-1b96-4f76-867a-c3e379636e9e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:15.863338 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8647031d-1b96-4f76-867a-c3e379636e9e None admin] RBAC: Adding query filter params (role.id=12f6817f9aaa4e2bb477095a6bed5d0f, scope.project.id=88057b215bfd47c29c8688468e6be6d6, user.id=2c38eaaf3e9f42df9f9de1f6645a624c) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:09:15.863645 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8647031d-1b96-4f76-867a-c3e379636e9e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:15.865110 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8647031d-1b96-4f76-867a-c3e379636e9e None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:15.871037 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 603/1185] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 31 00:09:15 2022] GET /identity/v3/role_assignments?user.id=2c38eaaf3e9f42df9f9de1f6645a624c&scope.project.id=88057b215bfd47c29c8688468e6be6d6&role.id=12f6817f9aaa4e2bb477095a6bed5d0f => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:09:17.773745 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23558b1a-3039-45a0-baad-2f183c074527 None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:17.774314 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23558b1a-3039-45a0-baad-2f183c074527 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:17.774314 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23558b1a-3039-45a0-baad-2f183c074527 None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:17.776299 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 583/1186] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 00:09:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:09:17.781691 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e76c82-48ae-43ed-a3bf-055217c4243c None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:17.782126 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e76c82-48ae-43ed-a3bf-055217c4243c None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:17.782233 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e76c82-48ae-43ed-a3bf-055217c4243c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:17.800507 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-32e76c82-48ae-43ed-a3bf-055217c4243c None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:09:17.801703 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-32e76c82-48ae-43ed-a3bf-055217c4243c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:09:17.868303 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 604/1187] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 00:09:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 00:09:18.136685 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23558b1a-3039-45a0-baad-2f183c074527 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:18.195788 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:18.240980 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23558b1a-3039-45a0-baad-2f183c074527 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:18.275274 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7f49ea-7276-4161-a81d-6df7e2a25db1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:18.275983 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7f49ea-7276-4161-a81d-6df7e2a25db1 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:18.276297 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7f49ea-7276-4161-a81d-6df7e2a25db1 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:18.276575 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7f49ea-7276-4161-a81d-6df7e2a25db1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:18.286957 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7f49ea-7276-4161-a81d-6df7e2a25db1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:09:18.292568 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-be7f49ea-7276-4161-a81d-6df7e2a25db1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:09:18.292568 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:09:18.292568 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:09:18.292568 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:09:18.292568 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:09:18.292568 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:09:18.292568 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:09:18.292568 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:09:18.292568 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:09:18.292568 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:09:18.292568 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:09:18.292568 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:09:18.292568 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:09:18.292568 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:09:18.292568 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:09:18.292568 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:09:18.293785 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:09:18.293785 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:09:18.293785 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:09:18.293785 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:09:18.293785 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:09:18.293785 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:09:18.293785 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:09:18.293785 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:09:18.293785 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:09:18.293785 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:09:18.293785 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:09:18.293785 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 31 00:09:18.293785 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:09:18.293785 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:09:18.293785 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:09:18.293785 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:09:18.294839 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:09:18.294839 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:09:18.294839 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:09:18.294839 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:09:18.294839 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:09:18.294839 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:09:18.294839 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:09:18.294839 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:09:18.294839 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:09:18.294839 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:09:18.294839 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:09:18.294839 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 31 00:09:18.294839 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 584/1188] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Aug 31 00:09:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:09:18.299775 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e76c82-48ae-43ed-a3bf-055217c4243c None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:18.345120 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:18.398157 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e76c82-48ae-43ed-a3bf-055217c4243c None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:18.432805 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6e3860-c056-4e58-aeca-3122bf5a15d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:18.433405 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6e3860-c056-4e58-aeca-3122bf5a15d2 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:18.433682 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6e3860-c056-4e58-aeca-3122bf5a15d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:18.433951 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6e3860-c056-4e58-aeca-3122bf5a15d2 None admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:18.434604 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6e3860-c056-4e58-aeca-3122bf5a15d2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:09:18.434905 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6e3860-c056-4e58-aeca-3122bf5a15d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:18.436317 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6e3860-c056-4e58-aeca-3122bf5a15d2 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:18.444339 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 605/1189] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 31 00:09:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:09:18.450823 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7f49ea-7276-4161-a81d-6df7e2a25db1 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:18.553686 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7f49ea-7276-4161-a81d-6df7e2a25db1 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:18.570414 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:18.588662 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008604d1-5a44-477a-8a3f-3333225a3cce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:18.589287 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008604d1-5a44-477a-8a3f-3333225a3cce None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:18.589562 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008604d1-5a44-477a-8a3f-3333225a3cce None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:18.589836 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008604d1-5a44-477a-8a3f-3333225a3cce None admin] PATH_INFO: `/v3/users/2c38eaaf3e9f42df9f9de1f6645a624c` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:18.590946 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008604d1-5a44-477a-8a3f-3333225a3cce None admin] RBAC: Authorizing `identity:get_user(user_id=2c38eaaf3e9f42df9f9de1f6645a624c)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:18.592415 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008604d1-5a44-477a-8a3f-3333225a3cce None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:18.593997 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 585/1190] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 31 00:09:18 2022] GET /identity/v3/users/2c38eaaf3e9f42df9f9de1f6645a624c => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:09:18.599959 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6e3860-c056-4e58-aeca-3122bf5a15d2 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:18.700126 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6e3860-c056-4e58-aeca-3122bf5a15d2 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:18.709200 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:18.735540 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840fe71d-3543-47b3-b25b-0687e077248b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:18.736183 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840fe71d-3543-47b3-b25b-0687e077248b None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:18.736471 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840fe71d-3543-47b3-b25b-0687e077248b None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:18.736743 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840fe71d-3543-47b3-b25b-0687e077248b None admin] PATH_INFO: `/v3/projects/88057b215bfd47c29c8688468e6be6d6` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:18.737839 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840fe71d-3543-47b3-b25b-0687e077248b None admin] RBAC: Authorizing `identity:get_project(project_id=88057b215bfd47c29c8688468e6be6d6)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:18.739260 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840fe71d-3543-47b3-b25b-0687e077248b None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:18.740927 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 606/1191] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 31 00:09:18 2022] GET /identity/v3/projects/88057b215bfd47c29c8688468e6be6d6 => generated 361 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:09:18.747744 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008604d1-5a44-477a-8a3f-3333225a3cce None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:18.847939 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008604d1-5a44-477a-8a3f-3333225a3cce None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:18.882229 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ab939a-2776-44cd-88f7-c4f7ee6f82cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:18.882881 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ab939a-2776-44cd-88f7-c4f7ee6f82cf None admin] REQUEST_METHOD: `PUT` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:18.883156 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ab939a-2776-44cd-88f7-c4f7ee6f82cf None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:18.883424 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ab939a-2776-44cd-88f7-c4f7ee6f82cf None admin] PATH_INFO: `/v3/projects/88057b215bfd47c29c8688468e6be6d6/users/2c38eaaf3e9f42df9f9de1f6645a624c/roles/12f6817f9aaa4e2bb477095a6bed5d0f` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:18.886095 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ab939a-2776-44cd-88f7-c4f7ee6f82cf None admin] RBAC: Authorizing `identity:create_grant(project_id=88057b215bfd47c29c8688468e6be6d6, user_id=2c38eaaf3e9f42df9f9de1f6645a624c, role_id=12f6817f9aaa4e2bb477095a6bed5d0f)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:18.887527 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ab939a-2776-44cd-88f7-c4f7ee6f82cf None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:18.901428 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 586/1192] 10.222.0.47 () {58 vars in 1439 bytes} [Wed Aug 31 00:09:18 2022] PUT /identity/v3/projects/88057b215bfd47c29c8688468e6be6d6/users/2c38eaaf3e9f42df9f9de1f6645a624c/roles/12f6817f9aaa4e2bb477095a6bed5d0f => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:09:20.880892 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3315a5ea-5cf5-4371-89f7-e1d95c747123 None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:20.881458 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3315a5ea-5cf5-4371-89f7-e1d95c747123 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:20.881458 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3315a5ea-5cf5-4371-89f7-e1d95c747123 None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:20.882775 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 607/1193] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 00:09:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:09:20.889320 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3d7b80-abd7-4dee-b20e-d949c09f6d8c None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:20.889809 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3d7b80-abd7-4dee-b20e-d949c09f6d8c None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:20.889941 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3d7b80-abd7-4dee-b20e-d949c09f6d8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:20.911732 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-ce3d7b80-abd7-4dee-b20e-d949c09f6d8c None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:09:20.912974 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-ce3d7b80-abd7-4dee-b20e-d949c09f6d8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:09:20.968177 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:20.997524 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 587/1194] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 00:09:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:09:21.271481 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3315a5ea-5cf5-4371-89f7-e1d95c747123 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:21.390708 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3315a5ea-5cf5-4371-89f7-e1d95c747123 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:21.426402 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067b9305-dc7b-4c43-8bea-00634ce0dffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:21.427486 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067b9305-dc7b-4c43-8bea-00634ce0dffc None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:21.427961 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067b9305-dc7b-4c43-8bea-00634ce0dffc None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:21.428454 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067b9305-dc7b-4c43-8bea-00634ce0dffc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:21.441110 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067b9305-dc7b-4c43-8bea-00634ce0dffc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:09:21.446045 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-067b9305-dc7b-4c43-8bea-00634ce0dffc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:09:21.446045 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:09:21.446045 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:09:21.446045 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:09:21.446045 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:09:21.446045 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:09:21.446045 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:09:21.446045 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:09:21.446045 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:09:21.446045 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:09:21.446045 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:09:21.446045 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:09:21.446045 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:09:21.446045 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:09:21.446045 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:09:21.446045 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:09:21.447802 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:09:21.447802 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:09:21.447802 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:09:21.447802 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:09:21.447802 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:09:21.447802 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:09:21.447802 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:09:21.447802 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:09:21.447802 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:09:21.447802 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:09:21.447802 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:09:21.447802 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Aug 31 00:09:21.447802 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:09:21.447802 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:09:21.447802 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:09:21.447802 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:09:21.449128 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:09:21.449128 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:09:21.449128 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:09:21.449128 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:09:21.449128 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:09:21.449128 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:09:21.449128 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:09:21.449128 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:09:21.449128 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:09:21.449128 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:09:21.449128 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:09:21.449128 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Aug 31 00:09:21.449128 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 608/1195] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Aug 31 00:09:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:09:21.454270 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3d7b80-abd7-4dee-b20e-d949c09f6d8c None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:21.568314 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3d7b80-abd7-4dee-b20e-d949c09f6d8c None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:21.602055 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d465817-786d-4b6d-9a6f-03da552715b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:21.602657 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d465817-786d-4b6d-9a6f-03da552715b9 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:21.603461 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d465817-786d-4b6d-9a6f-03da552715b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:21.603724 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d465817-786d-4b6d-9a6f-03da552715b9 None admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:21.604405 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d465817-786d-4b6d-9a6f-03da552715b9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:09:21.604702 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d465817-786d-4b6d-9a6f-03da552715b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:21.606063 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d465817-786d-4b6d-9a6f-03da552715b9 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:21.614026 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 588/1196] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 31 00:09:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:09:21.620562 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067b9305-dc7b-4c43-8bea-00634ce0dffc None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:21.656013 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:21.722048 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067b9305-dc7b-4c43-8bea-00634ce0dffc None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:21.756776 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a14978-eaa1-4793-b44e-37415c0dd2c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:21.757407 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a14978-eaa1-4793-b44e-37415c0dd2c7 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:21.757686 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a14978-eaa1-4793-b44e-37415c0dd2c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:21.757960 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a14978-eaa1-4793-b44e-37415c0dd2c7 None admin] PATH_INFO: `/v3/users/2c38eaaf3e9f42df9f9de1f6645a624c` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:21.759094 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a14978-eaa1-4793-b44e-37415c0dd2c7 None admin] RBAC: Authorizing `identity:get_user(user_id=2c38eaaf3e9f42df9f9de1f6645a624c)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:21.760678 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a14978-eaa1-4793-b44e-37415c0dd2c7 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:21.762261 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 609/1197] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 31 00:09:21 2022] GET /identity/v3/users/2c38eaaf3e9f42df9f9de1f6645a624c => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:09:21.768322 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d465817-786d-4b6d-9a6f-03da552715b9 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:21.804658 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:21.872636 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d465817-786d-4b6d-9a6f-03da552715b9 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:21.914495 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3094c5b-3105-4cca-97b5-2fbd58a23b81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:21.915199 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3094c5b-3105-4cca-97b5-2fbd58a23b81 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:21.915957 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3094c5b-3105-4cca-97b5-2fbd58a23b81 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:21.916659 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3094c5b-3105-4cca-97b5-2fbd58a23b81 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:21.987180 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3094c5b-3105-4cca-97b5-2fbd58a23b81 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:21.988677 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3094c5b-3105-4cca-97b5-2fbd58a23b81 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:22.024607 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:22.092410 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 589/1198] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 31 00:09:21 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 00:09:22.098641 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a14978-eaa1-4793-b44e-37415c0dd2c7 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:22.208719 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a14978-eaa1-4793-b44e-37415c0dd2c7 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:22.211248 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:22.246088 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593c3e8c-7c1b-4e56-87aa-f4e115400a42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:22.246740 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593c3e8c-7c1b-4e56-87aa-f4e115400a42 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:22.247023 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593c3e8c-7c1b-4e56-87aa-f4e115400a42 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:22.247300 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593c3e8c-7c1b-4e56-87aa-f4e115400a42 None admin] PATH_INFO: `/v3/projects/88057b215bfd47c29c8688468e6be6d6` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:22.248499 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593c3e8c-7c1b-4e56-87aa-f4e115400a42 None admin] RBAC: Authorizing `identity:get_project(project_id=88057b215bfd47c29c8688468e6be6d6)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:22.249961 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593c3e8c-7c1b-4e56-87aa-f4e115400a42 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:22.251732 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 610/1199] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 31 00:09:22 2022] GET /identity/v3/projects/88057b215bfd47c29c8688468e6be6d6 => generated 361 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:09:22.258061 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3094c5b-3105-4cca-97b5-2fbd58a23b81 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:09:22.369429 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3094c5b-3105-4cca-97b5-2fbd58a23b81 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:09:22.404664 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b94fe2c-8129-437b-bca0-c541ef821aa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:09:22.405278 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b94fe2c-8129-437b-bca0-c541ef821aa8 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:09:22.405560 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b94fe2c-8129-437b-bca0-c541ef821aa8 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:09:22.405832 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b94fe2c-8129-437b-bca0-c541ef821aa8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:09:22.406561 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b94fe2c-8129-437b-bca0-c541ef821aa8 None admin] RBAC: Adding query filter params (role.id=12f6817f9aaa4e2bb477095a6bed5d0f, scope.project.id=88057b215bfd47c29c8688468e6be6d6, user.id=2c38eaaf3e9f42df9f9de1f6645a624c) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:09:22.406875 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b94fe2c-8129-437b-bca0-c541ef821aa8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:09:22.408346 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b94fe2c-8129-437b-bca0-c541ef821aa8 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:09:22.411465 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:09:22.415416 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 590/1200] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 31 00:09:22 2022] GET /identity/v3/role_assignments?user.id=2c38eaaf3e9f42df9f9de1f6645a624c&scope.project.id=88057b215bfd47c29c8688468e6be6d6&role.id=12f6817f9aaa4e2bb477095a6bed5d0f => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:09:32.241854 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=14 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:10:19.889307 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42552d04-9a10-46cf-9717-dbb030c0b5d4 None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:10:19.890038 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42552d04-9a10-46cf-9717-dbb030c0b5d4 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:10:19.890038 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42552d04-9a10-46cf-9717-dbb030c0b5d4 None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:10:19.891471 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 611/1201] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 00:10:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:10:19.897865 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591059e6-b5c5-4f18-840d-2d4d5e3ddbe0 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:10:19.898524 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591059e6-b5c5-4f18-840d-2d4d5e3ddbe0 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:10:19.898524 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591059e6-b5c5-4f18-840d-2d4d5e3ddbe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:10:19.925929 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-591059e6-b5c5-4f18-840d-2d4d5e3ddbe0 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:10:19.927185 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-591059e6-b5c5-4f18-840d-2d4d5e3ddbe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:10:20.036197 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 591/1202] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 00:10:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:10:20.325693 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42552d04-9a10-46cf-9717-dbb030c0b5d4 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:10:20.484223 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42552d04-9a10-46cf-9717-dbb030c0b5d4 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:10:20.562309 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498ee53e-9bd6-4c22-b095-67ba0d06ab98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:10:20.563902 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498ee53e-9bd6-4c22-b095-67ba0d06ab98 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:10:20.564588 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498ee53e-9bd6-4c22-b095-67ba0d06ab98 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:10:20.565213 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498ee53e-9bd6-4c22-b095-67ba0d06ab98 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:10:20.586193 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498ee53e-9bd6-4c22-b095-67ba0d06ab98 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:10:20.589286 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498ee53e-9bd6-4c22-b095-67ba0d06ab98 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:10:20.625633 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-498ee53e-9bd6-4c22-b095-67ba0d06ab98 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:10:20.625633 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:10:20.625633 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:10:20.625633 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:10:20.625633 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:10:20.625633 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:10:20.625633 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:10:20.625633 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:10:20.625633 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:10:20.625633 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:10:20.625633 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:10:20.625633 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:10:20.625633 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:10:20.625633 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:10:20.625633 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:10:20.625633 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:10:20.627736 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:10:20.627736 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:10:20.627736 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:10:20.627736 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:10:20.627736 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:10:20.627736 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:10:20.627736 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:10:20.627736 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Aug 31 00:10:20.627736 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:10:20.627736 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:10:20.627736 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:10:20.627736 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:10:20.627736 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:10:20.627736 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:10:20.627736 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:10:20.627736 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:10:20.627736 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:10:20.634219 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:10:20.634219 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:10:20.634219 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Aug 31 00:10:20.634219 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 612/1203] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 00:10:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:10:20.643056 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591059e6-b5c5-4f18-840d-2d4d5e3ddbe0 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:10:20.804457 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591059e6-b5c5-4f18-840d-2d4d5e3ddbe0 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:10:20.845956 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:10:20.864546 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b2ed39-d924-4086-b3a8-f11638ad4c6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:10:20.865547 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b2ed39-d924-4086-b3a8-f11638ad4c6d None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:10:20.866455 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b2ed39-d924-4086-b3a8-f11638ad4c6d None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:10:20.867005 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b2ed39-d924-4086-b3a8-f11638ad4c6d None admin] PATH_INFO: `/v3/domains` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:10:20.868900 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b2ed39-d924-4086-b3a8-f11638ad4c6d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:10:20.869553 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b2ed39-d924-4086-b3a8-f11638ad4c6d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:10:20.871290 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b2ed39-d924-4086-b3a8-f11638ad4c6d None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:10:20.884957 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 592/1204] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 31 00:10:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:10:20.891661 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498ee53e-9bd6-4c22-b095-67ba0d06ab98 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:10:20.963592 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:10:21.022433 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498ee53e-9bd6-4c22-b095-67ba0d06ab98 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:10:21.087756 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78537074-1400-4db4-8b2e-3b417faf0635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:10:21.087756 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78537074-1400-4db4-8b2e-3b417faf0635 None admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:10:21.087756 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78537074-1400-4db4-8b2e-3b417faf0635 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:10:21.087756 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78537074-1400-4db4-8b2e-3b417faf0635 None admin] PATH_INFO: `/v3/users` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:10:21.088366 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78537074-1400-4db4-8b2e-3b417faf0635 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:10:21.088366 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78537074-1400-4db4-8b2e-3b417faf0635 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:10:21.120278 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 613/1205] 10.222.0.47 () {60 vars in 1132 bytes} [Wed Aug 31 00:10:20 2022] POST /identity/v3/users => generated 251 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:10:23.224705 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e188ffc-c9c7-4ec8-a915-64b5cfd0c0b7 None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:10:23.225260 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e188ffc-c9c7-4ec8-a915-64b5cfd0c0b7 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:10:23.225260 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e188ffc-c9c7-4ec8-a915-64b5cfd0c0b7 None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:10:23.226576 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 593/1206] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 00:10:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 00:10:23.233299 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0b70b0-34b4-4f69-a33d-6c57421e865b None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:10:23.233816 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0b70b0-34b4-4f69-a33d-6c57421e865b None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:10:23.233898 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0b70b0-34b4-4f69-a33d-6c57421e865b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:10:23.272474 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-7b0b70b0-34b4-4f69-a33d-6c57421e865b None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:10:23.273788 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-7b0b70b0-34b4-4f69-a33d-6c57421e865b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:10:23.370771 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 614/1207] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 00:10:23 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:10:23.675205 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e188ffc-c9c7-4ec8-a915-64b5cfd0c0b7 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:10:23.844976 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e188ffc-c9c7-4ec8-a915-64b5cfd0c0b7 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:10:23.893117 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8352c3-3e51-4874-8404-a5374e3dcc32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:10:23.893997 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8352c3-3e51-4874-8404-a5374e3dcc32 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:10:23.894470 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8352c3-3e51-4874-8404-a5374e3dcc32 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:10:23.894752 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8352c3-3e51-4874-8404-a5374e3dcc32 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:10:23.915937 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8352c3-3e51-4874-8404-a5374e3dcc32 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:10:23.921820 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-5b8352c3-3e51-4874-8404-a5374e3dcc32 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:10:23.921820 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:10:23.921820 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:10:23.921820 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:10:23.921820 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:10:23.921820 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:10:23.921820 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:10:23.921820 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:10:23.921820 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:10:23.921820 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:10:23.921820 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:10:23.921820 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:10:23.921820 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:10:23.921820 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:10:23.921820 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:10:23.921820 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:10:23.923658 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:10:23.923658 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:10:23.923658 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:10:23.923658 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:10:23.923658 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:10:23.923658 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:10:23.923658 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:10:23.923658 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:10:23.923658 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:10:23.923658 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:10:23.923658 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:10:23.923658 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 31 00:10:23.923658 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:10:23.923658 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:10:23.923658 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:10:23.923658 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:10:23.925318 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:10:23.925318 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:10:23.925318 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:10:23.925318 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:10:23.925318 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:10:23.925318 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:10:23.925318 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:10:23.925318 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:10:23.925318 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:10:23.925318 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:10:23.925318 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:10:23.925318 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 31 00:10:23.925318 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 594/1208] 10.222.0.47 () {56 vars in 1102 bytes} [Wed Aug 31 00:10:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:10:23.930182 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0b70b0-34b4-4f69-a33d-6c57421e865b None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:10:23.994600 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:10:24.081090 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0b70b0-34b4-4f69-a33d-6c57421e865b None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:10:24.158543 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6633dafd-2558-49fc-afdd-597853f4b091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:10:24.160437 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6633dafd-2558-49fc-afdd-597853f4b091 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:10:24.160437 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6633dafd-2558-49fc-afdd-597853f4b091 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:10:24.160755 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6633dafd-2558-49fc-afdd-597853f4b091 None admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:10:24.161702 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6633dafd-2558-49fc-afdd-597853f4b091 None admin] RBAC: Adding query filter params (name=service) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:10:24.162358 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6633dafd-2558-49fc-afdd-597853f4b091 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:10:24.166418 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6633dafd-2558-49fc-afdd-597853f4b091 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:10:24.183312 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 615/1209] 10.222.0.47 () {56 vars in 1103 bytes} [Wed Aug 31 00:10:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:10:24.185063 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8352c3-3e51-4874-8404-a5374e3dcc32 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:10:24.292012 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:10:24.368610 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8352c3-3e51-4874-8404-a5374e3dcc32 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:10:24.416482 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedb895a-a3fd-4acd-99c1-1d4703326c65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:10:24.417189 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedb895a-a3fd-4acd-99c1-1d4703326c65 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:10:24.417474 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedb895a-a3fd-4acd-99c1-1d4703326c65 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:10:24.417790 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedb895a-a3fd-4acd-99c1-1d4703326c65 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:10:24.434455 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedb895a-a3fd-4acd-99c1-1d4703326c65 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:10:24.435482 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedb895a-a3fd-4acd-99c1-1d4703326c65 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:10:24.456013 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-eedb895a-a3fd-4acd-99c1-1d4703326c65 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:10:24.456013 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:10:24.456013 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:10:24.456013 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:10:24.456013 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:10:24.456013 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:10:24.456013 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:10:24.456013 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:10:24.456013 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:10:24.456013 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:10:24.456013 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:10:24.456013 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:10:24.456013 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:10:24.456013 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:10:24.456013 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:10:24.456013 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:10:24.458782 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:10:24.458782 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:10:24.458782 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:10:24.458782 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:10:24.458782 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:10:24.458782 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:10:24.458782 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:10:24.458782 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 31 00:10:24.458782 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:10:24.458782 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:10:24.458782 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:10:24.458782 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:10:24.458782 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:10:24.458782 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:10:24.458782 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:10:24.458782 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:10:24.458782 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:10:24.469957 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:10:24.469957 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:10:24.469957 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 31 00:10:24.469957 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 595/1210] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 00:10:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:10:24.470805 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6633dafd-2558-49fc-afdd-597853f4b091 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:10:24.626502 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:10:24.636196 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6633dafd-2558-49fc-afdd-597853f4b091 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:10:24.678714 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cba303d-26eb-4065-8441-615e06fe61a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:10:24.678714 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cba303d-26eb-4065-8441-615e06fe61a1 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:10:24.678714 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cba303d-26eb-4065-8441-615e06fe61a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:10:24.678714 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cba303d-26eb-4065-8441-615e06fe61a1 None admin] PATH_INFO: `/v3/domains` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:10:24.679181 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cba303d-26eb-4065-8441-615e06fe61a1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:10:24.679181 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cba303d-26eb-4065-8441-615e06fe61a1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:10:24.680054 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cba303d-26eb-4065-8441-615e06fe61a1 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:10:24.696595 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 616/1211] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 31 00:10:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:10:24.702395 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedb895a-a3fd-4acd-99c1-1d4703326c65 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:10:24.851034 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedb895a-a3fd-4acd-99c1-1d4703326c65 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:10:24.854212 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:10:24.901661 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68fee57-dbf9-4d79-ba5a-061375d6b483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:10:24.902468 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68fee57-dbf9-4d79-ba5a-061375d6b483 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:10:24.902730 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68fee57-dbf9-4d79-ba5a-061375d6b483 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:10:24.903075 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68fee57-dbf9-4d79-ba5a-061375d6b483 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:10:24.913524 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68fee57-dbf9-4d79-ba5a-061375d6b483 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:10:24.914805 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68fee57-dbf9-4d79-ba5a-061375d6b483 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:10:24.927801 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-a68fee57-dbf9-4d79-ba5a-061375d6b483 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 31 00:10:24.927801 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:10:24.927801 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:10:24.927801 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:10:24.927801 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:10:24.927801 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:10:24.927801 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:10:24.927801 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:10:24.927801 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:10:24.927801 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:10:24.927801 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:10:24.927801 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:10:24.927801 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 00:10:24.927801 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 00:10:24.927801 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 00:10:24.927801 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 00:10:24.928986 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:10:24.928986 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:10:24.928986 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:10:24.928986 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:10:24.928986 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:10:24.928986 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:10:24.928986 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:10:24.928986 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:10:24.928986 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:10:24.928986 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:10:24.928986 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:10:24.928986 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 31 00:10:24.928986 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:10:24.928986 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:10:24.928986 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:10:24.928986 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:10:24.928986 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:10:24.928986 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:10:24.929994 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:10:24.929994 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:10:24.929994 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 00:10:24.929994 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 00:10:24.929994 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 00:10:24.929994 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 00:10:24.929994 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 00:10:24.929994 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 00:10:24.929994 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 31 00:10:24.929994 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 31 00:10:24.929994 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 596/1212] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 00:10:24 2022] GET /identity/v3/users/placement => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:10:24.936837 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cba303d-26eb-4065-8441-615e06fe61a1 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:10:25.068706 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cba303d-26eb-4065-8441-615e06fe61a1 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:10:25.112276 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dc9a38-d050-46af-a522-2a92f742fc3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:10:25.112946 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dc9a38-d050-46af-a522-2a92f742fc3e None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:10:25.113239 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dc9a38-d050-46af-a522-2a92f742fc3e None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:10:25.113506 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dc9a38-d050-46af-a522-2a92f742fc3e None admin] PATH_INFO: `/v3/users` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:10:25.114289 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dc9a38-d050-46af-a522-2a92f742fc3e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:10:25.114686 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dc9a38-d050-46af-a522-2a92f742fc3e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:10:25.116210 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dc9a38-d050-46af-a522-2a92f742fc3e None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:10:25.140198 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 617/1213] 10.222.0.47 () {56 vars in 1143 bytes} [Wed Aug 31 00:10:24 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:10:25.146622 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68fee57-dbf9-4d79-ba5a-061375d6b483 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:10:25.277338 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68fee57-dbf9-4d79-ba5a-061375d6b483 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:10:25.319089 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b878c7f-43fe-4929-bd60-9ec17baf8f9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:10:25.320570 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b878c7f-43fe-4929-bd60-9ec17baf8f9d None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:10:25.321153 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b878c7f-43fe-4929-bd60-9ec17baf8f9d None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:10:25.321845 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b878c7f-43fe-4929-bd60-9ec17baf8f9d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:10:25.357116 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:10:25.405044 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b878c7f-43fe-4929-bd60-9ec17baf8f9d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:10:25.406508 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b878c7f-43fe-4929-bd60-9ec17baf8f9d None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:10:25.549067 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 597/1214] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 31 00:10:25 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 00:10:25.557983 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dc9a38-d050-46af-a522-2a92f742fc3e None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:10:25.590454 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:10:25.730384 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dc9a38-d050-46af-a522-2a92f742fc3e None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:10:25.772121 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e77418-f73c-4eeb-9114-0b06f8cf40d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:10:25.772798 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e77418-f73c-4eeb-9114-0b06f8cf40d6 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:10:25.773077 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e77418-f73c-4eeb-9114-0b06f8cf40d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:10:25.773350 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e77418-f73c-4eeb-9114-0b06f8cf40d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:10:25.786525 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e77418-f73c-4eeb-9114-0b06f8cf40d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:10:25.788049 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e77418-f73c-4eeb-9114-0b06f8cf40d6 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:10:25.806940 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-f6e77418-f73c-4eeb-9114-0b06f8cf40d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:10:25.806940 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:10:25.806940 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:10:25.806940 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:10:25.806940 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:10:25.806940 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:10:25.806940 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:10:25.806940 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:10:25.806940 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:10:25.806940 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:10:25.806940 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:10:25.806940 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:10:25.806940 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:10:25.806940 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:10:25.806940 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:10:25.806940 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:10:25.807979 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:10:25.807979 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:10:25.807979 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:10:25.807979 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:10:25.807979 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:10:25.807979 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:10:25.807979 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:10:25.807979 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Aug 31 00:10:25.807979 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:10:25.807979 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:10:25.807979 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:10:25.807979 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:10:25.807979 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:10:25.807979 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:10:25.807979 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:10:25.807979 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:10:25.807979 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:10:25.809041 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:10:25.809041 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:10:25.809041 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Aug 31 00:10:25.812839 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 618/1215] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 00:10:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:10:25.814172 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b878c7f-43fe-4929-bd60-9ec17baf8f9d None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:10:25.913177 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:10:25.980064 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b878c7f-43fe-4929-bd60-9ec17baf8f9d None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:10:26.029506 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3379f901-8635-4d12-9a52-0d3e51092500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:10:26.030140 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3379f901-8635-4d12-9a52-0d3e51092500 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:10:26.030417 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3379f901-8635-4d12-9a52-0d3e51092500 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:10:26.030771 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3379f901-8635-4d12-9a52-0d3e51092500 None admin] PATH_INFO: `/v3/domains` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:10:26.031366 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3379f901-8635-4d12-9a52-0d3e51092500 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:10:26.031676 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3379f901-8635-4d12-9a52-0d3e51092500 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:10:26.033121 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3379f901-8635-4d12-9a52-0d3e51092500 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:10:26.049131 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 598/1216] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 31 00:10:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:10:26.054968 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e77418-f73c-4eeb-9114-0b06f8cf40d6 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:10:26.137643 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:10:26.176533 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e77418-f73c-4eeb-9114-0b06f8cf40d6 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:10:26.225197 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d328fb7-88f9-4211-8bba-17918914577a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:10:26.225847 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d328fb7-88f9-4211-8bba-17918914577a None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:10:26.226182 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d328fb7-88f9-4211-8bba-17918914577a None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:10:26.226464 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d328fb7-88f9-4211-8bba-17918914577a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:10:26.234331 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d328fb7-88f9-4211-8bba-17918914577a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:10:26.236011 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d328fb7-88f9-4211-8bba-17918914577a None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:10:26.249018 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-8d328fb7-88f9-4211-8bba-17918914577a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:10:26.249018 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:10:26.249018 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:10:26.249018 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:10:26.249018 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:10:26.249018 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:10:26.249018 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:10:26.249018 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:10:26.249018 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:10:26.249018 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:10:26.249018 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:10:26.249018 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:10:26.249018 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 00:10:26.249018 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 00:10:26.249018 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 00:10:26.250244 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 00:10:26.250244 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:10:26.250244 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:10:26.250244 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:10:26.250244 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:10:26.250244 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:10:26.250244 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:10:26.250244 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:10:26.250244 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Aug 31 00:10:26.250244 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:10:26.250244 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:10:26.250244 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:10:26.250244 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:10:26.250244 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:10:26.250244 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:10:26.250244 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:10:26.250244 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:10:26.251243 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 00:10:26.251243 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 00:10:26.251243 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:10:26.251243 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:10:26.251243 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:10:26.251243 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:10:26.251243 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:10:26.251243 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Aug 31 00:10:26.251243 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 619/1217] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 31 00:10:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:10:26.256290 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3379f901-8635-4d12-9a52-0d3e51092500 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:10:26.365003 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3379f901-8635-4d12-9a52-0d3e51092500 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:10:26.392462 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:10:26.408209 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807e44a3-90af-4dd3-be9c-f4ca729be42d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:10:26.408846 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807e44a3-90af-4dd3-be9c-f4ca729be42d None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:10:26.409181 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807e44a3-90af-4dd3-be9c-f4ca729be42d None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:10:26.409426 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807e44a3-90af-4dd3-be9c-f4ca729be42d None admin] PATH_INFO: `/v3/projects` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:10:26.410587 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807e44a3-90af-4dd3-be9c-f4ca729be42d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:10:26.410985 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807e44a3-90af-4dd3-be9c-f4ca729be42d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:10:26.412630 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807e44a3-90af-4dd3-be9c-f4ca729be42d None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:10:26.425872 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 599/1218] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Aug 31 00:10:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:10:26.433029 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d328fb7-88f9-4211-8bba-17918914577a None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:10:26.561390 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d328fb7-88f9-4211-8bba-17918914577a None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:10:26.599184 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:10:26.607356 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9961747-da76-4273-8317-64ce992c26b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:10:26.607964 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9961747-da76-4273-8317-64ce992c26b3 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:10:26.608332 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9961747-da76-4273-8317-64ce992c26b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:10:26.608624 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9961747-da76-4273-8317-64ce992c26b3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:10:26.611588 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9961747-da76-4273-8317-64ce992c26b3 None admin] RBAC: Adding query filter params (role.id=1e6d7ecde4b0415bb944f25eda475f9c, scope.project.id=1b647cccb30a427193fc62dbebe0c6f1, user.id=8f76e01e32264ff7a6a7740ffa0a207d) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:10:26.611588 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9961747-da76-4273-8317-64ce992c26b3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:10:26.612092 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9961747-da76-4273-8317-64ce992c26b3 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:10:26.624185 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 620/1219] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 31 00:10:26 2022] GET /identity/v3/role_assignments?user.id=8f76e01e32264ff7a6a7740ffa0a207d&scope.project.id=1b647cccb30a427193fc62dbebe0c6f1&role.id=1e6d7ecde4b0415bb944f25eda475f9c => generated 259 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:10:28.817949 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10f0a8c-ffb5-4803-b7f3-b05f1404c332 None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:10:28.818525 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10f0a8c-ffb5-4803-b7f3-b05f1404c332 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:10:28.818525 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10f0a8c-ffb5-4803-b7f3-b05f1404c332 None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:10:28.820146 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 600/1220] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 00:10:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:10:28.826589 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13279ce5-a1f4-4361-af8c-f10190511c63 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:10:28.827136 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13279ce5-a1f4-4361-af8c-f10190511c63 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:10:28.827136 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13279ce5-a1f4-4361-af8c-f10190511c63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:10:28.846142 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-13279ce5-a1f4-4361-af8c-f10190511c63 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:10:28.847347 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-13279ce5-a1f4-4361-af8c-f10190511c63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:10:28.924913 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 621/1221] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 00:10:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:10:29.197876 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10f0a8c-ffb5-4803-b7f3-b05f1404c332 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:10:29.307383 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10f0a8c-ffb5-4803-b7f3-b05f1404c332 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:10:29.343594 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20ab2b2-8fdd-425b-9d90-2b3449dd93aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:10:29.345267 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20ab2b2-8fdd-425b-9d90-2b3449dd93aa None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:10:29.345560 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20ab2b2-8fdd-425b-9d90-2b3449dd93aa None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:10:29.345833 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20ab2b2-8fdd-425b-9d90-2b3449dd93aa None admin] PATH_INFO: `/v3/roles/service` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:10:29.358064 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20ab2b2-8fdd-425b-9d90-2b3449dd93aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:10:29.363055 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-a20ab2b2-8fdd-425b-9d90-2b3449dd93aa None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:10:29.363055 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:10:29.363055 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:10:29.363055 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:10:29.363055 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:10:29.363055 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:10:29.363055 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:10:29.363055 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:10:29.363055 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:10:29.363055 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:10:29.363055 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:10:29.363055 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:10:29.363055 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:10:29.363055 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:10:29.363055 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:10:29.363055 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:10:29.364297 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:10:29.364297 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:10:29.364297 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:10:29.364297 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:10:29.364297 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:10:29.364297 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:10:29.364297 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:10:29.364297 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:10:29.364297 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:10:29.364297 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:10:29.364297 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:10:29.364297 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 31 00:10:29.364297 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:10:29.364297 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:10:29.364297 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:10:29.364297 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:10:29.365199 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:10:29.365199 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:10:29.365199 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:10:29.365199 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:10:29.365199 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:10:29.365199 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:10:29.365199 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:10:29.365199 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:10:29.365199 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:10:29.365199 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:10:29.365199 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:10:29.365199 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 31 00:10:29.365199 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 601/1222] 10.222.0.47 () {56 vars in 1102 bytes} [Wed Aug 31 00:10:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:10:29.370660 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13279ce5-a1f4-4361-af8c-f10190511c63 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:10:29.500435 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13279ce5-a1f4-4361-af8c-f10190511c63 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:10:29.525683 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:10:29.537680 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcfd74a-fea1-4133-b0a7-2fc7ec162ce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:10:29.538292 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcfd74a-fea1-4133-b0a7-2fc7ec162ce8 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:10:29.538575 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcfd74a-fea1-4133-b0a7-2fc7ec162ce8 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:10:29.538849 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcfd74a-fea1-4133-b0a7-2fc7ec162ce8 None admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:10:29.540063 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcfd74a-fea1-4133-b0a7-2fc7ec162ce8 None admin] RBAC: Adding query filter params (name=service) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:10:29.540785 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcfd74a-fea1-4133-b0a7-2fc7ec162ce8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:10:29.541899 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcfd74a-fea1-4133-b0a7-2fc7ec162ce8 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:10:29.550185 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 622/1223] 10.222.0.47 () {56 vars in 1103 bytes} [Wed Aug 31 00:10:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:10:29.556172 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20ab2b2-8fdd-425b-9d90-2b3449dd93aa None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:10:29.607905 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:10:29.677758 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20ab2b2-8fdd-425b-9d90-2b3449dd93aa None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:10:29.720419 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5198c8-8a84-4654-a60d-c786be13ff28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:10:29.721069 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5198c8-8a84-4654-a60d-c786be13ff28 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:10:29.721743 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5198c8-8a84-4654-a60d-c786be13ff28 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:10:29.722016 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5198c8-8a84-4654-a60d-c786be13ff28 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:10:29.733828 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5198c8-8a84-4654-a60d-c786be13ff28 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:10:29.735289 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5198c8-8a84-4654-a60d-c786be13ff28 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:10:29.751416 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-4b5198c8-8a84-4654-a60d-c786be13ff28 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:10:29.751416 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:10:29.751416 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:10:29.751416 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:10:29.751416 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:10:29.751416 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:10:29.751416 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:10:29.751416 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:10:29.751416 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:10:29.751416 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:10:29.751416 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:10:29.751416 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:10:29.751416 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:10:29.751416 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:10:29.751416 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:10:29.751416 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:10:29.752623 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:10:29.752623 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:10:29.752623 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:10:29.752623 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:10:29.752623 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:10:29.752623 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:10:29.752623 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:10:29.752623 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 31 00:10:29.752623 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:10:29.752623 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:10:29.752623 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:10:29.752623 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:10:29.752623 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:10:29.752623 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:10:29.752623 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:10:29.752623 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:10:29.752623 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:10:29.753585 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:10:29.753585 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:10:29.753585 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 31 00:10:29.753585 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 602/1224] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 00:10:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:10:29.760249 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcfd74a-fea1-4133-b0a7-2fc7ec162ce8 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:10:29.872610 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcfd74a-fea1-4133-b0a7-2fc7ec162ce8 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:10:29.910919 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb29e0ae-d2bf-42d0-b112-7dc33b06f014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:10:29.911534 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb29e0ae-d2bf-42d0-b112-7dc33b06f014 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:10:29.911816 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb29e0ae-d2bf-42d0-b112-7dc33b06f014 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:10:29.912097 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb29e0ae-d2bf-42d0-b112-7dc33b06f014 None admin] PATH_INFO: `/v3/domains` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:10:29.912798 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb29e0ae-d2bf-42d0-b112-7dc33b06f014 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:10:29.913108 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb29e0ae-d2bf-42d0-b112-7dc33b06f014 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:10:29.914528 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb29e0ae-d2bf-42d0-b112-7dc33b06f014 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:10:29.927961 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 623/1225] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 31 00:10:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:10:29.934889 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5198c8-8a84-4654-a60d-c786be13ff28 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:10:30.043095 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:10:30.050544 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5198c8-8a84-4654-a60d-c786be13ff28 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:10:30.088297 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ee3ee8-b491-497c-8d55-1c1e9571dbb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:10:30.088947 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ee3ee8-b491-497c-8d55-1c1e9571dbb7 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:10:30.089219 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ee3ee8-b491-497c-8d55-1c1e9571dbb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:10:30.089491 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ee3ee8-b491-497c-8d55-1c1e9571dbb7 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:10:30.098683 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ee3ee8-b491-497c-8d55-1c1e9571dbb7 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:10:30.100203 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ee3ee8-b491-497c-8d55-1c1e9571dbb7 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:10:30.112309 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-82ee3ee8-b491-497c-8d55-1c1e9571dbb7 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 31 00:10:30.112309 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:10:30.112309 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:10:30.112309 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:10:30.112309 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:10:30.112309 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:10:30.112309 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:10:30.112309 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:10:30.112309 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:10:30.112309 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:10:30.112309 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:10:30.112309 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:10:30.112309 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 00:10:30.112309 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 00:10:30.112309 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 00:10:30.112309 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 00:10:30.113423 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:10:30.113423 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:10:30.113423 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:10:30.113423 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:10:30.113423 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:10:30.113423 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:10:30.113423 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:10:30.113423 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:10:30.113423 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:10:30.113423 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:10:30.113423 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:10:30.113423 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 31 00:10:30.113423 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:10:30.113423 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:10:30.113423 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:10:30.113423 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:10:30.113423 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:10:30.113423 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:10:30.115141 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:10:30.115141 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:10:30.115141 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 00:10:30.115141 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 00:10:30.115141 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 00:10:30.115141 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 00:10:30.115141 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 00:10:30.115141 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 00:10:30.115141 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 31 00:10:30.115141 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 31 00:10:30.115141 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 603/1226] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 00:10:29 2022] GET /identity/v3/users/placement => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:10:30.120410 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb29e0ae-d2bf-42d0-b112-7dc33b06f014 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:10:30.178323 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:10:30.244320 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb29e0ae-d2bf-42d0-b112-7dc33b06f014 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:10:30.291102 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe2499f-fcb1-4899-aafa-5ad5c294811e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:10:30.291748 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe2499f-fcb1-4899-aafa-5ad5c294811e None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:10:30.292023 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe2499f-fcb1-4899-aafa-5ad5c294811e None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:10:30.292337 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe2499f-fcb1-4899-aafa-5ad5c294811e None admin] PATH_INFO: `/v3/users` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:10:30.293085 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe2499f-fcb1-4899-aafa-5ad5c294811e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:10:30.293437 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe2499f-fcb1-4899-aafa-5ad5c294811e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:10:30.294818 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe2499f-fcb1-4899-aafa-5ad5c294811e None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:10:30.314095 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 624/1227] 10.222.0.47 () {56 vars in 1143 bytes} [Wed Aug 31 00:10:30 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:10:30.320195 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ee3ee8-b491-497c-8d55-1c1e9571dbb7 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:10:30.444382 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ee3ee8-b491-497c-8d55-1c1e9571dbb7 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:10:30.498823 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff92365-0acf-4eae-9fa5-7d671f2f89cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:10:30.499529 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff92365-0acf-4eae-9fa5-7d671f2f89cd None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:10:30.499815 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff92365-0acf-4eae-9fa5-7d671f2f89cd None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:10:30.500084 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff92365-0acf-4eae-9fa5-7d671f2f89cd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:10:30.512839 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff92365-0acf-4eae-9fa5-7d671f2f89cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:10:30.514311 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff92365-0acf-4eae-9fa5-7d671f2f89cd None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:10:30.529269 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-8ff92365-0acf-4eae-9fa5-7d671f2f89cd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:10:30.529269 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:10:30.529269 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:10:30.529269 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:10:30.529269 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:10:30.529269 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:10:30.529269 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:10:30.529269 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:10:30.529269 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:10:30.529269 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:10:30.529269 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:10:30.529269 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:10:30.529269 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:10:30.529269 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:10:30.529269 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:10:30.529269 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:10:30.530511 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:10:30.530511 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:10:30.530511 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:10:30.530511 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:10:30.530511 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:10:30.530511 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:10:30.530511 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:10:30.530511 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 31 00:10:30.530511 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:10:30.530511 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:10:30.530511 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:10:30.530511 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:10:30.530511 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:10:30.530511 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:10:30.530511 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:10:30.530511 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:10:30.530511 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:10:30.531525 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:10:30.531525 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:10:30.531525 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 31 00:10:30.531525 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 604/1228] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 00:10:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:10:30.536803 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe2499f-fcb1-4899-aafa-5ad5c294811e None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:10:30.655241 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe2499f-fcb1-4899-aafa-5ad5c294811e None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:10:30.657814 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:10:30.707080 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5cdf02-49e6-495e-9e96-dd47c758cf3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:10:30.707826 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5cdf02-49e6-495e-9e96-dd47c758cf3a None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:10:30.708260 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5cdf02-49e6-495e-9e96-dd47c758cf3a None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:10:30.708716 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5cdf02-49e6-495e-9e96-dd47c758cf3a None admin] PATH_INFO: `/v3/domains` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:10:30.709512 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5cdf02-49e6-495e-9e96-dd47c758cf3a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:10:30.709997 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5cdf02-49e6-495e-9e96-dd47c758cf3a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:10:30.713226 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5cdf02-49e6-495e-9e96-dd47c758cf3a None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:10:30.738543 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 625/1229] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 31 00:10:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:10:30.740752 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff92365-0acf-4eae-9fa5-7d671f2f89cd None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:10:30.751942 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:10:30.867492 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff92365-0acf-4eae-9fa5-7d671f2f89cd None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:10:30.919257 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d6b5ce-7c77-47ed-bdd1-1ed4f0562480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:10:30.919904 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d6b5ce-7c77-47ed-bdd1-1ed4f0562480 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:10:30.920208 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d6b5ce-7c77-47ed-bdd1-1ed4f0562480 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:10:30.920560 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d6b5ce-7c77-47ed-bdd1-1ed4f0562480 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:10:30.928664 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d6b5ce-7c77-47ed-bdd1-1ed4f0562480 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:10:30.930927 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d6b5ce-7c77-47ed-bdd1-1ed4f0562480 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:10:30.943848 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-23d6b5ce-7c77-47ed-bdd1-1ed4f0562480 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:10:30.943848 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:10:30.943848 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:10:30.943848 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:10:30.943848 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:10:30.943848 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:10:30.943848 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:10:30.943848 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:10:30.943848 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:10:30.943848 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:10:30.943848 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:10:30.943848 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:10:30.943848 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 00:10:30.943848 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 00:10:30.943848 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 00:10:30.945304 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 00:10:30.945304 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:10:30.945304 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:10:30.945304 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:10:30.945304 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:10:30.945304 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:10:30.945304 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:10:30.945304 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:10:30.945304 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 31 00:10:30.945304 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:10:30.945304 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:10:30.945304 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:10:30.945304 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:10:30.945304 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:10:30.945304 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:10:30.945304 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:10:30.945304 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:10:30.946386 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 00:10:30.946386 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 00:10:30.946386 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:10:30.946386 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:10:30.946386 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:10:30.946386 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:10:30.946386 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:10:30.946386 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 31 00:10:30.946386 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 605/1230] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 31 00:10:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:10:30.953331 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5cdf02-49e6-495e-9e96-dd47c758cf3a None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:10:31.082352 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5cdf02-49e6-495e-9e96-dd47c758cf3a None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:10:31.130143 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8850b7e-e2fb-4c3e-9b54-e7b9066cc119 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:10:31.130918 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8850b7e-e2fb-4c3e-9b54-e7b9066cc119 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:10:31.131311 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8850b7e-e2fb-4c3e-9b54-e7b9066cc119 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:10:31.131730 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8850b7e-e2fb-4c3e-9b54-e7b9066cc119 None admin] PATH_INFO: `/v3/projects` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:10:31.132726 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8850b7e-e2fb-4c3e-9b54-e7b9066cc119 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:10:31.133265 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8850b7e-e2fb-4c3e-9b54-e7b9066cc119 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:10:31.135944 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8850b7e-e2fb-4c3e-9b54-e7b9066cc119 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:10:31.151508 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 626/1231] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Aug 31 00:10:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:10:31.158026 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d6b5ce-7c77-47ed-bdd1-1ed4f0562480 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:10:31.233426 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:10:31.275672 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d6b5ce-7c77-47ed-bdd1-1ed4f0562480 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:10:31.311779 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acf5e33-8e77-49dd-a484-fd94f99bc412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:10:31.312472 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acf5e33-8e77-49dd-a484-fd94f99bc412 None admin] REQUEST_METHOD: `PUT` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:10:31.312754 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acf5e33-8e77-49dd-a484-fd94f99bc412 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:10:31.313031 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acf5e33-8e77-49dd-a484-fd94f99bc412 None admin] PATH_INFO: `/v3/projects/1b647cccb30a427193fc62dbebe0c6f1/users/8f76e01e32264ff7a6a7740ffa0a207d/roles/1e6d7ecde4b0415bb944f25eda475f9c` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:10:31.328709 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acf5e33-8e77-49dd-a484-fd94f99bc412 None admin] RBAC: Authorizing `identity:create_grant(project_id=1b647cccb30a427193fc62dbebe0c6f1, user_id=8f76e01e32264ff7a6a7740ffa0a207d, role_id=1e6d7ecde4b0415bb944f25eda475f9c)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:10:31.330172 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acf5e33-8e77-49dd-a484-fd94f99bc412 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:10:31.345587 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 606/1232] 10.222.0.47 () {58 vars in 1439 bytes} [Wed Aug 31 00:10:31 2022] PUT /identity/v3/projects/1b647cccb30a427193fc62dbebe0c6f1/users/8f76e01e32264ff7a6a7740ffa0a207d/roles/1e6d7ecde4b0415bb944f25eda475f9c => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:10:33.369430 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2fe906-1d88-4f0c-a350-da79c9473976 None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:10:33.370006 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2fe906-1d88-4f0c-a350-da79c9473976 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:10:33.370006 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2fe906-1d88-4f0c-a350-da79c9473976 None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:10:33.371320 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 627/1233] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 00:10:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:10:33.379218 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9c2d4c-bd76-49c1-a68d-370f644d259b None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:10:33.379711 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9c2d4c-bd76-49c1-a68d-370f644d259b None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:10:33.379832 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9c2d4c-bd76-49c1-a68d-370f644d259b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:10:33.404570 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-6a9c2d4c-bd76-49c1-a68d-370f644d259b None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:10:33.405987 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-6a9c2d4c-bd76-49c1-a68d-370f644d259b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:10:33.498227 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 607/1234] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 00:10:33 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:10:33.802679 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2fe906-1d88-4f0c-a350-da79c9473976 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:10:33.838720 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:10:33.985980 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2fe906-1d88-4f0c-a350-da79c9473976 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:10:34.036537 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15a701c-1c80-43d4-8518-e151a1ab74e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:10:34.037316 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15a701c-1c80-43d4-8518-e151a1ab74e3 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:10:34.037611 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15a701c-1c80-43d4-8518-e151a1ab74e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:10:34.037919 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15a701c-1c80-43d4-8518-e151a1ab74e3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:10:34.053519 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15a701c-1c80-43d4-8518-e151a1ab74e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:10:34.060146 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-d15a701c-1c80-43d4-8518-e151a1ab74e3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:10:34.060146 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:10:34.060146 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:10:34.060146 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:10:34.060146 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:10:34.060146 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:10:34.060146 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:10:34.060146 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:10:34.060146 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:10:34.060146 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:10:34.060146 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:10:34.060146 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:10:34.060146 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:10:34.060146 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:10:34.060146 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:10:34.060146 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:10:34.062234 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:10:34.062234 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:10:34.062234 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:10:34.062234 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:10:34.062234 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:10:34.062234 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:10:34.062234 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:10:34.062234 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:10:34.062234 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:10:34.062234 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:10:34.062234 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:10:34.062234 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Aug 31 00:10:34.062234 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:10:34.062234 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:10:34.062234 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:10:34.062234 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:10:34.064076 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:10:34.064076 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:10:34.064076 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:10:34.064076 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:10:34.064076 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:10:34.064076 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:10:34.064076 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:10:34.064076 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:10:34.064076 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:10:34.064076 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:10:34.064076 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:10:34.064076 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Aug 31 00:10:34.064076 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 628/1235] 10.222.0.47 () {56 vars in 1102 bytes} [Wed Aug 31 00:10:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:10:34.068603 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9c2d4c-bd76-49c1-a68d-370f644d259b None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:10:34.134191 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:10:34.216303 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9c2d4c-bd76-49c1-a68d-370f644d259b None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:10:34.266971 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60323a51-3387-4fee-a1a4-420478340925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:10:34.268302 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60323a51-3387-4fee-a1a4-420478340925 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:10:34.268302 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60323a51-3387-4fee-a1a4-420478340925 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:10:34.268302 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60323a51-3387-4fee-a1a4-420478340925 None admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:10:34.268806 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60323a51-3387-4fee-a1a4-420478340925 None admin] RBAC: Adding query filter params (name=service) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:10:34.269098 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60323a51-3387-4fee-a1a4-420478340925 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:10:34.270525 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60323a51-3387-4fee-a1a4-420478340925 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:10:34.281536 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 608/1236] 10.222.0.47 () {56 vars in 1103 bytes} [Wed Aug 31 00:10:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:10:34.288890 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15a701c-1c80-43d4-8518-e151a1ab74e3 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:10:34.408755 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:10:34.427095 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15a701c-1c80-43d4-8518-e151a1ab74e3 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:10:34.472374 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f009293-2802-4767-8e75-8b0da484d87d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:10:34.473285 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f009293-2802-4767-8e75-8b0da484d87d None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:10:34.473761 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f009293-2802-4767-8e75-8b0da484d87d None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:10:34.474233 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f009293-2802-4767-8e75-8b0da484d87d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:10:34.496332 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f009293-2802-4767-8e75-8b0da484d87d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:10:34.497983 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f009293-2802-4767-8e75-8b0da484d87d None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:10:34.524690 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-0f009293-2802-4767-8e75-8b0da484d87d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:10:34.524690 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:10:34.524690 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:10:34.524690 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:10:34.524690 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:10:34.524690 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:10:34.524690 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:10:34.524690 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:10:34.524690 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:10:34.524690 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:10:34.524690 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:10:34.524690 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:10:34.524690 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:10:34.524690 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:10:34.524690 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:10:34.524690 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:10:34.526672 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:10:34.526672 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:10:34.526672 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:10:34.526672 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:10:34.526672 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:10:34.526672 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:10:34.526672 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:10:34.526672 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Aug 31 00:10:34.526672 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:10:34.526672 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:10:34.526672 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:10:34.526672 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:10:34.526672 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:10:34.526672 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:10:34.526672 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:10:34.526672 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:10:34.526672 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:10:34.528616 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:10:34.528616 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:10:34.528616 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Aug 31 00:10:34.531551 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 629/1237] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 00:10:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:10:34.541379 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60323a51-3387-4fee-a1a4-420478340925 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:10:34.687792 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60323a51-3387-4fee-a1a4-420478340925 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:10:34.699650 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:10:34.739683 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2e19e3-cb37-48bc-8dd4-32d5c3573b7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:10:34.740372 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2e19e3-cb37-48bc-8dd4-32d5c3573b7f None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:10:34.740651 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2e19e3-cb37-48bc-8dd4-32d5c3573b7f None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:10:34.740921 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2e19e3-cb37-48bc-8dd4-32d5c3573b7f None admin] PATH_INFO: `/v3/domains` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:10:34.741581 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2e19e3-cb37-48bc-8dd4-32d5c3573b7f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:10:34.741892 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2e19e3-cb37-48bc-8dd4-32d5c3573b7f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:10:34.743382 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2e19e3-cb37-48bc-8dd4-32d5c3573b7f None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:10:34.757528 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 609/1238] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 31 00:10:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:10:34.764073 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f009293-2802-4767-8e75-8b0da484d87d None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:10:34.911699 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f009293-2802-4767-8e75-8b0da484d87d None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:10:34.967537 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741a9397-846d-4996-90e9-f1c9dabd10b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:10:34.968123 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741a9397-846d-4996-90e9-f1c9dabd10b6 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:10:34.968443 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741a9397-846d-4996-90e9-f1c9dabd10b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:10:34.968807 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741a9397-846d-4996-90e9-f1c9dabd10b6 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:10:34.972450 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:10:34.978989 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741a9397-846d-4996-90e9-f1c9dabd10b6 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:10:34.980871 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741a9397-846d-4996-90e9-f1c9dabd10b6 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:10:34.999834 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-741a9397-846d-4996-90e9-f1c9dabd10b6 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 31 00:10:34.999834 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:10:34.999834 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:10:34.999834 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:10:34.999834 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:10:34.999834 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:10:34.999834 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:10:34.999834 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:10:34.999834 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:10:34.999834 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:10:34.999834 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:10:34.999834 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:10:34.999834 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 00:10:34.999834 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 00:10:34.999834 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 00:10:34.999834 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 00:10:35.000998 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:10:35.000998 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:10:35.000998 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:10:35.000998 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:10:35.000998 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:10:35.000998 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:10:35.000998 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:10:35.000998 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:10:35.000998 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:10:35.000998 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:10:35.000998 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:10:35.000998 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Aug 31 00:10:35.000998 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:10:35.000998 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:10:35.000998 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:10:35.000998 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:10:35.000998 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:10:35.000998 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:10:35.001974 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:10:35.001974 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:10:35.001974 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 00:10:35.001974 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 00:10:35.001974 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 00:10:35.001974 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 00:10:35.001974 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 00:10:35.001974 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 00:10:35.001974 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 31 00:10:35.001974 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Aug 31 00:10:35.001974 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 630/1239] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 00:10:34 2022] GET /identity/v3/users/placement => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:10:35.007718 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2e19e3-cb37-48bc-8dd4-32d5c3573b7f None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:10:35.128252 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2e19e3-cb37-48bc-8dd4-32d5c3573b7f None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:10:35.168397 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37814f6c-67fd-496a-85da-9ff5afb0a936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:10:35.169087 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37814f6c-67fd-496a-85da-9ff5afb0a936 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:10:35.169472 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37814f6c-67fd-496a-85da-9ff5afb0a936 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:10:35.169680 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37814f6c-67fd-496a-85da-9ff5afb0a936 None admin] PATH_INFO: `/v3/users` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:10:35.170655 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37814f6c-67fd-496a-85da-9ff5afb0a936 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:10:35.170971 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37814f6c-67fd-496a-85da-9ff5afb0a936 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:10:35.172484 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37814f6c-67fd-496a-85da-9ff5afb0a936 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:10:35.193635 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 610/1240] 10.222.0.47 () {56 vars in 1143 bytes} [Wed Aug 31 00:10:35 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:10:35.200830 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741a9397-846d-4996-90e9-f1c9dabd10b6 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:10:35.331959 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741a9397-846d-4996-90e9-f1c9dabd10b6 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:10:35.384163 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf29489-3f44-41ca-abe6-9376651c2e7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:10:35.385210 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf29489-3f44-41ca-abe6-9376651c2e7b None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:10:35.385496 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf29489-3f44-41ca-abe6-9376651c2e7b None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:10:35.385768 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf29489-3f44-41ca-abe6-9376651c2e7b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:10:35.462583 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:10:35.471431 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf29489-3f44-41ca-abe6-9376651c2e7b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:10:35.473751 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf29489-3f44-41ca-abe6-9376651c2e7b None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:10:35.627768 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 631/1241] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 31 00:10:35 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 00:10:35.637392 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37814f6c-67fd-496a-85da-9ff5afb0a936 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:10:35.675929 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:10:35.773236 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37814f6c-67fd-496a-85da-9ff5afb0a936 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:10:35.823656 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e72234-90f3-4c98-8121-bac6313a6f42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:10:35.824318 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e72234-90f3-4c98-8121-bac6313a6f42 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:10:35.824598 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e72234-90f3-4c98-8121-bac6313a6f42 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:10:35.824871 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e72234-90f3-4c98-8121-bac6313a6f42 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:10:35.837441 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e72234-90f3-4c98-8121-bac6313a6f42 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:10:35.839267 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e72234-90f3-4c98-8121-bac6313a6f42 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:10:35.857385 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-87e72234-90f3-4c98-8121-bac6313a6f42 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:10:35.857385 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:10:35.857385 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:10:35.857385 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:10:35.857385 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:10:35.857385 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:10:35.857385 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:10:35.857385 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:10:35.857385 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:10:35.857385 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:10:35.857385 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:10:35.857385 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:10:35.857385 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:10:35.857385 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:10:35.857385 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:10:35.857385 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:10:35.858499 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:10:35.858499 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:10:35.858499 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:10:35.858499 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:10:35.858499 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:10:35.858499 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:10:35.858499 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:10:35.858499 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 31 00:10:35.858499 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:10:35.858499 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:10:35.858499 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:10:35.858499 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:10:35.858499 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:10:35.858499 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:10:35.858499 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:10:35.858499 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:10:35.858499 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:10:35.859423 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:10:35.859423 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:10:35.859423 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 31 00:10:35.863603 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 611/1242] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 00:10:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:10:35.864679 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf29489-3f44-41ca-abe6-9376651c2e7b None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:10:36.019062 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:10:36.027037 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf29489-3f44-41ca-abe6-9376651c2e7b None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:10:36.077753 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b457904d-cc44-4f99-a3fa-8efbbc29aa44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:10:36.078562 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b457904d-cc44-4f99-a3fa-8efbbc29aa44 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:10:36.078911 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b457904d-cc44-4f99-a3fa-8efbbc29aa44 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:10:36.079263 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b457904d-cc44-4f99-a3fa-8efbbc29aa44 None admin] PATH_INFO: `/v3/domains` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:10:36.080017 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b457904d-cc44-4f99-a3fa-8efbbc29aa44 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:10:36.080453 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b457904d-cc44-4f99-a3fa-8efbbc29aa44 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:10:36.081838 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b457904d-cc44-4f99-a3fa-8efbbc29aa44 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:10:36.097577 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 632/1243] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 31 00:10:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:10:36.104075 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e72234-90f3-4c98-8121-bac6313a6f42 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:10:36.215143 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:10:36.252695 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e72234-90f3-4c98-8121-bac6313a6f42 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:10:36.315176 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd738b19-9011-4bc1-a1da-da7496859daa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:10:36.316252 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd738b19-9011-4bc1-a1da-da7496859daa None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:10:36.316705 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd738b19-9011-4bc1-a1da-da7496859daa None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:10:36.317161 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd738b19-9011-4bc1-a1da-da7496859daa None admin] PATH_INFO: `/v3/projects/service` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:10:36.330324 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd738b19-9011-4bc1-a1da-da7496859daa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:10:36.332464 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd738b19-9011-4bc1-a1da-da7496859daa None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:10:36.349684 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-cd738b19-9011-4bc1-a1da-da7496859daa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:10:36.349684 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:10:36.349684 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:10:36.349684 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:10:36.349684 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:10:36.349684 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:10:36.349684 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:10:36.349684 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:10:36.349684 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:10:36.349684 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:10:36.349684 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:10:36.349684 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:10:36.349684 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 00:10:36.349684 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 00:10:36.349684 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 00:10:36.353424 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 00:10:36.353424 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:10:36.353424 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:10:36.353424 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:10:36.353424 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:10:36.353424 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:10:36.353424 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:10:36.353424 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:10:36.353424 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 31 00:10:36.353424 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:10:36.353424 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:10:36.353424 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:10:36.353424 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:10:36.353424 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:10:36.353424 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:10:36.353424 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:10:36.353424 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:10:36.354730 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 00:10:36.354730 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 00:10:36.354730 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:10:36.354730 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:10:36.354730 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:10:36.354730 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:10:36.354730 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:10:36.354730 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 31 00:10:36.354730 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 612/1244] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 31 00:10:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:10:36.360048 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b457904d-cc44-4f99-a3fa-8efbbc29aa44 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:10:36.499608 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b457904d-cc44-4f99-a3fa-8efbbc29aa44 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:10:36.547991 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40987f53-14b5-4873-be44-0eeeb0364ad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:10:36.549006 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40987f53-14b5-4873-be44-0eeeb0364ad6 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:10:36.549313 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40987f53-14b5-4873-be44-0eeeb0364ad6 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:10:36.549883 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40987f53-14b5-4873-be44-0eeeb0364ad6 None admin] PATH_INFO: `/v3/projects` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:10:36.550759 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40987f53-14b5-4873-be44-0eeeb0364ad6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:10:36.551223 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40987f53-14b5-4873-be44-0eeeb0364ad6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:10:36.553766 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40987f53-14b5-4873-be44-0eeeb0364ad6 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:10:36.572203 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 633/1245] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Aug 31 00:10:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:10:36.577892 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd738b19-9011-4bc1-a1da-da7496859daa None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:10:36.707165 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd738b19-9011-4bc1-a1da-da7496859daa None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:10:36.750494 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56519dd2-2b4e-418f-95dd-c59d5d4ef7e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:10:36.751202 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56519dd2-2b4e-418f-95dd-c59d5d4ef7e6 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:10:36.751530 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56519dd2-2b4e-418f-95dd-c59d5d4ef7e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:10:36.751919 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56519dd2-2b4e-418f-95dd-c59d5d4ef7e6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:10:36.752831 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56519dd2-2b4e-418f-95dd-c59d5d4ef7e6 None admin] RBAC: Adding query filter params (role.id=1e6d7ecde4b0415bb944f25eda475f9c, scope.project.id=1b647cccb30a427193fc62dbebe0c6f1, user.id=8f76e01e32264ff7a6a7740ffa0a207d) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:10:36.753140 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56519dd2-2b4e-418f-95dd-c59d5d4ef7e6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:10:36.754742 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56519dd2-2b4e-418f-95dd-c59d5d4ef7e6 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:10:36.762511 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 613/1246] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 31 00:10:36 2022] GET /identity/v3/role_assignments?user.id=8f76e01e32264ff7a6a7740ffa0a207d&scope.project.id=1b647cccb30a427193fc62dbebe0c6f1&role.id=1e6d7ecde4b0415bb944f25eda475f9c => generated 608 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:10:38.872257 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503fb938-1ffe-4066-97eb-b78c4de441ff None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:10:38.872821 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503fb938-1ffe-4066-97eb-b78c4de441ff None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:10:38.872821 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503fb938-1ffe-4066-97eb-b78c4de441ff None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:10:38.874139 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 634/1247] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 00:10:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 00:10:38.879996 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d413fda-34c3-4a74-9eaa-094442a78140 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:10:38.880844 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d413fda-34c3-4a74-9eaa-094442a78140 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:10:38.880844 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d413fda-34c3-4a74-9eaa-094442a78140 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:10:38.887771 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:10:38.902492 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-1d413fda-34c3-4a74-9eaa-094442a78140 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:10:38.903324 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-1d413fda-34c3-4a74-9eaa-094442a78140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:10:39.008202 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 614/1248] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 00:10:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:10:39.293280 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503fb938-1ffe-4066-97eb-b78c4de441ff None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:10:39.317762 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:10:39.422826 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503fb938-1ffe-4066-97eb-b78c4de441ff None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:10:39.465263 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eab0c2d-277a-4282-b340-f80a1577f132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:10:39.466155 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eab0c2d-277a-4282-b340-f80a1577f132 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:10:39.466377 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eab0c2d-277a-4282-b340-f80a1577f132 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:10:39.466743 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eab0c2d-277a-4282-b340-f80a1577f132 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:10:39.480975 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eab0c2d-277a-4282-b340-f80a1577f132 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:10:39.487361 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-1eab0c2d-277a-4282-b340-f80a1577f132 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:10:39.487361 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:10:39.487361 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:10:39.487361 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:10:39.487361 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:10:39.487361 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:10:39.487361 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:10:39.487361 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:10:39.487361 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:10:39.487361 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:10:39.487361 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:10:39.487361 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:10:39.487361 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:10:39.487361 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:10:39.487361 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:10:39.487361 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:10:39.492472 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:10:39.492472 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:10:39.492472 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:10:39.492472 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:10:39.492472 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:10:39.492472 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:10:39.492472 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:10:39.492472 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:10:39.492472 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:10:39.492472 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:10:39.492472 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:10:39.492472 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Aug 31 00:10:39.492472 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:10:39.492472 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:10:39.492472 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:10:39.492472 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:10:39.493712 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:10:39.493712 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:10:39.493712 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:10:39.493712 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:10:39.493712 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:10:39.493712 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:10:39.493712 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:10:39.493712 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:10:39.493712 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:10:39.493712 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:10:39.493712 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:10:39.493712 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Aug 31 00:10:39.493712 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 635/1249] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Aug 31 00:10:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:10:39.495621 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d413fda-34c3-4a74-9eaa-094442a78140 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:10:39.630936 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d413fda-34c3-4a74-9eaa-094442a78140 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:10:39.673493 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:10:39.683253 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b0b0c7-f574-4815-a21c-fce3044eb1a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:10:39.684280 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b0b0c7-f574-4815-a21c-fce3044eb1a5 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:10:39.684602 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b0b0c7-f574-4815-a21c-fce3044eb1a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:10:39.684880 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b0b0c7-f574-4815-a21c-fce3044eb1a5 None admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:10:39.685534 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b0b0c7-f574-4815-a21c-fce3044eb1a5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:10:39.685909 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b0b0c7-f574-4815-a21c-fce3044eb1a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:10:39.687301 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b0b0c7-f574-4815-a21c-fce3044eb1a5 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:10:39.703215 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 615/1250] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 31 00:10:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:10:39.706691 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eab0c2d-277a-4282-b340-f80a1577f132 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:10:39.807031 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:10:39.835472 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eab0c2d-277a-4282-b340-f80a1577f132 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:10:39.879757 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1620b0a-a4c1-411c-a25a-c84e6c66add6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:10:39.881239 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1620b0a-a4c1-411c-a25a-c84e6c66add6 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:10:39.881505 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1620b0a-a4c1-411c-a25a-c84e6c66add6 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:10:39.881866 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1620b0a-a4c1-411c-a25a-c84e6c66add6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:10:39.894700 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1620b0a-a4c1-411c-a25a-c84e6c66add6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:10:39.896812 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1620b0a-a4c1-411c-a25a-c84e6c66add6 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:10:39.914501 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-d1620b0a-a4c1-411c-a25a-c84e6c66add6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:10:39.914501 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:10:39.914501 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:10:39.914501 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:10:39.914501 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:10:39.914501 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:10:39.914501 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:10:39.914501 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:10:39.914501 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:10:39.914501 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:10:39.914501 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:10:39.914501 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:10:39.914501 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:10:39.914501 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:10:39.914501 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:10:39.914501 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:10:39.915695 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:10:39.915695 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:10:39.915695 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:10:39.915695 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:10:39.915695 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:10:39.915695 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:10:39.915695 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:10:39.915695 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Aug 31 00:10:39.915695 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:10:39.915695 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:10:39.915695 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:10:39.915695 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:10:39.915695 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:10:39.915695 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:10:39.915695 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:10:39.915695 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:10:39.915695 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:10:39.916849 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:10:39.916849 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:10:39.916849 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Aug 31 00:10:39.921351 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 636/1251] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 00:10:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:10:39.922303 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b0b0c7-f574-4815-a21c-fce3044eb1a5 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:10:40.052929 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b0b0c7-f574-4815-a21c-fce3044eb1a5 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:10:40.105120 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83350d0-4e5f-423c-af6e-9cb9f3af58e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:10:40.105980 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83350d0-4e5f-423c-af6e-9cb9f3af58e0 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:10:40.106428 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83350d0-4e5f-423c-af6e-9cb9f3af58e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:10:40.106761 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83350d0-4e5f-423c-af6e-9cb9f3af58e0 None admin] PATH_INFO: `/v3/domains` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:10:40.107561 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83350d0-4e5f-423c-af6e-9cb9f3af58e0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:10:40.107896 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83350d0-4e5f-423c-af6e-9cb9f3af58e0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:10:40.109332 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83350d0-4e5f-423c-af6e-9cb9f3af58e0 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:10:40.126678 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 616/1252] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 31 00:10:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:10:40.132854 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1620b0a-a4c1-411c-a25a-c84e6c66add6 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:10:40.262090 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1620b0a-a4c1-411c-a25a-c84e6c66add6 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:10:40.294130 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:10:40.303315 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a29628-5f3b-4d47-ae44-c66f38d2dc19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:10:40.303958 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a29628-5f3b-4d47-ae44-c66f38d2dc19 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:10:40.304284 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a29628-5f3b-4d47-ae44-c66f38d2dc19 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:10:40.304560 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a29628-5f3b-4d47-ae44-c66f38d2dc19 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:10:40.313683 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a29628-5f3b-4d47-ae44-c66f38d2dc19 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:10:40.315229 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a29628-5f3b-4d47-ae44-c66f38d2dc19 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:10:40.328477 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-c2a29628-5f3b-4d47-ae44-c66f38d2dc19 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 31 00:10:40.328477 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:10:40.328477 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:10:40.328477 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:10:40.328477 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:10:40.328477 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:10:40.328477 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:10:40.328477 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:10:40.328477 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:10:40.328477 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:10:40.328477 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:10:40.328477 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:10:40.328477 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 00:10:40.328477 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 00:10:40.328477 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 00:10:40.328477 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 00:10:40.329540 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:10:40.329540 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:10:40.329540 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:10:40.329540 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:10:40.329540 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:10:40.329540 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:10:40.329540 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:10:40.329540 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:10:40.329540 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:10:40.329540 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:10:40.329540 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:10:40.329540 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Aug 31 00:10:40.329540 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:10:40.329540 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:10:40.329540 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:10:40.329540 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:10:40.329540 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:10:40.329540 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:10:40.330534 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:10:40.330534 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:10:40.330534 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 00:10:40.330534 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 00:10:40.330534 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 00:10:40.330534 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 00:10:40.330534 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 00:10:40.330534 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 00:10:40.330534 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 31 00:10:40.330534 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Aug 31 00:10:40.330534 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 637/1253] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 00:10:40 2022] GET /identity/v3/users/placement => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:10:40.336047 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83350d0-4e5f-423c-af6e-9cb9f3af58e0 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:10:40.410791 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:10:40.479969 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83350d0-4e5f-423c-af6e-9cb9f3af58e0 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:10:40.537517 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab141a83-b4e6-44e2-a9e9-ffe94c3e9b45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:10:40.538235 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab141a83-b4e6-44e2-a9e9-ffe94c3e9b45 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:10:40.538657 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab141a83-b4e6-44e2-a9e9-ffe94c3e9b45 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:10:40.539065 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab141a83-b4e6-44e2-a9e9-ffe94c3e9b45 None admin] PATH_INFO: `/v3/users` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:10:40.540951 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab141a83-b4e6-44e2-a9e9-ffe94c3e9b45 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:10:40.541335 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab141a83-b4e6-44e2-a9e9-ffe94c3e9b45 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:10:40.543126 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab141a83-b4e6-44e2-a9e9-ffe94c3e9b45 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:10:40.570482 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 617/1254] 10.222.0.47 () {56 vars in 1143 bytes} [Wed Aug 31 00:10:40 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:10:40.578264 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a29628-5f3b-4d47-ae44-c66f38d2dc19 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:10:40.708223 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a29628-5f3b-4d47-ae44-c66f38d2dc19 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:10:40.754228 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a79430-f558-4d11-b9e1-7eade73d7302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:10:40.754909 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a79430-f558-4d11-b9e1-7eade73d7302 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:10:40.755146 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a79430-f558-4d11-b9e1-7eade73d7302 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:10:40.755422 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a79430-f558-4d11-b9e1-7eade73d7302 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:10:40.824145 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:10:40.847103 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a79430-f558-4d11-b9e1-7eade73d7302 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:10:40.848690 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a79430-f558-4d11-b9e1-7eade73d7302 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:10:40.963551 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 638/1255] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 31 00:10:40 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 00:10:40.969514 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab141a83-b4e6-44e2-a9e9-ffe94c3e9b45 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:10:41.123018 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab141a83-b4e6-44e2-a9e9-ffe94c3e9b45 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:10:41.142730 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:10:41.172481 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577499c4-ffa5-4e3e-971e-ed4659f71b93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:10:41.173114 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577499c4-ffa5-4e3e-971e-ed4659f71b93 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:10:41.173397 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577499c4-ffa5-4e3e-971e-ed4659f71b93 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:10:41.173669 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577499c4-ffa5-4e3e-971e-ed4659f71b93 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:10:41.184579 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577499c4-ffa5-4e3e-971e-ed4659f71b93 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:10:41.186406 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577499c4-ffa5-4e3e-971e-ed4659f71b93 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:10:41.203829 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-577499c4-ffa5-4e3e-971e-ed4659f71b93 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:10:41.203829 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:10:41.203829 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:10:41.203829 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:10:41.203829 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:10:41.203829 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:10:41.203829 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:10:41.203829 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:10:41.203829 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:10:41.203829 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:10:41.203829 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:10:41.203829 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:10:41.203829 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:10:41.203829 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:10:41.203829 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:10:41.203829 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:10:41.205096 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:10:41.205096 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:10:41.205096 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:10:41.205096 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:10:41.205096 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:10:41.205096 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:10:41.205096 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:10:41.205096 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 31 00:10:41.205096 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:10:41.205096 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:10:41.205096 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:10:41.205096 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:10:41.205096 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:10:41.205096 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:10:41.205096 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:10:41.205096 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:10:41.205096 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:10:41.206225 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:10:41.206225 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:10:41.206225 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 31 00:10:41.207651 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 618/1256] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 00:10:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:10:41.214180 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a79430-f558-4d11-b9e1-7eade73d7302 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:10:41.321302 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:10:41.339002 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a79430-f558-4d11-b9e1-7eade73d7302 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:10:41.384183 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e69b34-ca1b-41cb-aac4-f4b48a82410f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:10:41.384844 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e69b34-ca1b-41cb-aac4-f4b48a82410f None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:10:41.385146 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e69b34-ca1b-41cb-aac4-f4b48a82410f None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:10:41.385423 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e69b34-ca1b-41cb-aac4-f4b48a82410f None admin] PATH_INFO: `/v3/domains` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:10:41.386209 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e69b34-ca1b-41cb-aac4-f4b48a82410f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:10:41.387198 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e69b34-ca1b-41cb-aac4-f4b48a82410f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:10:41.388011 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e69b34-ca1b-41cb-aac4-f4b48a82410f None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:10:41.406242 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 639/1257] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 31 00:10:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:10:41.407965 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577499c4-ffa5-4e3e-971e-ed4659f71b93 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:10:41.551830 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577499c4-ffa5-4e3e-971e-ed4659f71b93 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:10:41.595078 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546ab27c-87c0-4351-826c-c6895f61738c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:10:41.596010 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546ab27c-87c0-4351-826c-c6895f61738c None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:10:41.596528 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546ab27c-87c0-4351-826c-c6895f61738c None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:10:41.596816 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546ab27c-87c0-4351-826c-c6895f61738c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:10:41.608318 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546ab27c-87c0-4351-826c-c6895f61738c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:10:41.611408 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546ab27c-87c0-4351-826c-c6895f61738c None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:10:41.629251 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-546ab27c-87c0-4351-826c-c6895f61738c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:10:41.629251 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:10:41.629251 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:10:41.629251 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:10:41.629251 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:10:41.629251 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:10:41.629251 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:10:41.629251 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:10:41.629251 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:10:41.629251 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:10:41.629251 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:10:41.629251 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:10:41.629251 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 00:10:41.629251 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 00:10:41.629251 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 00:10:41.630436 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 00:10:41.630436 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:10:41.630436 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:10:41.630436 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:10:41.630436 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:10:41.630436 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:10:41.630436 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:10:41.630436 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:10:41.630436 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 31 00:10:41.630436 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:10:41.630436 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:10:41.630436 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:10:41.630436 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:10:41.630436 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:10:41.630436 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:10:41.630436 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:10:41.630436 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:10:41.631540 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 00:10:41.631540 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 00:10:41.631540 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:10:41.631540 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:10:41.631540 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:10:41.631540 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:10:41.631540 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:10:41.631540 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 31 00:10:41.634853 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 619/1258] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 31 00:10:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:10:41.642645 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e69b34-ca1b-41cb-aac4-f4b48a82410f None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:10:41.797395 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e69b34-ca1b-41cb-aac4-f4b48a82410f None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:10:41.853844 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c7f7c0-32a4-49fc-aced-964dbd9d6fe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:10:41.854548 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c7f7c0-32a4-49fc-aced-964dbd9d6fe0 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:10:41.854920 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c7f7c0-32a4-49fc-aced-964dbd9d6fe0 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:10:41.855289 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c7f7c0-32a4-49fc-aced-964dbd9d6fe0 None admin] PATH_INFO: `/v3/projects` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:10:41.856103 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c7f7c0-32a4-49fc-aced-964dbd9d6fe0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:10:41.856425 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c7f7c0-32a4-49fc-aced-964dbd9d6fe0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:10:41.857888 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c7f7c0-32a4-49fc-aced-964dbd9d6fe0 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:10:41.873043 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 640/1259] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Aug 31 00:10:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:10:41.881885 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546ab27c-87c0-4351-826c-c6895f61738c None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:10:41.916757 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:10:42.047816 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546ab27c-87c0-4351-826c-c6895f61738c None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:10:42.095585 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d12947-2225-4ffa-acb1-ac9d31bd5957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:10:42.096343 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d12947-2225-4ffa-acb1-ac9d31bd5957 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:10:42.096607 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d12947-2225-4ffa-acb1-ac9d31bd5957 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:10:42.096881 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d12947-2225-4ffa-acb1-ac9d31bd5957 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:10:42.097615 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d12947-2225-4ffa-acb1-ac9d31bd5957 None admin] RBAC: Adding query filter params (role.id=12f6817f9aaa4e2bb477095a6bed5d0f, scope.project.id=1b647cccb30a427193fc62dbebe0c6f1, user.id=8f76e01e32264ff7a6a7740ffa0a207d) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:10:42.097916 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d12947-2225-4ffa-acb1-ac9d31bd5957 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:10:42.099478 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d12947-2225-4ffa-acb1-ac9d31bd5957 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:10:42.106714 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 620/1260] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 31 00:10:41 2022] GET /identity/v3/role_assignments?user.id=8f76e01e32264ff7a6a7740ffa0a207d&scope.project.id=1b647cccb30a427193fc62dbebe0c6f1&role.id=12f6817f9aaa4e2bb477095a6bed5d0f => generated 259 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:10:44.076254 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf85614-c3f7-45a5-a424-d5a815664ab2 None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:10:44.076809 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf85614-c3f7-45a5-a424-d5a815664ab2 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:10:44.076809 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf85614-c3f7-45a5-a424-d5a815664ab2 None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:10:44.078143 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 641/1261] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 00:10:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:10:44.083277 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0174a698-37d0-4354-8a17-6ed56d6d3961 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:10:44.083682 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0174a698-37d0-4354-8a17-6ed56d6d3961 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:10:44.083814 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0174a698-37d0-4354-8a17-6ed56d6d3961 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:10:44.102264 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-0174a698-37d0-4354-8a17-6ed56d6d3961 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:10:44.103439 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-0174a698-37d0-4354-8a17-6ed56d6d3961 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:10:44.179350 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 621/1262] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 00:10:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:10:44.454492 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf85614-c3f7-45a5-a424-d5a815664ab2 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:10:44.467408 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:10:44.566673 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf85614-c3f7-45a5-a424-d5a815664ab2 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:10:44.600452 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3f5377-e63c-4576-9a90-1ebff1d143a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:10:44.601083 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3f5377-e63c-4576-9a90-1ebff1d143a5 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:10:44.601357 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3f5377-e63c-4576-9a90-1ebff1d143a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:10:44.601630 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3f5377-e63c-4576-9a90-1ebff1d143a5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:10:44.612692 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3f5377-e63c-4576-9a90-1ebff1d143a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:10:44.618625 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-ad3f5377-e63c-4576-9a90-1ebff1d143a5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:10:44.618625 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:10:44.618625 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:10:44.618625 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:10:44.618625 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:10:44.618625 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:10:44.618625 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:10:44.618625 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:10:44.618625 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:10:44.618625 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:10:44.618625 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:10:44.618625 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:10:44.618625 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:10:44.618625 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:10:44.618625 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:10:44.618625 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:10:44.619816 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:10:44.619816 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:10:44.619816 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:10:44.619816 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:10:44.619816 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:10:44.619816 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:10:44.619816 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:10:44.619816 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:10:44.619816 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:10:44.619816 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:10:44.619816 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:10:44.619816 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Aug 31 00:10:44.619816 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:10:44.619816 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:10:44.619816 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:10:44.619816 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:10:44.620902 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:10:44.620902 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:10:44.620902 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:10:44.620902 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:10:44.620902 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:10:44.620902 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:10:44.620902 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:10:44.620902 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:10:44.620902 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:10:44.620902 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:10:44.620902 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:10:44.620902 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Aug 31 00:10:44.620902 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 642/1263] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Aug 31 00:10:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:10:44.626252 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0174a698-37d0-4354-8a17-6ed56d6d3961 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:10:44.645283 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:10:44.732530 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0174a698-37d0-4354-8a17-6ed56d6d3961 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:10:44.775548 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f5ae75-401d-48d0-8b23-280c507834d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:10:44.776179 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f5ae75-401d-48d0-8b23-280c507834d0 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:10:44.776450 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f5ae75-401d-48d0-8b23-280c507834d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:10:44.776716 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f5ae75-401d-48d0-8b23-280c507834d0 None admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:10:44.777381 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f5ae75-401d-48d0-8b23-280c507834d0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:10:44.777677 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f5ae75-401d-48d0-8b23-280c507834d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:10:44.779037 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f5ae75-401d-48d0-8b23-280c507834d0 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:10:44.787434 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 622/1264] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 31 00:10:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:10:44.793917 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3f5377-e63c-4576-9a90-1ebff1d143a5 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:10:44.863558 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:10:44.897582 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3f5377-e63c-4576-9a90-1ebff1d143a5 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:10:44.931640 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76b8947-d1ad-4820-a176-cb2f38d0954f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:10:44.932294 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76b8947-d1ad-4820-a176-cb2f38d0954f None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:10:44.932571 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76b8947-d1ad-4820-a176-cb2f38d0954f None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:10:44.932843 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76b8947-d1ad-4820-a176-cb2f38d0954f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:10:44.942947 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76b8947-d1ad-4820-a176-cb2f38d0954f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:10:44.944405 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76b8947-d1ad-4820-a176-cb2f38d0954f None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:10:44.961815 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-f76b8947-d1ad-4820-a176-cb2f38d0954f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:10:44.961815 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:10:44.961815 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:10:44.961815 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:10:44.961815 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:10:44.961815 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:10:44.961815 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:10:44.961815 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:10:44.961815 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:10:44.961815 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:10:44.961815 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:10:44.961815 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:10:44.961815 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:10:44.961815 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:10:44.961815 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:10:44.961815 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:10:44.962963 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:10:44.962963 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:10:44.962963 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:10:44.962963 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:10:44.962963 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:10:44.962963 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:10:44.962963 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:10:44.962963 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Aug 31 00:10:44.962963 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:10:44.962963 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:10:44.962963 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:10:44.962963 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:10:44.962963 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:10:44.962963 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:10:44.962963 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:10:44.962963 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:10:44.962963 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:10:44.963938 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:10:44.963938 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:10:44.963938 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Aug 31 00:10:44.963938 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 643/1265] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 00:10:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:10:44.969843 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f5ae75-401d-48d0-8b23-280c507834d0 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:10:45.058248 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:10:45.081705 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f5ae75-401d-48d0-8b23-280c507834d0 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:10:45.118964 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46735bc0-71a9-433a-a375-1727b7b1a407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:10:45.119659 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46735bc0-71a9-433a-a375-1727b7b1a407 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:10:45.119833 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46735bc0-71a9-433a-a375-1727b7b1a407 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:10:45.120099 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46735bc0-71a9-433a-a375-1727b7b1a407 None admin] PATH_INFO: `/v3/domains` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:10:45.120768 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46735bc0-71a9-433a-a375-1727b7b1a407 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:10:45.121069 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46735bc0-71a9-433a-a375-1727b7b1a407 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:10:45.122437 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46735bc0-71a9-433a-a375-1727b7b1a407 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:10:45.135088 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 623/1266] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 31 00:10:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:10:45.140947 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76b8947-d1ad-4820-a176-cb2f38d0954f None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:10:45.241198 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76b8947-d1ad-4820-a176-cb2f38d0954f None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:10:45.262295 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:10:45.276462 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa01ac0-6874-41af-aaa7-cce447e84ca8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:10:45.277087 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa01ac0-6874-41af-aaa7-cce447e84ca8 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:10:45.277367 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa01ac0-6874-41af-aaa7-cce447e84ca8 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:10:45.277637 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa01ac0-6874-41af-aaa7-cce447e84ca8 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:10:45.285440 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa01ac0-6874-41af-aaa7-cce447e84ca8 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:10:45.286872 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa01ac0-6874-41af-aaa7-cce447e84ca8 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:10:45.297937 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-3aa01ac0-6874-41af-aaa7-cce447e84ca8 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 31 00:10:45.297937 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:10:45.297937 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:10:45.297937 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:10:45.297937 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:10:45.297937 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:10:45.297937 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:10:45.297937 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:10:45.297937 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:10:45.297937 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:10:45.297937 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:10:45.297937 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:10:45.297937 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 00:10:45.297937 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 00:10:45.297937 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 00:10:45.297937 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 00:10:45.299130 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:10:45.299130 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:10:45.299130 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:10:45.299130 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:10:45.299130 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:10:45.299130 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:10:45.299130 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:10:45.299130 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:10:45.299130 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:10:45.299130 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:10:45.299130 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:10:45.299130 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Aug 31 00:10:45.299130 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:10:45.299130 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:10:45.299130 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:10:45.299130 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:10:45.299130 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:10:45.299130 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:10:45.300348 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:10:45.300348 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:10:45.300348 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 00:10:45.300348 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 00:10:45.300348 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 00:10:45.300348 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 00:10:45.300348 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 00:10:45.300348 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 00:10:45.300348 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 31 00:10:45.300348 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Aug 31 00:10:45.300348 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 644/1267] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 00:10:45 2022] GET /identity/v3/users/placement => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:10:45.305661 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46735bc0-71a9-433a-a375-1727b7b1a407 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:10:45.416098 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46735bc0-71a9-433a-a375-1727b7b1a407 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:10:45.450635 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f47ba4-a01a-4c0a-8f27-d1d3ab951dc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:10:45.451242 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f47ba4-a01a-4c0a-8f27-d1d3ab951dc0 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:10:45.451519 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f47ba4-a01a-4c0a-8f27-d1d3ab951dc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:10:45.451791 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f47ba4-a01a-4c0a-8f27-d1d3ab951dc0 None admin] PATH_INFO: `/v3/users` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:10:45.452591 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f47ba4-a01a-4c0a-8f27-d1d3ab951dc0 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:10:45.453001 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f47ba4-a01a-4c0a-8f27-d1d3ab951dc0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:10:45.454364 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f47ba4-a01a-4c0a-8f27-d1d3ab951dc0 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:10:45.464385 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:10:45.482515 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 624/1268] 10.222.0.47 () {56 vars in 1143 bytes} [Wed Aug 31 00:10:45 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:10:45.483966 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa01ac0-6874-41af-aaa7-cce447e84ca8 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:10:45.589940 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa01ac0-6874-41af-aaa7-cce447e84ca8 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:10:45.625022 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3385bf5-f28e-43f1-844e-466fa66cb34e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:10:45.625640 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3385bf5-f28e-43f1-844e-466fa66cb34e None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:10:45.625919 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3385bf5-f28e-43f1-844e-466fa66cb34e None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:10:45.626197 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3385bf5-f28e-43f1-844e-466fa66cb34e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:10:45.637021 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3385bf5-f28e-43f1-844e-466fa66cb34e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:10:45.638477 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3385bf5-f28e-43f1-844e-466fa66cb34e None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:10:45.654070 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-c3385bf5-f28e-43f1-844e-466fa66cb34e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:10:45.654070 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:10:45.654070 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:10:45.654070 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:10:45.654070 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:10:45.654070 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:10:45.654070 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:10:45.654070 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:10:45.654070 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:10:45.654070 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:10:45.654070 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:10:45.654070 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:10:45.654070 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:10:45.654070 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:10:45.654070 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:10:45.654070 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:10:45.655228 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:10:45.655228 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:10:45.655228 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:10:45.655228 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:10:45.655228 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:10:45.655228 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:10:45.655228 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:10:45.655228 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Aug 31 00:10:45.655228 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:10:45.655228 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:10:45.655228 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:10:45.655228 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:10:45.655228 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:10:45.655228 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:10:45.655228 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:10:45.655228 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:10:45.655228 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:10:45.656503 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:10:45.656503 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:10:45.656503 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Aug 31 00:10:45.656503 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 645/1269] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 00:10:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:10:45.661429 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f47ba4-a01a-4c0a-8f27-d1d3ab951dc0 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:10:45.761920 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f47ba4-a01a-4c0a-8f27-d1d3ab951dc0 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:10:45.796892 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8f8f0e-06bf-404b-8098-63448a359004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:10:45.797495 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8f8f0e-06bf-404b-8098-63448a359004 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:10:45.797773 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8f8f0e-06bf-404b-8098-63448a359004 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:10:45.798039 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8f8f0e-06bf-404b-8098-63448a359004 None admin] PATH_INFO: `/v3/domains` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:10:45.798679 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8f8f0e-06bf-404b-8098-63448a359004 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:10:45.798975 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8f8f0e-06bf-404b-8098-63448a359004 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:10:45.800377 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8f8f0e-06bf-404b-8098-63448a359004 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:10:45.812525 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 625/1270] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 31 00:10:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:10:45.818429 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3385bf5-f28e-43f1-844e-466fa66cb34e None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:10:45.851195 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:10:45.922650 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3385bf5-f28e-43f1-844e-466fa66cb34e None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:10:45.955318 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94b553e-aa1c-4a52-966b-bd0694a503c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:10:45.955938 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94b553e-aa1c-4a52-966b-bd0694a503c1 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:10:45.956242 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94b553e-aa1c-4a52-966b-bd0694a503c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:10:45.956513 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94b553e-aa1c-4a52-966b-bd0694a503c1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:10:45.963546 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94b553e-aa1c-4a52-966b-bd0694a503c1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:10:45.965010 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94b553e-aa1c-4a52-966b-bd0694a503c1 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:10:45.978028 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-d94b553e-aa1c-4a52-966b-bd0694a503c1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:10:45.978028 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:10:45.978028 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:10:45.978028 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:10:45.978028 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:10:45.978028 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:10:45.978028 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:10:45.978028 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:10:45.978028 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:10:45.978028 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:10:45.978028 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:10:45.978028 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:10:45.978028 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 00:10:45.978028 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 00:10:45.978028 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 00:10:45.979118 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 00:10:45.979118 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:10:45.979118 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:10:45.979118 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:10:45.979118 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:10:45.979118 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:10:45.979118 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:10:45.979118 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:10:45.979118 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Aug 31 00:10:45.979118 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:10:45.979118 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:10:45.979118 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:10:45.979118 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:10:45.979118 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:10:45.979118 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:10:45.979118 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:10:45.979118 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:10:45.980452 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 00:10:45.980452 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 00:10:45.980452 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:10:45.980452 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:10:45.980452 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:10:45.980452 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:10:45.980452 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:10:45.980452 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Aug 31 00:10:45.980452 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 646/1271] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 31 00:10:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:10:45.985468 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8f8f0e-06bf-404b-8098-63448a359004 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:10:46.044933 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:10:46.087359 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8f8f0e-06bf-404b-8098-63448a359004 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:10:46.121114 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea55ae9-ec8f-4eff-8a5c-35a40981736a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:10:46.121761 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea55ae9-ec8f-4eff-8a5c-35a40981736a None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:10:46.121890 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea55ae9-ec8f-4eff-8a5c-35a40981736a None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:10:46.122162 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea55ae9-ec8f-4eff-8a5c-35a40981736a None admin] PATH_INFO: `/v3/projects` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:10:46.122849 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea55ae9-ec8f-4eff-8a5c-35a40981736a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:10:46.123153 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea55ae9-ec8f-4eff-8a5c-35a40981736a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:10:46.124626 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea55ae9-ec8f-4eff-8a5c-35a40981736a None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:10:46.140478 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 626/1272] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Aug 31 00:10:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:10:46.146584 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94b553e-aa1c-4a52-966b-bd0694a503c1 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:10:46.249081 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:10:46.258430 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94b553e-aa1c-4a52-966b-bd0694a503c1 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:10:46.292635 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07039f0c-d259-49cd-bd6e-183a43f1f0c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:10:46.293291 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07039f0c-d259-49cd-bd6e-183a43f1f0c1 None admin] REQUEST_METHOD: `PUT` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:10:46.293566 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07039f0c-d259-49cd-bd6e-183a43f1f0c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:10:46.293839 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07039f0c-d259-49cd-bd6e-183a43f1f0c1 None admin] PATH_INFO: `/v3/projects/1b647cccb30a427193fc62dbebe0c6f1/users/8f76e01e32264ff7a6a7740ffa0a207d/roles/12f6817f9aaa4e2bb477095a6bed5d0f` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:10:46.295722 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07039f0c-d259-49cd-bd6e-183a43f1f0c1 None admin] RBAC: Authorizing `identity:create_grant(project_id=1b647cccb30a427193fc62dbebe0c6f1, user_id=8f76e01e32264ff7a6a7740ffa0a207d, role_id=12f6817f9aaa4e2bb477095a6bed5d0f)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:10:46.297177 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07039f0c-d259-49cd-bd6e-183a43f1f0c1 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:10:46.310941 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 647/1273] 10.222.0.47 () {58 vars in 1439 bytes} [Wed Aug 31 00:10:46 2022] PUT /identity/v3/projects/1b647cccb30a427193fc62dbebe0c6f1/users/8f76e01e32264ff7a6a7740ffa0a207d/roles/12f6817f9aaa4e2bb477095a6bed5d0f => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:10:48.238991 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec6a383-72d1-47cd-b530-3753ce87ab87 None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:10:48.239514 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec6a383-72d1-47cd-b530-3753ce87ab87 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:10:48.239514 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec6a383-72d1-47cd-b530-3753ce87ab87 None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:10:48.240846 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 627/1274] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 00:10:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:10:48.246355 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaef7187-4f74-429f-ae78-e2e953c59eac None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:10:48.246773 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaef7187-4f74-429f-ae78-e2e953c59eac None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:10:48.246910 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaef7187-4f74-429f-ae78-e2e953c59eac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:10:48.265368 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-aaef7187-4f74-429f-ae78-e2e953c59eac None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:10:48.266573 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-aaef7187-4f74-429f-ae78-e2e953c59eac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:10:48.334730 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 648/1275] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 00:10:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:10:48.625171 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec6a383-72d1-47cd-b530-3753ce87ab87 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:10:48.729653 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec6a383-72d1-47cd-b530-3753ce87ab87 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:10:48.747686 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:10:48.766156 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723942ef-c56e-4c4a-ba5b-8e48ed66e835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:10:48.766783 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723942ef-c56e-4c4a-ba5b-8e48ed66e835 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:10:48.767059 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723942ef-c56e-4c4a-ba5b-8e48ed66e835 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:10:48.767325 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723942ef-c56e-4c4a-ba5b-8e48ed66e835 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:10:48.778171 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723942ef-c56e-4c4a-ba5b-8e48ed66e835 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:10:48.782948 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-723942ef-c56e-4c4a-ba5b-8e48ed66e835 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:10:48.782948 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:10:48.782948 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:10:48.782948 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:10:48.782948 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:10:48.782948 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:10:48.782948 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:10:48.782948 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:10:48.782948 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:10:48.782948 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:10:48.782948 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:10:48.782948 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:10:48.782948 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:10:48.782948 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:10:48.782948 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:10:48.782948 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:10:48.784070 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:10:48.784070 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:10:48.784070 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:10:48.784070 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:10:48.784070 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:10:48.784070 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:10:48.784070 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:10:48.784070 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:10:48.784070 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:10:48.784070 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:10:48.784070 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:10:48.784070 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 31 00:10:48.784070 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:10:48.784070 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:10:48.784070 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:10:48.784070 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:10:48.785535 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:10:48.785535 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:10:48.785535 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:10:48.785535 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:10:48.785535 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:10:48.785535 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:10:48.785535 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:10:48.785535 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:10:48.785535 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:10:48.785535 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:10:48.785535 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:10:48.785535 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 31 00:10:48.785535 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 628/1276] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Aug 31 00:10:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:10:48.790601 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaef7187-4f74-429f-ae78-e2e953c59eac None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:10:48.871633 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:10:48.891026 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaef7187-4f74-429f-ae78-e2e953c59eac None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:10:48.926556 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f520007b-8c52-463a-8a7e-74d7fa39dd5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:10:48.927161 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f520007b-8c52-463a-8a7e-74d7fa39dd5e None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:10:48.927445 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f520007b-8c52-463a-8a7e-74d7fa39dd5e None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:10:48.927723 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f520007b-8c52-463a-8a7e-74d7fa39dd5e None admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:10:48.928410 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f520007b-8c52-463a-8a7e-74d7fa39dd5e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:10:48.928718 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f520007b-8c52-463a-8a7e-74d7fa39dd5e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:10:48.930651 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f520007b-8c52-463a-8a7e-74d7fa39dd5e None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:10:48.938686 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 649/1277] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 31 00:10:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:10:48.944449 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723942ef-c56e-4c4a-ba5b-8e48ed66e835 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:10:49.048078 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723942ef-c56e-4c4a-ba5b-8e48ed66e835 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:10:49.082337 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b06f29-bc48-4290-8af6-37497eab5db7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:10:49.082966 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b06f29-bc48-4290-8af6-37497eab5db7 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:10:49.083245 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b06f29-bc48-4290-8af6-37497eab5db7 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:10:49.083515 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b06f29-bc48-4290-8af6-37497eab5db7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:10:49.093469 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b06f29-bc48-4290-8af6-37497eab5db7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:10:49.094920 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b06f29-bc48-4290-8af6-37497eab5db7 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:10:49.109309 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-f5b06f29-bc48-4290-8af6-37497eab5db7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:10:49.109309 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:10:49.109309 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:10:49.109309 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:10:49.109309 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:10:49.109309 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:10:49.109309 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:10:49.109309 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:10:49.109309 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:10:49.109309 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:10:49.109309 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:10:49.109309 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:10:49.109309 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:10:49.109309 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:10:49.109309 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:10:49.109309 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:10:49.110386 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:10:49.110386 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:10:49.110386 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:10:49.110386 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:10:49.110386 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:10:49.110386 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:10:49.110386 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:10:49.110386 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 31 00:10:49.110386 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:10:49.110386 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:10:49.110386 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:10:49.110386 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:10:49.110386 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:10:49.110386 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:10:49.110386 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:10:49.110386 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:10:49.110386 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:10:49.111471 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:10:49.111471 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:10:49.111471 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 31 00:10:49.111471 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 629/1278] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 00:10:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:10:49.116405 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f520007b-8c52-463a-8a7e-74d7fa39dd5e None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:10:49.217260 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f520007b-8c52-463a-8a7e-74d7fa39dd5e None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:10:49.250834 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c1c3b9-60ea-4f7a-8a36-faa16aa07a9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:10:49.251470 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c1c3b9-60ea-4f7a-8a36-faa16aa07a9f None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:10:49.251694 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c1c3b9-60ea-4f7a-8a36-faa16aa07a9f None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:10:49.251962 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c1c3b9-60ea-4f7a-8a36-faa16aa07a9f None admin] PATH_INFO: `/v3/domains` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:10:49.252646 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c1c3b9-60ea-4f7a-8a36-faa16aa07a9f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:10:49.252947 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c1c3b9-60ea-4f7a-8a36-faa16aa07a9f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:10:49.254300 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c1c3b9-60ea-4f7a-8a36-faa16aa07a9f None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:10:49.265885 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 650/1279] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 31 00:10:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:10:49.271625 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b06f29-bc48-4290-8af6-37497eab5db7 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:10:49.303162 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:10:49.375932 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b06f29-bc48-4290-8af6-37497eab5db7 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:10:49.408497 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896a8415-ce8f-40f8-807f-5c3e1c19b12b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:10:49.409120 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896a8415-ce8f-40f8-807f-5c3e1c19b12b None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:10:49.409393 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896a8415-ce8f-40f8-807f-5c3e1c19b12b None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:10:49.409926 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896a8415-ce8f-40f8-807f-5c3e1c19b12b None admin] PATH_INFO: `/v3/users/placement` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:10:49.418112 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896a8415-ce8f-40f8-807f-5c3e1c19b12b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:10:49.419549 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896a8415-ce8f-40f8-807f-5c3e1c19b12b None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:10:49.431108 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-896a8415-ce8f-40f8-807f-5c3e1c19b12b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 31 00:10:49.431108 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:10:49.431108 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:10:49.431108 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:10:49.431108 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:10:49.431108 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:10:49.431108 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:10:49.431108 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:10:49.431108 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:10:49.431108 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:10:49.431108 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:10:49.431108 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:10:49.431108 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 00:10:49.431108 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 00:10:49.431108 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 00:10:49.431108 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 00:10:49.432503 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:10:49.432503 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:10:49.432503 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:10:49.432503 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:10:49.432503 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:10:49.432503 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:10:49.432503 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:10:49.432503 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:10:49.432503 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:10:49.432503 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:10:49.432503 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:10:49.432503 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 31 00:10:49.432503 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:10:49.432503 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:10:49.432503 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:10:49.432503 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:10:49.432503 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:10:49.432503 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:10:49.433623 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:10:49.433623 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:10:49.433623 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 00:10:49.433623 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 00:10:49.433623 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 00:10:49.433623 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 00:10:49.433623 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 00:10:49.433623 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 00:10:49.433623 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 31 00:10:49.433623 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 31 00:10:49.433623 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 630/1280] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 00:10:49 2022] GET /identity/v3/users/placement => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:10:49.438116 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c1c3b9-60ea-4f7a-8a36-faa16aa07a9f None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:10:49.441965 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:10:49.549744 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c1c3b9-60ea-4f7a-8a36-faa16aa07a9f None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:10:49.584048 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33647086-6330-4a49-8697-80f5b60f3cab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:10:49.584684 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33647086-6330-4a49-8697-80f5b60f3cab None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:10:49.584967 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33647086-6330-4a49-8697-80f5b60f3cab None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:10:49.585242 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33647086-6330-4a49-8697-80f5b60f3cab None admin] PATH_INFO: `/v3/users` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:10:49.586516 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33647086-6330-4a49-8697-80f5b60f3cab None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:10:49.586830 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33647086-6330-4a49-8697-80f5b60f3cab None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:10:49.588326 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33647086-6330-4a49-8697-80f5b60f3cab None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:10:49.607061 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 651/1281] 10.222.0.47 () {56 vars in 1143 bytes} [Wed Aug 31 00:10:49 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:10:49.612862 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896a8415-ce8f-40f8-807f-5c3e1c19b12b None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:10:49.704571 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:10:49.714857 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896a8415-ce8f-40f8-807f-5c3e1c19b12b None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:10:49.749162 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08004a9a-7aca-48d5-bbaf-10fbd4e8f2b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:10:49.749751 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08004a9a-7aca-48d5-bbaf-10fbd4e8f2b8 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:10:49.750025 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08004a9a-7aca-48d5-bbaf-10fbd4e8f2b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:10:49.750295 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08004a9a-7aca-48d5-bbaf-10fbd4e8f2b8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:10:49.819646 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08004a9a-7aca-48d5-bbaf-10fbd4e8f2b8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:10:49.821167 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08004a9a-7aca-48d5-bbaf-10fbd4e8f2b8 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:10:49.909330 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:10:49.920764 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 631/1282] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 31 00:10:49 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 00:10:49.926696 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33647086-6330-4a49-8697-80f5b60f3cab None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:10:49.989081 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:10:50.028556 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33647086-6330-4a49-8697-80f5b60f3cab None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:10:50.061896 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7691dcb8-e154-459f-8b17-fff932331719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:10:50.062523 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7691dcb8-e154-459f-8b17-fff932331719 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:10:50.062802 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7691dcb8-e154-459f-8b17-fff932331719 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:10:50.063075 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7691dcb8-e154-459f-8b17-fff932331719 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:10:50.075328 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7691dcb8-e154-459f-8b17-fff932331719 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:10:50.076732 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7691dcb8-e154-459f-8b17-fff932331719 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:10:50.092233 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-7691dcb8-e154-459f-8b17-fff932331719 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:10:50.092233 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:10:50.092233 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:10:50.092233 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:10:50.092233 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:10:50.092233 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:10:50.092233 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:10:50.092233 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:10:50.092233 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:10:50.092233 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:10:50.092233 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:10:50.092233 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:10:50.092233 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:10:50.092233 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:10:50.092233 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:10:50.092233 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:10:50.093378 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:10:50.093378 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:10:50.093378 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:10:50.093378 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:10:50.093378 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:10:50.093378 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:10:50.093378 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:10:50.093378 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Aug 31 00:10:50.093378 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:10:50.093378 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:10:50.093378 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:10:50.093378 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:10:50.093378 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:10:50.093378 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:10:50.093378 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:10:50.093378 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:10:50.093378 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:10:50.094521 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:10:50.094521 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:10:50.094521 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Aug 31 00:10:50.094521 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 652/1283] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 00:10:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:10:50.099446 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08004a9a-7aca-48d5-bbaf-10fbd4e8f2b8 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:10:50.200096 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08004a9a-7aca-48d5-bbaf-10fbd4e8f2b8 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:10:50.234498 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64eca0a-2816-4e2d-b2f0-a945aa53fe5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:10:50.235101 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64eca0a-2816-4e2d-b2f0-a945aa53fe5d None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:10:50.235382 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64eca0a-2816-4e2d-b2f0-a945aa53fe5d None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:10:50.235657 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64eca0a-2816-4e2d-b2f0-a945aa53fe5d None admin] PATH_INFO: `/v3/domains` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:10:50.236326 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64eca0a-2816-4e2d-b2f0-a945aa53fe5d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:10:50.236632 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64eca0a-2816-4e2d-b2f0-a945aa53fe5d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:10:50.238000 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64eca0a-2816-4e2d-b2f0-a945aa53fe5d None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:10:50.249549 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 632/1284] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 31 00:10:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:10:50.255185 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7691dcb8-e154-459f-8b17-fff932331719 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:10:50.357063 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7691dcb8-e154-459f-8b17-fff932331719 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:10:50.370812 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:10:50.391344 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b1ffdb-806e-46e4-b0c7-7e594187da2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:10:50.391963 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b1ffdb-806e-46e4-b0c7-7e594187da2e None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:10:50.392266 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b1ffdb-806e-46e4-b0c7-7e594187da2e None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:10:50.392537 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b1ffdb-806e-46e4-b0c7-7e594187da2e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:10:50.399571 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b1ffdb-806e-46e4-b0c7-7e594187da2e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:10:50.401032 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b1ffdb-806e-46e4-b0c7-7e594187da2e None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:10:50.412707 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-06b1ffdb-806e-46e4-b0c7-7e594187da2e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:10:50.412707 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:10:50.412707 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:10:50.412707 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:10:50.412707 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:10:50.412707 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:10:50.412707 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:10:50.412707 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:10:50.412707 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:10:50.412707 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:10:50.412707 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:10:50.412707 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:10:50.412707 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 00:10:50.412707 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 00:10:50.412707 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 00:10:50.419031 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 00:10:50.419031 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:10:50.419031 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:10:50.419031 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:10:50.419031 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:10:50.419031 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:10:50.419031 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:10:50.419031 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:10:50.419031 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Aug 31 00:10:50.419031 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:10:50.419031 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:10:50.419031 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:10:50.419031 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:10:50.419031 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:10:50.419031 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:10:50.419031 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:10:50.419031 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:10:50.420281 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 00:10:50.420281 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 00:10:50.420281 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:10:50.420281 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:10:50.420281 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:10:50.420281 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:10:50.420281 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:10:50.420281 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: ERROR keystone.server.flask.application Aug 31 00:10:50.420281 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 653/1285] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 31 00:10:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:10:50.420905 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64eca0a-2816-4e2d-b2f0-a945aa53fe5d None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:10:50.476606 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:10:50.532635 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64eca0a-2816-4e2d-b2f0-a945aa53fe5d None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:10:50.569738 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3780920c-c09f-4ac5-8b9e-08e0c9be4179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:10:50.570929 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3780920c-c09f-4ac5-8b9e-08e0c9be4179 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:10:50.571248 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3780920c-c09f-4ac5-8b9e-08e0c9be4179 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:10:50.571523 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3780920c-c09f-4ac5-8b9e-08e0c9be4179 None admin] PATH_INFO: `/v3/projects` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:10:50.572271 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3780920c-c09f-4ac5-8b9e-08e0c9be4179 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:10:50.572578 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3780920c-c09f-4ac5-8b9e-08e0c9be4179 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:10:50.574033 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3780920c-c09f-4ac5-8b9e-08e0c9be4179 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:10:50.586635 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 633/1286] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Aug 31 00:10:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:10:50.592873 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b1ffdb-806e-46e4-b0c7-7e594187da2e None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:10:50.697980 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b1ffdb-806e-46e4-b0c7-7e594187da2e None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:10:50.737509 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bebabf-b31f-40e5-b2fb-89cd9beecf3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:10:50.738105 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bebabf-b31f-40e5-b2fb-89cd9beecf3b None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:10:50.738382 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bebabf-b31f-40e5-b2fb-89cd9beecf3b None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:10:50.738653 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bebabf-b31f-40e5-b2fb-89cd9beecf3b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:10:50.739376 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bebabf-b31f-40e5-b2fb-89cd9beecf3b None admin] RBAC: Adding query filter params (role.id=12f6817f9aaa4e2bb477095a6bed5d0f, scope.project.id=1b647cccb30a427193fc62dbebe0c6f1, user.id=8f76e01e32264ff7a6a7740ffa0a207d) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:10:50.739688 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bebabf-b31f-40e5-b2fb-89cd9beecf3b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:10:50.741161 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bebabf-b31f-40e5-b2fb-89cd9beecf3b None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:10:50.748204 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 654/1287] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 31 00:10:50 2022] GET /identity/v3/role_assignments?user.id=8f76e01e32264ff7a6a7740ffa0a207d&scope.project.id=1b647cccb30a427193fc62dbebe0c6f1&role.id=12f6817f9aaa4e2bb477095a6bed5d0f => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:10:52.719883 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566f3561-9f7c-4462-a187-9e82416395b8 None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:10:52.720460 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566f3561-9f7c-4462-a187-9e82416395b8 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:10:52.720460 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566f3561-9f7c-4462-a187-9e82416395b8 None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:10:52.721771 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 634/1288] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 00:10:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:10:52.727330 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791373e0-7ebc-450c-9414-d423d795b9f0 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:10:52.727881 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791373e0-7ebc-450c-9414-d423d795b9f0 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:10:52.727881 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791373e0-7ebc-450c-9414-d423d795b9f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:10:52.747593 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-791373e0-7ebc-450c-9414-d423d795b9f0 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:10:52.748831 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-791373e0-7ebc-450c-9414-d423d795b9f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:10:52.781292 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:10:52.822991 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 655/1289] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 00:10:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:10:53.106739 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566f3561-9f7c-4462-a187-9e82416395b8 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:10:53.213191 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566f3561-9f7c-4462-a187-9e82416395b8 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:10:53.224508 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:10:53.249473 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf462cc-e694-46e8-baab-7e52606f430c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:10:53.250011 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf462cc-e694-46e8-baab-7e52606f430c None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:10:53.250288 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf462cc-e694-46e8-baab-7e52606f430c None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:10:53.250564 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf462cc-e694-46e8-baab-7e52606f430c None admin] PATH_INFO: `/v3/services/placement` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:10:53.251145 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf462cc-e694-46e8-baab-7e52606f430c None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:10:53.252556 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf462cc-e694-46e8-baab-7e52606f430c None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:10:53.262058 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-fdf462cc-e694-46e8-baab-7e52606f430c None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 31 00:10:53.262058 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:10:53.262058 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 00:10:53.262058 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 00:10:53.262058 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 00:10:53.262058 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 00:10:53.262058 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 00:10:53.262058 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:10:53.262058 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 31 00:10:53.262058 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 31 00:10:53.262058 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 00:10:53.262058 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 31 00:10:53.262058 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:10:53.262058 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:10:53.262058 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:10:53.262058 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:10:53.262058 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:10:53.263393 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:10:53.263393 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:10:53.263393 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:10:53.263393 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:10:53.263393 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:10:53.263393 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:10:53.263393 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 00:10:53.263393 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 00:10:53.263393 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 00:10:53.263393 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 00:10:53.263393 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:10:53.263393 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:10:53.263393 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:10:53.263393 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:10:53.263393 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:10:53.263393 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:10:53.264592 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:10:53.264592 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 31 00:10:53.264592 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:10:53.264592 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:10:53.264592 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:10:53.264592 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:10:53.264592 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:10:53.264592 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:10:53.264592 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:10:53.264592 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:10:53.264592 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 00:10:53.264592 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:10:53.264592 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 31 00:10:53.264592 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 31 00:10:53.264592 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 635/1290] 10.222.0.47 () {56 vars in 1117 bytes} [Wed Aug 31 00:10:53 2022] GET /identity/v3/services/placement => generated 90 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:10:53.269326 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791373e0-7ebc-450c-9414-d423d795b9f0 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:10:53.374588 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791373e0-7ebc-450c-9414-d423d795b9f0 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:10:53.409144 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7937f67e-cf24-4f6f-8a0d-712862f66796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:10:53.409999 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7937f67e-cf24-4f6f-8a0d-712862f66796 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:10:53.410280 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7937f67e-cf24-4f6f-8a0d-712862f66796 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:10:53.410554 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7937f67e-cf24-4f6f-8a0d-712862f66796 None admin] PATH_INFO: `/v3/services` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:10:53.411183 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7937f67e-cf24-4f6f-8a0d-712862f66796 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:10:53.411485 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7937f67e-cf24-4f6f-8a0d-712862f66796 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:10:53.412872 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7937f67e-cf24-4f6f-8a0d-712862f66796 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:10:53.418452 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 656/1291] 10.222.0.47 () {56 vars in 1116 bytes} [Wed Aug 31 00:10:53 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:10:53.424442 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf462cc-e694-46e8-baab-7e52606f430c None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:10:53.546306 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf462cc-e694-46e8-baab-7e52606f430c None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:10:53.580763 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527a0b59-2d9f-4ce8-a562-81b917337410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:10:53.581383 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527a0b59-2d9f-4ce8-a562-81b917337410 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:10:53.581663 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527a0b59-2d9f-4ce8-a562-81b917337410 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:10:53.581937 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527a0b59-2d9f-4ce8-a562-81b917337410 None admin] PATH_INFO: `/v3/services` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:10:53.582572 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527a0b59-2d9f-4ce8-a562-81b917337410 None admin] RBAC: Adding query filter params (type=placement) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:10:53.582876 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527a0b59-2d9f-4ce8-a562-81b917337410 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:10:53.584297 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527a0b59-2d9f-4ce8-a562-81b917337410 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:10:53.589923 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 636/1292] 10.222.0.47 () {56 vars in 1116 bytes} [Wed Aug 31 00:10:53 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:10:55.550671 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8384d4-834d-4196-98b7-e791cd4c93a2 None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:10:55.551246 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8384d4-834d-4196-98b7-e791cd4c93a2 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:10:55.551246 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8384d4-834d-4196-98b7-e791cd4c93a2 None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:10:55.552591 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 657/1293] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 00:10:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:10:55.558135 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691f359a-5041-462b-81b9-3d88f9b443fe None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:10:55.558573 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691f359a-5041-462b-81b9-3d88f9b443fe None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:10:55.558753 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691f359a-5041-462b-81b9-3d88f9b443fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:10:55.579177 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-691f359a-5041-462b-81b9-3d88f9b443fe None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:10:55.580405 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-691f359a-5041-462b-81b9-3d88f9b443fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:10:55.612890 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:10:55.656309 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 637/1294] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 00:10:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:10:55.928369 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8384d4-834d-4196-98b7-e791cd4c93a2 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:10:55.961880 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:10:56.036027 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8384d4-834d-4196-98b7-e791cd4c93a2 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:10:56.071134 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583dc69a-1c7c-4faa-b903-72cde5a75dad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:10:56.071735 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583dc69a-1c7c-4faa-b903-72cde5a75dad None admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:10:56.072018 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583dc69a-1c7c-4faa-b903-72cde5a75dad None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:10:56.072326 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583dc69a-1c7c-4faa-b903-72cde5a75dad None admin] PATH_INFO: `/v3/services` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:10:56.072978 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583dc69a-1c7c-4faa-b903-72cde5a75dad None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:10:56.074346 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583dc69a-1c7c-4faa-b903-72cde5a75dad None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:10:56.088929 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 658/1295] 10.222.0.47 () {60 vars in 1141 bytes} [Wed Aug 31 00:10:55 2022] POST /identity/v3/services => generated 246 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:10:58.037561 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d53885-31a6-4928-b590-d125bb0c16d8 None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:10:58.038134 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d53885-31a6-4928-b590-d125bb0c16d8 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:10:58.038134 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d53885-31a6-4928-b590-d125bb0c16d8 None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:10:58.040087 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 638/1296] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 00:10:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:10:58.045520 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a196f9ff-e1bc-4054-8e47-a74931613868 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:10:58.045956 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a196f9ff-e1bc-4054-8e47-a74931613868 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:10:58.046077 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a196f9ff-e1bc-4054-8e47-a74931613868 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:10:58.064809 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-a196f9ff-e1bc-4054-8e47-a74931613868 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:10:58.066017 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-a196f9ff-e1bc-4054-8e47-a74931613868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:10:58.140929 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 659/1297] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 00:10:58 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:10:58.416732 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d53885-31a6-4928-b590-d125bb0c16d8 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:10:58.533721 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d53885-31a6-4928-b590-d125bb0c16d8 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:10:58.568490 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55268d4-29b3-42f6-a796-f7ac79e47015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:10:58.569120 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55268d4-29b3-42f6-a796-f7ac79e47015 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:10:58.569399 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55268d4-29b3-42f6-a796-f7ac79e47015 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:10:58.569669 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55268d4-29b3-42f6-a796-f7ac79e47015 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:10:58.570837 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55268d4-29b3-42f6-a796-f7ac79e47015 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:10:58.572749 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55268d4-29b3-42f6-a796-f7ac79e47015 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:10:58.581505 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-c55268d4-29b3-42f6-a796-f7ac79e47015 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 31 00:10:58.581505 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:10:58.581505 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 00:10:58.581505 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 00:10:58.581505 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 00:10:58.581505 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 00:10:58.581505 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 00:10:58.581505 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:10:58.581505 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 31 00:10:58.581505 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 31 00:10:58.581505 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 00:10:58.581505 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 31 00:10:58.581505 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:10:58.581505 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:10:58.581505 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:10:58.581505 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:10:58.581505 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:10:58.582987 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:10:58.582987 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:10:58.582987 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:10:58.582987 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:10:58.582987 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:10:58.582987 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:10:58.582987 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 00:10:58.582987 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 00:10:58.582987 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 00:10:58.582987 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 00:10:58.582987 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:10:58.582987 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:10:58.582987 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:10:58.582987 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:10:58.582987 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:10:58.582987 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:10:58.583967 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:10:58.583967 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 31 00:10:58.583967 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:10:58.583967 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:10:58.583967 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:10:58.583967 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:10:58.583967 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:10:58.583967 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:10:58.583967 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:10:58.583967 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:10:58.583967 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 00:10:58.583967 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:10:58.583967 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 31 00:10:58.583967 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 31 00:10:58.583967 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 639/1298] 10.222.0.47 () {56 vars in 1117 bytes} [Wed Aug 31 00:10:58 2022] GET /identity/v3/services/placement => generated 90 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:10:58.589999 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a196f9ff-e1bc-4054-8e47-a74931613868 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:10:58.608499 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:10:58.692464 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a196f9ff-e1bc-4054-8e47-a74931613868 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:10:58.726805 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f37736-c761-406a-98ec-ef6fc040c8b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:10:58.727418 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f37736-c761-406a-98ec-ef6fc040c8b8 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:10:58.727696 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f37736-c761-406a-98ec-ef6fc040c8b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:10:58.727967 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f37736-c761-406a-98ec-ef6fc040c8b8 None admin] PATH_INFO: `/v3/services` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:10:58.728622 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f37736-c761-406a-98ec-ef6fc040c8b8 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:10:58.728922 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f37736-c761-406a-98ec-ef6fc040c8b8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:10:58.730287 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f37736-c761-406a-98ec-ef6fc040c8b8 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:10:58.735490 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 660/1299] 10.222.0.47 () {56 vars in 1116 bytes} [Wed Aug 31 00:10:58 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:10:58.741613 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55268d4-29b3-42f6-a796-f7ac79e47015 None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:10:58.776282 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:10:58.848089 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55268d4-29b3-42f6-a796-f7ac79e47015 None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:10:58.882426 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a26f369-6225-43c1-8d4e-5dd428352477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:10:58.883647 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a26f369-6225-43c1-8d4e-5dd428352477 None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:10:58.883930 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a26f369-6225-43c1-8d4e-5dd428352477 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:10:58.884228 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a26f369-6225-43c1-8d4e-5dd428352477 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:10:58.884932 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a26f369-6225-43c1-8d4e-5dd428352477 None admin] RBAC: Adding query filter params (interface=public, service_id=ed6e20cfa1194dc380fe9044c6e70966, region_id=RegionOne) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:10:58.885244 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a26f369-6225-43c1-8d4e-5dd428352477 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:10:58.886620 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a26f369-6225-43c1-8d4e-5dd428352477 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:10:58.891655 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 640/1300] 10.222.0.47 () {56 vars in 1251 bytes} [Wed Aug 31 00:10:58 2022] GET /identity/v3/endpoints?service_id=ed6e20cfa1194dc380fe9044c6e70966&interface=public®ion_id=RegionOne => generated 194 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:10:58.897386 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f37736-c761-406a-98ec-ef6fc040c8b8 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:10:58.982560 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:10:59.002210 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f37736-c761-406a-98ec-ef6fc040c8b8 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:10:59.036976 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcb3f53-b736-47a2-856a-3b77afadd1fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:10:59.037590 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcb3f53-b736-47a2-856a-3b77afadd1fd None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:10:59.037872 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcb3f53-b736-47a2-856a-3b77afadd1fd None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:10:59.038148 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcb3f53-b736-47a2-856a-3b77afadd1fd None admin] PATH_INFO: `/v3/services` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:10:59.038760 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcb3f53-b736-47a2-856a-3b77afadd1fd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:10:59.040802 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcb3f53-b736-47a2-856a-3b77afadd1fd None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:10:59.047803 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 661/1301] 10.222.0.47 () {56 vars in 1087 bytes} [Wed Aug 31 00:10:58 2022] GET /identity/v3/services => generated 2191 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:11:00.980915 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f0502d-ee68-4e9d-bc5e-16911e7c864e None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:11:00.981466 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f0502d-ee68-4e9d-bc5e-16911e7c864e None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:11:00.981466 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f0502d-ee68-4e9d-bc5e-16911e7c864e None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:11:00.982827 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 641/1302] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 00:11:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:11:00.988550 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fa2ed8-5819-424e-ab40-d97f0f4cabc1 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:11:00.989008 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fa2ed8-5819-424e-ab40-d97f0f4cabc1 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:11:00.989140 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fa2ed8-5819-424e-ab40-d97f0f4cabc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:11:01.009736 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-34fa2ed8-5819-424e-ab40-d97f0f4cabc1 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:11:01.010922 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-34fa2ed8-5819-424e-ab40-d97f0f4cabc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:11:01.079448 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 662/1303] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 00:11:00 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:11:01.359916 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f0502d-ee68-4e9d-bc5e-16911e7c864e None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:11:01.457265 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:11:01.464765 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f0502d-ee68-4e9d-bc5e-16911e7c864e None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:11:01.500671 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d523cda9-a4cb-4456-aada-812a56742dda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:11:01.501314 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d523cda9-a4cb-4456-aada-812a56742dda None admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:11:01.501595 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d523cda9-a4cb-4456-aada-812a56742dda None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:11:01.501869 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d523cda9-a4cb-4456-aada-812a56742dda None admin] PATH_INFO: `/v3/services/placement` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:11:01.502453 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d523cda9-a4cb-4456-aada-812a56742dda None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:11:01.503824 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d523cda9-a4cb-4456-aada-812a56742dda None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:11:01.513457 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application [None req-d523cda9-a4cb-4456-aada-812a56742dda None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 31 00:11:01.513457 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:11:01.513457 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 00:11:01.513457 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 00:11:01.513457 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 00:11:01.513457 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 00:11:01.513457 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 00:11:01.513457 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:11:01.513457 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 31 00:11:01.513457 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 31 00:11:01.513457 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 00:11:01.513457 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 31 00:11:01.513457 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:11:01.513457 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:11:01.513457 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:11:01.513457 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:11:01.513457 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:11:01.514731 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:11:01.514731 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:11:01.514731 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:11:01.514731 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:11:01.514731 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:11:01.514731 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:11:01.514731 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 00:11:01.514731 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 00:11:01.514731 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 00:11:01.514731 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 00:11:01.514731 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:11:01.514731 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:11:01.514731 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:11:01.514731 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:11:01.514731 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:11:01.514731 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:11:01.515911 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:11:01.515911 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application with Lock( Aug 31 00:11:01.515911 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:11:01.515911 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:11:01.515911 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:11:01.515911 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:11:01.515911 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:11:01.515911 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:11:01.515911 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:11:01.515911 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:11:01.515911 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 00:11:01.515911 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:11:01.515911 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 31 00:11:01.515911 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: ERROR keystone.server.flask.application Aug 31 00:11:01.515911 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 642/1304] 10.222.0.47 () {56 vars in 1117 bytes} [Wed Aug 31 00:11:01 2022] GET /identity/v3/services/placement => generated 90 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:11:01.520706 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fa2ed8-5819-424e-ab40-d97f0f4cabc1 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:11:01.602654 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:11:01.626040 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fa2ed8-5819-424e-ab40-d97f0f4cabc1 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:11:01.661180 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86e6949-7148-4a39-a02b-7378391a560c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:11:01.661803 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86e6949-7148-4a39-a02b-7378391a560c None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:11:01.662086 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86e6949-7148-4a39-a02b-7378391a560c None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:11:01.662364 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86e6949-7148-4a39-a02b-7378391a560c None admin] PATH_INFO: `/v3/services` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:11:01.663003 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86e6949-7148-4a39-a02b-7378391a560c None admin] RBAC: Adding query filter params (name=placement) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:11:01.663310 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86e6949-7148-4a39-a02b-7378391a560c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:11:01.665375 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86e6949-7148-4a39-a02b-7378391a560c None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:11:01.670642 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 663/1305] 10.222.0.47 () {56 vars in 1116 bytes} [Wed Aug 31 00:11:01 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:11:01.676980 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d523cda9-a4cb-4456-aada-812a56742dda None admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:11:01.777292 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d523cda9-a4cb-4456-aada-812a56742dda None admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:11:01.812866 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1354de73-b071-4be4-9cd3-0548af70cb39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:11:01.813474 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1354de73-b071-4be4-9cd3-0548af70cb39 None admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:11:01.813753 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1354de73-b071-4be4-9cd3-0548af70cb39 None admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:11:01.814023 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1354de73-b071-4be4-9cd3-0548af70cb39 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:11:01.814679 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1354de73-b071-4be4-9cd3-0548af70cb39 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:11:01.816053 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1354de73-b071-4be4-9cd3-0548af70cb39 None admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:11:01.836411 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 643/1306] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 31 00:11:01 2022] POST /identity/v3/endpoints => generated 331 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:11:11.667763 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=30 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:11:11.831523 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:12:07.728052 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aeb2cb-6422-442c-b387-d7769b44ea3f None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:12:07.729153 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aeb2cb-6422-442c-b387-d7769b44ea3f None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:12:07.729769 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aeb2cb-6422-442c-b387-d7769b44ea3f None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:12:07.735481 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 664/1307] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 00:12:07 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:12:07.736867 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78612d2f-5951-4f4d-bc6f-ebfca8df743e None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:12:07.737318 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78612d2f-5951-4f4d-bc6f-ebfca8df743e None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:12:07.737402 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78612d2f-5951-4f4d-bc6f-ebfca8df743e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:12:07.891374 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-78612d2f-5951-4f4d-bc6f-ebfca8df743e None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:12:07.892643 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-78612d2f-5951-4f4d-bc6f-ebfca8df743e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:12:08.009723 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 644/1308] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 00:12:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:12:08.314240 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbba8ed3-72c6-4c25-b066-48b691bbd53e None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:12:08.315013 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbba8ed3-72c6-4c25-b066-48b691bbd53e None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:12:08.315515 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbba8ed3-72c6-4c25-b066-48b691bbd53e None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:12:08.317781 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 665/1309] 10.222.0.47 () {54 vars in 965 bytes} [Wed Aug 31 00:12:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:12:08.325166 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7cec07-2475-4eba-bca9-f96cceefe824 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:12:08.325507 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7cec07-2475-4eba-bca9-f96cceefe824 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:12:08.325722 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7cec07-2475-4eba-bca9-f96cceefe824 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:12:08.419239 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-6c7cec07-2475-4eba-bca9-f96cceefe824 None None] MFA Rules not processed for user `daae792cd11d4c4ca7aae0558998aced`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:12:08.420409 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-6c7cec07-2475-4eba-bca9-f96cceefe824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:12:08.447173 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:12:08.520399 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 645/1310] 10.222.0.47 () {58 vars in 1062 bytes} [Wed Aug 31 00:12:08 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:12:08.530263 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbba8ed3-72c6-4c25-b066-48b691bbd53e None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:12:08.533798 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-bbba8ed3-72c6-4c25-b066-48b691bbd53e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:12:08.687302 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbba8ed3-72c6-4c25-b066-48b691bbd53e None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:12:08.777149 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a937d46-6282-46b2-9b44-72fca367ba00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'daae792cd11d4c4ca7aae0558998aced', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:12:08.777775 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a937d46-6282-46b2-9b44-72fca367ba00 service neutron] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:12:08.778028 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a937d46-6282-46b2-9b44-72fca367ba00 service neutron] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:12:08.778237 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a937d46-6282-46b2-9b44-72fca367ba00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:12:08.781502 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-7a937d46-6282-46b2-9b44-72fca367ba00 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:12:08.862994 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:12:08.931311 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a937d46-6282-46b2-9b44-72fca367ba00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:12:08.932803 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a937d46-6282-46b2-9b44-72fca367ba00 service neutron] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:12:08.955410 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 666/1311] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:12:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:12:11.280117 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909dfbba-1d8a-4e51-a6ec-e2779a97b3e9 None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:12:11.280653 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909dfbba-1d8a-4e51-a6ec-e2779a97b3e9 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:12:11.280653 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909dfbba-1d8a-4e51-a6ec-e2779a97b3e9 None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:12:11.284263 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 646/1312] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 00:12:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:12:11.289002 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d97e120-973c-4a22-912a-d427cead52af None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:12:11.289583 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d97e120-973c-4a22-912a-d427cead52af None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:12:11.289976 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d97e120-973c-4a22-912a-d427cead52af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:12:11.383682 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-6d97e120-973c-4a22-912a-d427cead52af None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:12:11.384962 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-6d97e120-973c-4a22-912a-d427cead52af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:12:11.499929 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 667/1313] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 00:12:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:12:11.797554 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fad31c-a7eb-4889-b545-2234accbc455 None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:12:11.797950 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fad31c-a7eb-4889-b545-2234accbc455 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:12:11.798082 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fad31c-a7eb-4889-b545-2234accbc455 None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:12:11.799442 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 647/1314] 10.222.0.47 () {54 vars in 965 bytes} [Wed Aug 31 00:12:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:12:11.805707 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec56ea96-f45e-4d60-8f88-94607dd58464 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:12:11.805993 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec56ea96-f45e-4d60-8f88-94607dd58464 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:12:11.806268 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec56ea96-f45e-4d60-8f88-94607dd58464 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:12:11.818423 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:12:11.885037 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-ec56ea96-f45e-4d60-8f88-94607dd58464 None None] MFA Rules not processed for user `daae792cd11d4c4ca7aae0558998aced`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:12:11.886231 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-ec56ea96-f45e-4d60-8f88-94607dd58464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:12:11.965853 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 668/1315] 10.222.0.47 () {58 vars in 1062 bytes} [Wed Aug 31 00:12:11 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:12:11.974847 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fad31c-a7eb-4889-b545-2234accbc455 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:12:11.977118 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-36fad31c-a7eb-4889-b545-2234accbc455 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:12:12.082550 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fad31c-a7eb-4889-b545-2234accbc455 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:12:12.154472 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:12:12.157126 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb86096-971f-4170-abde-3f6a1ff7d4d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'daae792cd11d4c4ca7aae0558998aced', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:12:12.157922 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb86096-971f-4170-abde-3f6a1ff7d4d2 service neutron] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:12:12.158414 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb86096-971f-4170-abde-3f6a1ff7d4d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:12:12.158740 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb86096-971f-4170-abde-3f6a1ff7d4d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:12:12.160869 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-bdb86096-971f-4170-abde-3f6a1ff7d4d2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:12:12.269089 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb86096-971f-4170-abde-3f6a1ff7d4d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:12:12.270527 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb86096-971f-4170-abde-3f6a1ff7d4d2 service neutron] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:12:12.288756 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 648/1316] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:12:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:12:14.757371 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2ac63a-b17e-45e4-b484-6ae6f5c83735 None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:12:14.758014 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2ac63a-b17e-45e4-b484-6ae6f5c83735 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:12:14.758014 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2ac63a-b17e-45e4-b484-6ae6f5c83735 None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:12:14.759258 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 669/1317] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 00:12:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:12:14.764533 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b21df8-2f4f-4792-bc55-50f7729ef37d None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:12:14.764968 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b21df8-2f4f-4792-bc55-50f7729ef37d None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:12:14.765061 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b21df8-2f4f-4792-bc55-50f7729ef37d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:12:14.833057 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-25b21df8-2f4f-4792-bc55-50f7729ef37d None None] MFA Rules not processed for user `053c6535fa2e4cb595fbd3b2fe32ca43`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:12:14.834268 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-25b21df8-2f4f-4792-bc55-50f7729ef37d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:12:14.887400 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:12:14.934424 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 649/1318] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 00:12:14 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:12:15.243184 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2ac63a-b17e-45e4-b484-6ae6f5c83735 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:12:15.244792 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-ee2ac63a-b17e-45e4-b484-6ae6f5c83735 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:12:15.349258 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2ac63a-b17e-45e4-b484-6ae6f5c83735 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:12:15.352716 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:12:15.423853 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe805d2-e17b-4f3d-82e8-b6b283da911d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'daae792cd11d4c4ca7aae0558998aced', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:12:15.424491 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe805d2-e17b-4f3d-82e8-b6b283da911d service neutron] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:12:15.424776 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe805d2-e17b-4f3d-82e8-b6b283da911d service neutron] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:12:15.425051 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe805d2-e17b-4f3d-82e8-b6b283da911d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:12:15.426729 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-1fe805d2-e17b-4f3d-82e8-b6b283da911d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:12:15.541332 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe805d2-e17b-4f3d-82e8-b6b283da911d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:12:15.542706 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe805d2-e17b-4f3d-82e8-b6b283da911d service neutron] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:12:15.563210 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 670/1319] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:12:15 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:12:18.079818 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692bc288-ea40-4303-b806-1d695ebfba00 None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:12:18.080392 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692bc288-ea40-4303-b806-1d695ebfba00 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:12:18.080392 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692bc288-ea40-4303-b806-1d695ebfba00 None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:12:18.081782 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 650/1320] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 00:12:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:12:18.087489 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d10a75c-d1d2-4bbd-b53b-1a73530182c5 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:12:18.087955 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d10a75c-d1d2-4bbd-b53b-1a73530182c5 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:12:18.088058 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d10a75c-d1d2-4bbd-b53b-1a73530182c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:12:18.129052 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:12:18.155924 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-3d10a75c-d1d2-4bbd-b53b-1a73530182c5 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:12:18.157205 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-3d10a75c-d1d2-4bbd-b53b-1a73530182c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:12:18.256419 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 671/1321] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 00:12:18 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:12:18.545570 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692bc288-ea40-4303-b806-1d695ebfba00 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:12:18.547181 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-692bc288-ea40-4303-b806-1d695ebfba00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:12:18.649461 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692bc288-ea40-4303-b806-1d695ebfba00 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:12:18.722257 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1844521-6932-4254-b738-fb6a2b0706fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'daae792cd11d4c4ca7aae0558998aced', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:12:18.722856 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1844521-6932-4254-b738-fb6a2b0706fe service neutron] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:12:18.723131 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1844521-6932-4254-b738-fb6a2b0706fe service neutron] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:12:18.723397 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1844521-6932-4254-b738-fb6a2b0706fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:12:18.725035 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-c1844521-6932-4254-b738-fb6a2b0706fe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:12:18.733503 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:12:18.837171 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1844521-6932-4254-b738-fb6a2b0706fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:12:18.838518 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1844521-6932-4254-b738-fb6a2b0706fe service neutron] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:12:18.856862 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 651/1322] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:12:18 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:12:21.443969 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05087ec3-240c-440c-9cce-244a62cec92a None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:12:21.444455 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05087ec3-240c-440c-9cce-244a62cec92a None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:12:21.444550 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05087ec3-240c-440c-9cce-244a62cec92a None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:12:21.446891 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 672/1323] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 00:12:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:12:21.452349 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc5fdad-6924-4066-b27f-4337cc60bba4 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:12:21.452759 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc5fdad-6924-4066-b27f-4337cc60bba4 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:12:21.452884 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc5fdad-6924-4066-b27f-4337cc60bba4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:12:21.520905 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-edc5fdad-6924-4066-b27f-4337cc60bba4 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:12:21.522102 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-edc5fdad-6924-4066-b27f-4337cc60bba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:12:21.581565 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:12:21.623301 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 652/1324] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 00:12:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:12:21.925405 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05087ec3-240c-440c-9cce-244a62cec92a None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:12:21.926940 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-05087ec3-240c-440c-9cce-244a62cec92a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:12:22.037797 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05087ec3-240c-440c-9cce-244a62cec92a None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:12:22.051631 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:12:22.117870 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b954bd-d240-45ba-b0a9-b23bfaec49c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'daae792cd11d4c4ca7aae0558998aced', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:12:22.118376 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b954bd-d240-45ba-b0a9-b23bfaec49c8 service neutron] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:12:22.118656 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b954bd-d240-45ba-b0a9-b23bfaec49c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:12:22.118929 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b954bd-d240-45ba-b0a9-b23bfaec49c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:12:22.120563 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-b6b954bd-d240-45ba-b0a9-b23bfaec49c8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:12:22.235173 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b954bd-d240-45ba-b0a9-b23bfaec49c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:12:22.236657 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b954bd-d240-45ba-b0a9-b23bfaec49c8 service neutron] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:12:22.257291 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 673/1325] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:12:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:12:24.250006 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50d6027-05a9-480b-aaa1-4b056996ffb4 None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:12:24.250542 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50d6027-05a9-480b-aaa1-4b056996ffb4 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:12:24.250542 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50d6027-05a9-480b-aaa1-4b056996ffb4 None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:12:24.251824 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 653/1326] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 00:12:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:12:24.258300 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb3e5dd-ab8c-4f22-8b15-f9b7d378fb30 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:12:24.258777 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb3e5dd-ab8c-4f22-8b15-f9b7d378fb30 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:12:24.258909 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb3e5dd-ab8c-4f22-8b15-f9b7d378fb30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:12:24.308997 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:12:24.328879 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-2fb3e5dd-ab8c-4f22-8b15-f9b7d378fb30 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:12:24.330092 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-2fb3e5dd-ab8c-4f22-8b15-f9b7d378fb30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:12:24.443086 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 674/1327] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 00:12:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:12:24.731387 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50d6027-05a9-480b-aaa1-4b056996ffb4 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:12:24.732953 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-b50d6027-05a9-480b-aaa1-4b056996ffb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:12:24.856373 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50d6027-05a9-480b-aaa1-4b056996ffb4 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:12:24.934093 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d8e0b2-23ed-4dc3-b1aa-002d0b351adf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'daae792cd11d4c4ca7aae0558998aced', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:12:24.934708 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d8e0b2-23ed-4dc3-b1aa-002d0b351adf service neutron] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:12:24.934987 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d8e0b2-23ed-4dc3-b1aa-002d0b351adf service neutron] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:12:24.935259 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d8e0b2-23ed-4dc3-b1aa-002d0b351adf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:12:24.936915 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-69d8e0b2-23ed-4dc3-b1aa-002d0b351adf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:12:24.954991 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:12:25.057362 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d8e0b2-23ed-4dc3-b1aa-002d0b351adf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:12:25.058904 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d8e0b2-23ed-4dc3-b1aa-002d0b351adf service neutron] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:12:25.077356 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 654/1328] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:12:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:12:27.203539 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75347637-e9e3-469b-bda6-6fc0a6aa0926 None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:12:27.204107 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75347637-e9e3-469b-bda6-6fc0a6aa0926 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:12:27.204107 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75347637-e9e3-469b-bda6-6fc0a6aa0926 None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:12:27.205501 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 675/1329] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 00:12:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:12:27.210926 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da14aa3-6d3d-4fdd-bd5c-b8cee64d50db None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:12:27.211435 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da14aa3-6d3d-4fdd-bd5c-b8cee64d50db None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:12:27.211586 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da14aa3-6d3d-4fdd-bd5c-b8cee64d50db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:12:27.282837 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-8da14aa3-6d3d-4fdd-bd5c-b8cee64d50db None None] MFA Rules not processed for user `053c6535fa2e4cb595fbd3b2fe32ca43`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:12:27.284051 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-8da14aa3-6d3d-4fdd-bd5c-b8cee64d50db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:12:27.353225 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:12:27.386586 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 655/1330] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 00:12:27 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:12:27.683005 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75347637-e9e3-469b-bda6-6fc0a6aa0926 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:12:27.684578 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-75347637-e9e3-469b-bda6-6fc0a6aa0926 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:12:27.791324 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75347637-e9e3-469b-bda6-6fc0a6aa0926 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:12:27.811522 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:12:27.868403 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c6a4a4-e242-4a1a-b473-b450d6297a67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'daae792cd11d4c4ca7aae0558998aced', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:12:27.869085 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c6a4a4-e242-4a1a-b473-b450d6297a67 service neutron] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:12:27.869402 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c6a4a4-e242-4a1a-b473-b450d6297a67 service neutron] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:12:27.869785 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c6a4a4-e242-4a1a-b473-b450d6297a67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:12:27.871967 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-34c6a4a4-e242-4a1a-b473-b450d6297a67 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:12:27.989459 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c6a4a4-e242-4a1a-b473-b450d6297a67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:12:27.991705 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c6a4a4-e242-4a1a-b473-b450d6297a67 service neutron] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:12:28.012530 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 676/1331] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:12:27 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:12:30.201728 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041068a3-4532-42ec-914e-8d82f2d36dfd None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:12:30.202301 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041068a3-4532-42ec-914e-8d82f2d36dfd None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:12:30.202301 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041068a3-4532-42ec-914e-8d82f2d36dfd None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:12:30.203650 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 656/1332] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 00:12:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:12:30.209410 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9def48b-4905-4eef-aa83-05926e801b30 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:12:30.212468 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9def48b-4905-4eef-aa83-05926e801b30 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:12:30.212756 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9def48b-4905-4eef-aa83-05926e801b30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:12:30.286424 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:12:30.290463 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-c9def48b-4905-4eef-aa83-05926e801b30 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:12:30.292238 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-c9def48b-4905-4eef-aa83-05926e801b30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:12:30.389317 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 677/1333] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 00:12:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:12:30.670270 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041068a3-4532-42ec-914e-8d82f2d36dfd None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:12:30.671823 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-041068a3-4532-42ec-914e-8d82f2d36dfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:12:30.778651 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041068a3-4532-42ec-914e-8d82f2d36dfd None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:12:30.853646 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fff538e-64c7-4d0c-b154-b0327425e918 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'daae792cd11d4c4ca7aae0558998aced', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:12:30.854252 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fff538e-64c7-4d0c-b154-b0327425e918 service neutron] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:12:30.854533 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fff538e-64c7-4d0c-b154-b0327425e918 service neutron] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:12:30.854802 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fff538e-64c7-4d0c-b154-b0327425e918 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:12:30.856445 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-0fff538e-64c7-4d0c-b154-b0327425e918 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:12:30.884378 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:12:30.967568 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fff538e-64c7-4d0c-b154-b0327425e918 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:12:30.968980 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fff538e-64c7-4d0c-b154-b0327425e918 service neutron] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:12:30.988039 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 657/1334] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:12:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:12:32.955635 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7676657-1b73-4608-bdc9-84ae7cbc7706 None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:12:32.956201 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7676657-1b73-4608-bdc9-84ae7cbc7706 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:12:32.956201 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7676657-1b73-4608-bdc9-84ae7cbc7706 None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:12:32.957561 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 678/1335] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 00:12:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 00:12:32.962980 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f751d42-4241-44f6-9104-73b396bdd650 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:12:32.963398 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f751d42-4241-44f6-9104-73b396bdd650 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:12:32.963528 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f751d42-4241-44f6-9104-73b396bdd650 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:12:33.031648 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-4f751d42-4241-44f6-9104-73b396bdd650 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:12:33.032925 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-4f751d42-4241-44f6-9104-73b396bdd650 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:12:33.109851 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:12:33.131916 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 658/1336] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 00:12:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:12:33.418059 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7676657-1b73-4608-bdc9-84ae7cbc7706 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:12:33.419607 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-f7676657-1b73-4608-bdc9-84ae7cbc7706 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:12:33.532111 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7676657-1b73-4608-bdc9-84ae7cbc7706 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:12:33.563173 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:12:33.609820 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b299aed7-0cb6-4f00-b587-cd6f19ee9a1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'daae792cd11d4c4ca7aae0558998aced', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:12:33.610439 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b299aed7-0cb6-4f00-b587-cd6f19ee9a1f service neutron] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:12:33.610720 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b299aed7-0cb6-4f00-b587-cd6f19ee9a1f service neutron] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:12:33.610994 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b299aed7-0cb6-4f00-b587-cd6f19ee9a1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:12:33.612658 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-b299aed7-0cb6-4f00-b587-cd6f19ee9a1f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:12:33.731373 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b299aed7-0cb6-4f00-b587-cd6f19ee9a1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:12:33.732784 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b299aed7-0cb6-4f00-b587-cd6f19ee9a1f service neutron] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:12:33.753794 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 679/1337] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:12:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:12:36.010156 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981159c0-802d-4019-8ecd-1a0b8e414c9c None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:12:36.010684 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981159c0-802d-4019-8ecd-1a0b8e414c9c None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:12:36.010684 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981159c0-802d-4019-8ecd-1a0b8e414c9c None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:12:36.012087 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 659/1338] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 00:12:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:12:36.017454 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645b0ce8-c5ce-4362-84a6-b2986617312c None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:12:36.017914 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645b0ce8-c5ce-4362-84a6-b2986617312c None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:12:36.018010 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645b0ce8-c5ce-4362-84a6-b2986617312c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:12:36.088558 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-645b0ce8-c5ce-4362-84a6-b2986617312c None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:12:36.089785 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-645b0ce8-c5ce-4362-84a6-b2986617312c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:12:36.098471 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:12:36.190783 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 680/1339] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 00:12:36 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:12:36.491642 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981159c0-802d-4019-8ecd-1a0b8e414c9c None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:12:36.493241 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-981159c0-802d-4019-8ecd-1a0b8e414c9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:12:36.602548 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981159c0-802d-4019-8ecd-1a0b8e414c9c None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:12:36.681058 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76c4771-8e62-4e0c-b11f-3d4c2e7095e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'daae792cd11d4c4ca7aae0558998aced', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:12:36.681674 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76c4771-8e62-4e0c-b11f-3d4c2e7095e8 service neutron] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:12:36.681951 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76c4771-8e62-4e0c-b11f-3d4c2e7095e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:12:36.682222 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76c4771-8e62-4e0c-b11f-3d4c2e7095e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:12:36.683867 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-a76c4771-8e62-4e0c-b11f-3d4c2e7095e8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:12:36.720298 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:12:36.799795 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76c4771-8e62-4e0c-b11f-3d4c2e7095e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:12:36.801180 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76c4771-8e62-4e0c-b11f-3d4c2e7095e8 service neutron] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:12:36.820365 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 660/1340] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:12:36 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:12:40.653267 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb34b8c3-343e-4c2c-8bf1-bfcb3899981e None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:12:40.653787 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb34b8c3-343e-4c2c-8bf1-bfcb3899981e None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:12:40.653977 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb34b8c3-343e-4c2c-8bf1-bfcb3899981e None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:12:40.655437 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 681/1341] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 00:12:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 00:12:40.661077 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc32763-bbdf-4b6b-9535-8eb743e472d7 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:12:40.661486 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc32763-bbdf-4b6b-9535-8eb743e472d7 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:12:40.661771 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc32763-bbdf-4b6b-9535-8eb743e472d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:12:40.731869 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-afc32763-bbdf-4b6b-9535-8eb743e472d7 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:12:40.733123 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-afc32763-bbdf-4b6b-9535-8eb743e472d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:12:40.826802 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:12:40.839703 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 661/1342] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 00:12:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:12:41.122114 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb34b8c3-343e-4c2c-8bf1-bfcb3899981e None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:12:41.123642 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-bb34b8c3-343e-4c2c-8bf1-bfcb3899981e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:12:41.233021 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb34b8c3-343e-4c2c-8bf1-bfcb3899981e None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:12:41.273299 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:12:41.314110 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da51cc9b-fce5-493b-8d12-3bcd1e1221ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'daae792cd11d4c4ca7aae0558998aced', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:12:41.314684 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da51cc9b-fce5-493b-8d12-3bcd1e1221ff service neutron] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:12:41.314963 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da51cc9b-fce5-493b-8d12-3bcd1e1221ff service neutron] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:12:41.315236 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da51cc9b-fce5-493b-8d12-3bcd1e1221ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:12:41.316863 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-da51cc9b-fce5-493b-8d12-3bcd1e1221ff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:12:41.427142 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da51cc9b-fce5-493b-8d12-3bcd1e1221ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:12:41.429179 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da51cc9b-fce5-493b-8d12-3bcd1e1221ff service neutron] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:12:41.449530 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 682/1343] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:12:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:12:44.046925 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1679072-9b94-4b86-bb66-252abe92a4ec None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:12:44.047558 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1679072-9b94-4b86-bb66-252abe92a4ec None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:12:44.047558 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1679072-9b94-4b86-bb66-252abe92a4ec None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:12:44.048871 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 662/1344] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 00:12:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:12:44.055098 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72041bab-614a-4a3e-a99b-2062501bc02f None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:12:44.055664 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72041bab-614a-4a3e-a99b-2062501bc02f None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:12:44.055664 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72041bab-614a-4a3e-a99b-2062501bc02f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:12:44.128063 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-72041bab-614a-4a3e-a99b-2062501bc02f None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:12:44.129334 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-72041bab-614a-4a3e-a99b-2062501bc02f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:12:44.148258 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:12:44.232250 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 683/1345] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 00:12:44 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:12:44.516320 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1679072-9b94-4b86-bb66-252abe92a4ec None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:12:44.518022 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-e1679072-9b94-4b86-bb66-252abe92a4ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:12:44.627932 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1679072-9b94-4b86-bb66-252abe92a4ec None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:12:44.705033 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603dd4e3-6546-4444-8bed-24810a489589 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'daae792cd11d4c4ca7aae0558998aced', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:12:44.705645 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603dd4e3-6546-4444-8bed-24810a489589 service neutron] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:12:44.705919 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603dd4e3-6546-4444-8bed-24810a489589 service neutron] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:12:44.706183 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603dd4e3-6546-4444-8bed-24810a489589 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:12:44.707773 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-603dd4e3-6546-4444-8bed-24810a489589 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:12:44.756908 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:12:44.831621 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603dd4e3-6546-4444-8bed-24810a489589 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:12:44.833099 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603dd4e3-6546-4444-8bed-24810a489589 service neutron] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:12:44.853277 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 663/1346] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:12:44 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:12:48.777087 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf37217-4bd1-4dfa-bccc-34e4b0ed1817 None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:12:48.777639 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf37217-4bd1-4dfa-bccc-34e4b0ed1817 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:12:48.777639 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf37217-4bd1-4dfa-bccc-34e4b0ed1817 None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:12:48.778972 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 684/1347] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 00:12:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:12:48.784168 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00756868-3ffb-41aa-bf68-6a1bb59abdd1 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:12:48.784657 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00756868-3ffb-41aa-bf68-6a1bb59abdd1 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:12:48.785028 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00756868-3ffb-41aa-bf68-6a1bb59abdd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:12:48.874003 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-00756868-3ffb-41aa-bf68-6a1bb59abdd1 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:12:48.875232 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-00756868-3ffb-41aa-bf68-6a1bb59abdd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:12:48.985069 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:12:48.987506 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 664/1348] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 00:12:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:12:49.271256 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf37217-4bd1-4dfa-bccc-34e4b0ed1817 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:12:49.273513 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-8bf37217-4bd1-4dfa-bccc-34e4b0ed1817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:12:49.390487 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf37217-4bd1-4dfa-bccc-34e4b0ed1817 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:12:49.439918 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:12:49.471762 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b484c96-9b3b-4153-b4e1-a4649fa2871d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'daae792cd11d4c4ca7aae0558998aced', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:12:49.472580 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b484c96-9b3b-4153-b4e1-a4649fa2871d service neutron] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:12:49.472985 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b484c96-9b3b-4153-b4e1-a4649fa2871d service neutron] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:12:49.473269 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b484c96-9b3b-4153-b4e1-a4649fa2871d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:12:49.475230 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-6b484c96-9b3b-4153-b4e1-a4649fa2871d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:12:49.605279 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b484c96-9b3b-4153-b4e1-a4649fa2871d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:12:49.606729 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b484c96-9b3b-4153-b4e1-a4649fa2871d service neutron] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:12:49.626556 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 685/1349] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:12:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:12:54.590468 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffcac4d-ff41-4915-9574-33d8297a344a None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:12:54.591566 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffcac4d-ff41-4915-9574-33d8297a344a None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:12:54.592060 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffcac4d-ff41-4915-9574-33d8297a344a None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:12:54.594843 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 665/1350] 10.222.0.47 () {54 vars in 921 bytes} [Wed Aug 31 00:12:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:12:54.604197 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c4b721-27ed-46d5-bca3-8bc7f6f76b55 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:12:54.604197 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c4b721-27ed-46d5-bca3-8bc7f6f76b55 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:12:54.604197 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c4b721-27ed-46d5-bca3-8bc7f6f76b55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:12:54.748093 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-60c4b721-27ed-46d5-bca3-8bc7f6f76b55 None None] MFA Rules not processed for user `8f76e01e32264ff7a6a7740ffa0a207d`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:12:54.749597 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-60c4b721-27ed-46d5-bca3-8bc7f6f76b55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:12:54.784919 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:12:54.893099 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 686/1351] 10.222.0.47 () {58 vars in 1018 bytes} [Wed Aug 31 00:12:54 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:12:59.114152 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b29daa1-8622-4b20-84f9-d6ab566c524a None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:12:59.115292 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b29daa1-8622-4b20-84f9-d6ab566c524a None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:12:59.115788 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b29daa1-8622-4b20-84f9-d6ab566c524a None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:12:59.117230 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 666/1352] 10.222.0.47 () {54 vars in 921 bytes} [Wed Aug 31 00:12:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:12:59.123306 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec7e678-0e28-4a88-a7b8-4e21cc0bf07a None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:12:59.123767 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec7e678-0e28-4a88-a7b8-4e21cc0bf07a None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:12:59.123849 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec7e678-0e28-4a88-a7b8-4e21cc0bf07a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:12:59.218044 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-4ec7e678-0e28-4a88-a7b8-4e21cc0bf07a None None] MFA Rules not processed for user `8f76e01e32264ff7a6a7740ffa0a207d`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:12:59.219374 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-4ec7e678-0e28-4a88-a7b8-4e21cc0bf07a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:12:59.297302 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:12:59.337736 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 687/1353] 10.222.0.47 () {58 vars in 1018 bytes} [Wed Aug 31 00:12:59 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:13:00.972877 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee016d66-5e43-4abd-b5ff-b6a937c9d830 None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:13:00.973440 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee016d66-5e43-4abd-b5ff-b6a937c9d830 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:13:00.973440 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee016d66-5e43-4abd-b5ff-b6a937c9d830 None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:13:00.975618 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 667/1354] 10.222.0.47 () {54 vars in 921 bytes} [Wed Aug 31 00:13:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:13:00.980814 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8266ca8-10ec-4d7f-89dc-482206b00079 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:13:00.981305 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8266ca8-10ec-4d7f-89dc-482206b00079 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:13:00.981398 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8266ca8-10ec-4d7f-89dc-482206b00079 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:13:01.062912 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-c8266ca8-10ec-4d7f-89dc-482206b00079 None None] MFA Rules not processed for user `8f76e01e32264ff7a6a7740ffa0a207d`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:13:01.064111 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-c8266ca8-10ec-4d7f-89dc-482206b00079 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:13:01.181863 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 688/1355] 10.222.0.47 () {58 vars in 1018 bytes} [Wed Aug 31 00:13:00 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:13:04.454891 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e703d85-234a-4d30-97b6-0b8ba3ca33f0 None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:13:04.455436 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e703d85-234a-4d30-97b6-0b8ba3ca33f0 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:13:04.455436 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e703d85-234a-4d30-97b6-0b8ba3ca33f0 None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:13:04.457035 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 668/1356] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 00:13:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:13:04.463479 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdcf761-cc30-4a82-b8c9-d139098db16d None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:13:04.463974 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdcf761-cc30-4a82-b8c9-d139098db16d None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:13:04.464147 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdcf761-cc30-4a82-b8c9-d139098db16d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:13:04.505656 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:13:04.545221 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-cfdcf761-cc30-4a82-b8c9-d139098db16d None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:13:04.546434 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-cfdcf761-cc30-4a82-b8c9-d139098db16d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:13:04.670404 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 689/1357] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 00:13:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:13:04.979289 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10599040-dac6-4c6c-8672-028d6ee0ba0f None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:13:04.979676 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10599040-dac6-4c6c-8672-028d6ee0ba0f None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:13:04.980016 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10599040-dac6-4c6c-8672-028d6ee0ba0f None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:13:04.981732 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 669/1358] 10.222.0.47 () {54 vars in 962 bytes} [Wed Aug 31 00:13:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:13:04.995186 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633b4185-1d25-43fe-9c97-bb0e3b23c171 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:13:04.995472 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633b4185-1d25-43fe-9c97-bb0e3b23c171 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:13:04.996568 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633b4185-1d25-43fe-9c97-bb0e3b23c171 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:13:05.084813 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-633b4185-1d25-43fe-9c97-bb0e3b23c171 None None] MFA Rules not processed for user `9ea002bf49c248dbae7147665fa10fd1`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:13:05.085974 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-633b4185-1d25-43fe-9c97-bb0e3b23c171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:13:05.148661 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:13:05.227869 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 690/1359] 10.222.0.47 () {58 vars in 1059 bytes} [Wed Aug 31 00:13:04 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:13:05.235911 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10599040-dac6-4c6c-8672-028d6ee0ba0f None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:13:05.237749 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-10599040-dac6-4c6c-8672-028d6ee0ba0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:13:05.394324 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10599040-dac6-4c6c-8672-028d6ee0ba0f None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:13:05.473638 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:13:05.520326 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfa6ca4-9b7a-4fbf-8f2a-63eb43f0f5db service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea002bf49c248dbae7147665fa10fd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:13:05.521185 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfa6ca4-9b7a-4fbf-8f2a-63eb43f0f5db service nova] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:13:05.521560 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfa6ca4-9b7a-4fbf-8f2a-63eb43f0f5db service nova] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:13:05.521900 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfa6ca4-9b7a-4fbf-8f2a-63eb43f0f5db service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:13:05.523583 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-edfa6ca4-9b7a-4fbf-8f2a-63eb43f0f5db service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:13:05.624123 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfa6ca4-9b7a-4fbf-8f2a-63eb43f0f5db service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:13:05.625745 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfa6ca4-9b7a-4fbf-8f2a-63eb43f0f5db service nova] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:13:05.645464 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 670/1360] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:13:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 00:13:07.830131 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c22a819-ccac-4f78-bfaa-c42c09ef28a6 None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:13:07.830749 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c22a819-ccac-4f78-bfaa-c42c09ef28a6 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:13:07.830749 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c22a819-ccac-4f78-bfaa-c42c09ef28a6 None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:13:07.832245 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 691/1361] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 00:13:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:13:07.838581 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5af217-6cf9-4610-a691-a14ae645fb9e None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:13:07.839102 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5af217-6cf9-4610-a691-a14ae645fb9e None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:13:07.839102 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5af217-6cf9-4610-a691-a14ae645fb9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:13:07.916138 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-ee5af217-6cf9-4610-a691-a14ae645fb9e None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:13:07.917867 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-ee5af217-6cf9-4610-a691-a14ae645fb9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:13:07.963561 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:13:08.052803 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 671/1362] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 00:13:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:13:08.353269 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c22a819-ccac-4f78-bfaa-c42c09ef28a6 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:13:08.354934 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-3c22a819-ccac-4f78-bfaa-c42c09ef28a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:13:08.529043 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c22a819-ccac-4f78-bfaa-c42c09ef28a6 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:13:08.538999 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:13:08.655692 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b89990-fe13-441a-942a-462c9f93e739 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea002bf49c248dbae7147665fa10fd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:13:08.656428 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b89990-fe13-441a-942a-462c9f93e739 service nova] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:13:08.656783 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b89990-fe13-441a-942a-462c9f93e739 service nova] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:13:08.657132 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b89990-fe13-441a-942a-462c9f93e739 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:13:08.658843 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-75b89990-fe13-441a-942a-462c9f93e739 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:13:08.765233 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b89990-fe13-441a-942a-462c9f93e739 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:13:08.766850 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b89990-fe13-441a-942a-462c9f93e739 service nova] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:13:08.787479 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 692/1363] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:13:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:13:11.303996 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ffc2de-505b-4143-a59d-356ba1bd6337 None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:13:11.304546 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ffc2de-505b-4143-a59d-356ba1bd6337 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:13:11.304973 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ffc2de-505b-4143-a59d-356ba1bd6337 None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:13:11.306622 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 672/1364] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 00:13:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:13:11.312128 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd42b42-b5da-4373-b1a2-815ee2a023ad None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:13:11.312649 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd42b42-b5da-4373-b1a2-815ee2a023ad None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:13:11.312744 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd42b42-b5da-4373-b1a2-815ee2a023ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:13:11.329628 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:13:11.386521 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-4fd42b42-b5da-4373-b1a2-815ee2a023ad None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:13:11.387725 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-4fd42b42-b5da-4373-b1a2-815ee2a023ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:13:11.520519 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 693/1365] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 00:13:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:13:11.803710 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14058728-da97-48f0-a4f2-3430bc16be12 None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:13:11.804351 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14058728-da97-48f0-a4f2-3430bc16be12 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:13:11.804727 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14058728-da97-48f0-a4f2-3430bc16be12 None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:13:11.806323 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 673/1366] 10.222.0.47 () {54 vars in 962 bytes} [Wed Aug 31 00:13:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:13:11.811998 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a35faa-0a9c-4137-993c-3e47243bb5f4 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:13:11.812311 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a35faa-0a9c-4137-993c-3e47243bb5f4 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:13:11.812587 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a35faa-0a9c-4137-993c-3e47243bb5f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:13:11.901427 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-c7a35faa-0a9c-4137-993c-3e47243bb5f4 None None] MFA Rules not processed for user `9ea002bf49c248dbae7147665fa10fd1`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:13:11.901427 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-c7a35faa-0a9c-4137-993c-3e47243bb5f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:13:11.940837 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:13:12.041827 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 694/1367] 10.222.0.47 () {58 vars in 1059 bytes} [Wed Aug 31 00:13:11 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:13:12.050021 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14058728-da97-48f0-a4f2-3430bc16be12 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:13:12.051646 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-14058728-da97-48f0-a4f2-3430bc16be12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:13:12.223463 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14058728-da97-48f0-a4f2-3430bc16be12 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:13:12.246583 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:13:12.358754 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06391300-ff22-49ca-8839-ac577b85adb6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea002bf49c248dbae7147665fa10fd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:13:12.359416 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06391300-ff22-49ca-8839-ac577b85adb6 service nova] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:13:12.359798 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06391300-ff22-49ca-8839-ac577b85adb6 service nova] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:13:12.360184 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06391300-ff22-49ca-8839-ac577b85adb6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:13:12.362225 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-06391300-ff22-49ca-8839-ac577b85adb6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:13:12.462671 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06391300-ff22-49ca-8839-ac577b85adb6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:13:12.464400 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06391300-ff22-49ca-8839-ac577b85adb6 service nova] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:13:12.485270 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 674/1368] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:13:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:13:12.953918 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0920ac83-ba73-4f2d-b649-3d3957fd1ffa None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:13:12.954485 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0920ac83-ba73-4f2d-b649-3d3957fd1ffa None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:13:12.954485 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0920ac83-ba73-4f2d-b649-3d3957fd1ffa None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:13:12.956219 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 695/1369] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 00:13:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 00:13:12.963765 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d723b6-ebcf-4ab8-aa39-9310593d6dec None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:13:12.964048 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d723b6-ebcf-4ab8-aa39-9310593d6dec None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:13:12.964343 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d723b6-ebcf-4ab8-aa39-9310593d6dec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:13:13.007435 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:13:13.048172 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-39d723b6-ebcf-4ab8-aa39-9310593d6dec None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:13:13.049502 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-39d723b6-ebcf-4ab8-aa39-9310593d6dec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:13:13.153432 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 675/1370] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 00:13:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:13:13.704613 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5127aa6-0b86-41c3-80f7-cc16f617fc4c None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:13:13.705021 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5127aa6-0b86-41c3-80f7-cc16f617fc4c None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:13:13.705428 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5127aa6-0b86-41c3-80f7-cc16f617fc4c None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:13:13.706981 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 696/1371] 10.222.0.47 () {54 vars in 964 bytes} [Wed Aug 31 00:13:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:13:13.712402 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80bc380-4219-4167-bd07-e8f04b3b6a85 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:13:13.712885 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80bc380-4219-4167-bd07-e8f04b3b6a85 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:13:13.712983 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80bc380-4219-4167-bd07-e8f04b3b6a85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:13:13.792605 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-c80bc380-4219-4167-bd07-e8f04b3b6a85 None None] MFA Rules not processed for user `beecda6e9feb400288618745c784989f`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:13:13.793704 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-c80bc380-4219-4167-bd07-e8f04b3b6a85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:13:13.846306 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:13:13.877771 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 676/1372] 10.222.0.47 () {58 vars in 1061 bytes} [Wed Aug 31 00:13:13 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:13:13.886022 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5127aa6-0b86-41c3-80f7-cc16f617fc4c None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:13:13.887553 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-b5127aa6-0b86-41c3-80f7-cc16f617fc4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:13:14.000963 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5127aa6-0b86-41c3-80f7-cc16f617fc4c None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:13:14.047636 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:13:14.092563 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6b7560-6ea1-428e-9e6f-bf8e9cb979a8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beecda6e9feb400288618745c784989f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:13:14.093187 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6b7560-6ea1-428e-9e6f-bf8e9cb979a8 service cinder] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:13:14.093465 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6b7560-6ea1-428e-9e6f-bf8e9cb979a8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:13:14.093744 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6b7560-6ea1-428e-9e6f-bf8e9cb979a8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:13:14.095350 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-7d6b7560-6ea1-428e-9e6f-bf8e9cb979a8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:13:14.274689 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6b7560-6ea1-428e-9e6f-bf8e9cb979a8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:13:14.276572 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6b7560-6ea1-428e-9e6f-bf8e9cb979a8 service cinder] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:13:14.303415 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 697/1373] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:13:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 00:13:14.514988 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b286850-19ef-4899-b480-99eec185979f None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:13:14.515275 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b286850-19ef-4899-b480-99eec185979f None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:13:14.515751 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b286850-19ef-4899-b480-99eec185979f None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:13:14.517143 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 677/1374] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 00:13:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:13:14.523464 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112d9156-3f76-4b1d-b3f3-05509931c9c3 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:13:14.523752 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112d9156-3f76-4b1d-b3f3-05509931c9c3 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:13:14.524028 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112d9156-3f76-4b1d-b3f3-05509931c9c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:13:14.594538 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-112d9156-3f76-4b1d-b3f3-05509931c9c3 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:13:14.595671 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-112d9156-3f76-4b1d-b3f3-05509931c9c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:13:14.617500 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:13:14.697580 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 698/1375] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 00:13:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:13:15.003517 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b286850-19ef-4899-b480-99eec185979f None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:13:15.006474 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-1b286850-19ef-4899-b480-99eec185979f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:13:15.163154 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b286850-19ef-4899-b480-99eec185979f None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:13:15.215415 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:13:15.280570 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2420fb-31ef-4984-a100-7b75738e711d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea002bf49c248dbae7147665fa10fd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:13:15.281045 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2420fb-31ef-4984-a100-7b75738e711d service nova] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:13:15.281324 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2420fb-31ef-4984-a100-7b75738e711d service nova] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:13:15.281595 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2420fb-31ef-4984-a100-7b75738e711d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:13:15.283217 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-1a2420fb-31ef-4984-a100-7b75738e711d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:13:15.375278 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2420fb-31ef-4984-a100-7b75738e711d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:13:15.376957 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2420fb-31ef-4984-a100-7b75738e711d service nova] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:13:15.396632 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 678/1376] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:13:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:13:17.390343 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1b6bdd-438d-44c3-a535-8fa5724ab77d None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:13:17.390790 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1b6bdd-438d-44c3-a535-8fa5724ab77d None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:13:17.390790 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1b6bdd-438d-44c3-a535-8fa5724ab77d None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:13:17.392311 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 699/1377] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 00:13:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:13:17.398089 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6301541b-96c1-4f08-b184-68130301d755 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:13:17.398538 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6301541b-96c1-4f08-b184-68130301d755 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:13:17.398641 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6301541b-96c1-4f08-b184-68130301d755 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:13:17.478061 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-6301541b-96c1-4f08-b184-68130301d755 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:13:17.479318 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-6301541b-96c1-4f08-b184-68130301d755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:13:17.496948 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:13:17.587930 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 679/1378] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 00:13:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:13:17.878368 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1b6bdd-438d-44c3-a535-8fa5724ab77d None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:13:17.879908 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-6b1b6bdd-438d-44c3-a535-8fa5724ab77d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:13:18.090790 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1b6bdd-438d-44c3-a535-8fa5724ab77d None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:13:18.095037 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:13:18.218763 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dc2098-f29a-40c5-8da2-d36856d4dec0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea002bf49c248dbae7147665fa10fd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:13:18.219057 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dc2098-f29a-40c5-8da2-d36856d4dec0 service nova] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:13:18.219324 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dc2098-f29a-40c5-8da2-d36856d4dec0 service nova] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:13:18.219597 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dc2098-f29a-40c5-8da2-d36856d4dec0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:13:18.221638 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-58dc2098-f29a-40c5-8da2-d36856d4dec0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:13:18.325439 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dc2098-f29a-40c5-8da2-d36856d4dec0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:13:18.327595 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dc2098-f29a-40c5-8da2-d36856d4dec0 service nova] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:13:18.348779 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 700/1379] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:13:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 471 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:13:20.355121 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a286d3-49ba-429b-988b-95855fb1860d None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:13:20.355687 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a286d3-49ba-429b-988b-95855fb1860d None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:13:20.355687 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a286d3-49ba-429b-988b-95855fb1860d None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:13:20.357035 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 680/1380] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 00:13:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:13:20.362299 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f3ad98-f64a-4825-8ce4-38ece2303002 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:13:20.362727 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f3ad98-f64a-4825-8ce4-38ece2303002 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:13:20.362901 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f3ad98-f64a-4825-8ce4-38ece2303002 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:13:20.375161 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:13:20.444136 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-20f3ad98-f64a-4825-8ce4-38ece2303002 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:13:20.445345 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-20f3ad98-f64a-4825-8ce4-38ece2303002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:13:20.562927 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 701/1381] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 00:13:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:13:20.869961 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a286d3-49ba-429b-988b-95855fb1860d None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:13:20.872136 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-41a286d3-49ba-429b-988b-95855fb1860d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:13:21.047069 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:13:21.061711 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a286d3-49ba-429b-988b-95855fb1860d None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:13:21.188523 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9621c70e-9ad1-4d96-a602-cf4dabe7e25a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea002bf49c248dbae7147665fa10fd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:13:21.189141 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9621c70e-9ad1-4d96-a602-cf4dabe7e25a service nova] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:13:21.189414 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9621c70e-9ad1-4d96-a602-cf4dabe7e25a service nova] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:13:21.189683 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9621c70e-9ad1-4d96-a602-cf4dabe7e25a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:13:21.191285 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-9621c70e-9ad1-4d96-a602-cf4dabe7e25a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:13:21.293029 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9621c70e-9ad1-4d96-a602-cf4dabe7e25a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:13:21.294635 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9621c70e-9ad1-4d96-a602-cf4dabe7e25a service nova] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:13:21.305726 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:13:21.316185 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 681/1382] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:13:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:13:23.337725 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124e231d-8769-4e86-bc04-9d3e250777eb None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:13:23.338257 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124e231d-8769-4e86-bc04-9d3e250777eb None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:13:23.338257 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124e231d-8769-4e86-bc04-9d3e250777eb None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:13:23.339632 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 702/1383] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 00:13:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:13:23.345182 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf23965-8eca-4b74-83a4-ffa79210de7a None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:13:23.345701 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf23965-8eca-4b74-83a4-ffa79210de7a None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:13:23.345799 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf23965-8eca-4b74-83a4-ffa79210de7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:13:23.418769 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-8cf23965-8eca-4b74-83a4-ffa79210de7a None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:13:23.419988 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-8cf23965-8eca-4b74-83a4-ffa79210de7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:13:23.530284 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 682/1384] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 00:13:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:13:23.821815 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124e231d-8769-4e86-bc04-9d3e250777eb None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:13:23.824227 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-124e231d-8769-4e86-bc04-9d3e250777eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:13:24.088514 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:13:24.156353 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124e231d-8769-4e86-bc04-9d3e250777eb None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:13:24.299876 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cd838b-937f-43d4-8f21-56fee876d2de service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea002bf49c248dbae7147665fa10fd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:13:24.300696 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cd838b-937f-43d4-8f21-56fee876d2de service nova] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:13:24.301055 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cd838b-937f-43d4-8f21-56fee876d2de service nova] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:13:24.302134 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cd838b-937f-43d4-8f21-56fee876d2de service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:13:24.304269 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-d9cd838b-937f-43d4-8f21-56fee876d2de service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:13:24.369360 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:13:24.420982 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cd838b-937f-43d4-8f21-56fee876d2de service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:13:24.422860 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cd838b-937f-43d4-8f21-56fee876d2de service nova] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:13:24.441714 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 703/1385] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:13:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 621 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 00:13:26.946276 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e299386-40df-4b93-a78d-4d4fdd1d439d None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:13:26.946861 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e299386-40df-4b93-a78d-4d4fdd1d439d None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:13:26.946968 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e299386-40df-4b93-a78d-4d4fdd1d439d None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:13:26.948712 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 683/1386] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 00:13:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:13:26.954571 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083278c2-38f3-454f-ac41-6f0411b968eb None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:13:26.955067 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083278c2-38f3-454f-ac41-6f0411b968eb None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:13:26.955272 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083278c2-38f3-454f-ac41-6f0411b968eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:13:27.036470 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-083278c2-38f3-454f-ac41-6f0411b968eb None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:13:27.037722 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-083278c2-38f3-454f-ac41-6f0411b968eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:13:27.159489 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 704/1387] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 00:13:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:13:27.506747 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e299386-40df-4b93-a78d-4d4fdd1d439d None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:13:27.509419 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-3e299386-40df-4b93-a78d-4d4fdd1d439d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:13:27.615988 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:13:27.705620 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e299386-40df-4b93-a78d-4d4fdd1d439d None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:13:27.844713 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a14f62-48b1-40e0-bd87-2da4b6db703c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea002bf49c248dbae7147665fa10fd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:13:27.845341 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a14f62-48b1-40e0-bd87-2da4b6db703c service nova] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:13:27.845845 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a14f62-48b1-40e0-bd87-2da4b6db703c service nova] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:13:27.846241 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a14f62-48b1-40e0-bd87-2da4b6db703c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:13:27.847982 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-27a14f62-48b1-40e0-bd87-2da4b6db703c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:13:27.901462 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:13:27.965139 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a14f62-48b1-40e0-bd87-2da4b6db703c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:13:27.967456 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a14f62-48b1-40e0-bd87-2da4b6db703c service nova] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:13:27.987062 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 684/1388] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:13:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 481 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:13:29.516104 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4956707d-d78a-4ca3-9465-549d3bc2a0a6 None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:13:29.516715 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4956707d-d78a-4ca3-9465-549d3bc2a0a6 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:13:29.516715 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4956707d-d78a-4ca3-9465-549d3bc2a0a6 None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:13:29.518024 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 705/1389] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 00:13:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:13:29.523986 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f08913a-a05a-46e4-b1c8-d4077c105b51 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:13:29.524463 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f08913a-a05a-46e4-b1c8-d4077c105b51 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:13:29.524982 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f08913a-a05a-46e4-b1c8-d4077c105b51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:13:29.596109 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-1f08913a-a05a-46e4-b1c8-d4077c105b51 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:13:29.597342 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-1f08913a-a05a-46e4-b1c8-d4077c105b51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:13:29.701018 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 685/1390] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 00:13:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:13:29.946511 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e9667c-b7ff-4a0f-8008-755b9020a5cc None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:13:29.946796 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e9667c-b7ff-4a0f-8008-755b9020a5cc None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:13:29.947072 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e9667c-b7ff-4a0f-8008-755b9020a5cc None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:13:29.948490 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 706/1391] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 00:13:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:13:29.953808 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ec1ae1-5318-42e8-8aae-4b43dd56c476 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:13:29.954093 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ec1ae1-5318-42e8-8aae-4b43dd56c476 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:13:29.954368 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ec1ae1-5318-42e8-8aae-4b43dd56c476 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:13:29.971595 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:13:30.007606 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5972c6-e9a0-4eab-a438-ebd874fec083 None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:13:30.007889 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5972c6-e9a0-4eab-a438-ebd874fec083 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:13:30.008184 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5972c6-e9a0-4eab-a438-ebd874fec083 None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:13:30.009812 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 707/1392] 10.222.0.47 () {54 vars in 967 bytes} [Wed Aug 31 00:13:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 00:13:30.014696 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fc5e8b-c3d4-45fe-99be-5080bf9e66fc None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:13:30.014981 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fc5e8b-c3d4-45fe-99be-5080bf9e66fc None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:13:30.015251 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fc5e8b-c3d4-45fe-99be-5080bf9e66fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:13:30.030178 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-c6ec1ae1-5318-42e8-8aae-4b43dd56c476 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:13:30.031529 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-c6ec1ae1-5318-42e8-8aae-4b43dd56c476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:13:30.048093 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:13:30.096109 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-35fc5e8b-c3d4-45fe-99be-5080bf9e66fc None None] MFA Rules not processed for user `cc025521e1dc4c91ab50a8718a87754f`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:13:30.097342 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-35fc5e8b-c3d4-45fe-99be-5080bf9e66fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:13:30.134854 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 686/1393] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 00:13:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:13:30.180819 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 708/1394] 10.222.0.47 () {58 vars in 1064 bytes} [Wed Aug 31 00:13:30 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:13:30.188699 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ec1ae1-5318-42e8-8aae-4b43dd56c476 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:13:30.189918 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-c6ec1ae1-5318-42e8-8aae-4b43dd56c476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:13:30.286657 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ec1ae1-5318-42e8-8aae-4b43dd56c476 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:13:30.294223 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:13:30.365128 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ca7e14-7c16-4a49-b67e-91c923091536 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc025521e1dc4c91ab50a8718a87754f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:13:30.365760 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ca7e14-7c16-4a49-b67e-91c923091536 service glance] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:13:30.366043 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ca7e14-7c16-4a49-b67e-91c923091536 service glance] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:13:30.366311 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ca7e14-7c16-4a49-b67e-91c923091536 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:13:30.367891 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-d6ca7e14-7c16-4a49-b67e-91c923091536 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:13:30.431297 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fc5e8b-c3d4-45fe-99be-5080bf9e66fc None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:13:30.432997 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-35fc5e8b-c3d4-45fe-99be-5080bf9e66fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:13:30.490908 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ca7e14-7c16-4a49-b67e-91c923091536 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:13:30.492551 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ca7e14-7c16-4a49-b67e-91c923091536 service glance] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:13:30.512129 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 687/1395] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:13:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 00:13:30.559613 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fc5e8b-c3d4-45fe-99be-5080bf9e66fc None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:13:30.563223 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:13:30.678288 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76554e59-d1fa-454d-95db-12c29e8c86bd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea002bf49c248dbae7147665fa10fd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:13:30.678912 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76554e59-d1fa-454d-95db-12c29e8c86bd service nova] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:13:30.679194 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76554e59-d1fa-454d-95db-12c29e8c86bd service nova] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:13:30.679467 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76554e59-d1fa-454d-95db-12c29e8c86bd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:13:30.681138 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-76554e59-d1fa-454d-95db-12c29e8c86bd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:13:30.783490 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76554e59-d1fa-454d-95db-12c29e8c86bd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:13:30.786963 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76554e59-d1fa-454d-95db-12c29e8c86bd service nova] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:13:30.807742 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 709/1396] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:13:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 00:13:31.290407 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e0ada2-c0f7-4dd7-898d-4b369129b55a None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:13:31.290905 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e0ada2-c0f7-4dd7-898d-4b369129b55a None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:13:31.291107 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e0ada2-c0f7-4dd7-898d-4b369129b55a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:13:31.339436 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:13:31.361738 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-78e0ada2-c0f7-4dd7-898d-4b369129b55a None None] MFA Rules not processed for user `601aa9e547aa4d42bef6753b26f48eaa`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:13:31.362939 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-78e0ada2-c0f7-4dd7-898d-4b369129b55a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:13:31.452101 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 688/1397] 10.222.0.47 () {58 vars in 1009 bytes} [Wed Aug 31 00:13:31 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:13:31.496665 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c314b88c-6374-4fa5-810c-28acad2e99d0 None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:13:31.497101 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c314b88c-6374-4fa5-810c-28acad2e99d0 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:13:31.497564 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c314b88c-6374-4fa5-810c-28acad2e99d0 None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:13:31.499032 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 710/1398] 10.222.0.47 () {54 vars in 943 bytes} [Wed Aug 31 00:13:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:13:31.506546 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee5e5b3-9d7d-46c7-b915-c1e953db5794 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:13:31.506962 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee5e5b3-9d7d-46c7-b915-c1e953db5794 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:13:31.507240 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee5e5b3-9d7d-46c7-b915-c1e953db5794 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:13:31.586336 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-eee5e5b3-9d7d-46c7-b915-c1e953db5794 None None] MFA Rules not processed for user `ffbfbf19509645f49dbf9566e447c8c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:13:31.587549 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-eee5e5b3-9d7d-46c7-b915-c1e953db5794 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:13:31.649403 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:13:31.698435 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 689/1399] 10.222.0.47 () {58 vars in 1040 bytes} [Wed Aug 31 00:13:31 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:13:31.708115 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c314b88c-6374-4fa5-810c-28acad2e99d0 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:13:31.709662 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-c314b88c-6374-4fa5-810c-28acad2e99d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:13:31.719738 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:13:31.852470 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c314b88c-6374-4fa5-810c-28acad2e99d0 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:13:31.964436 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:13:31.973337 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bba03e4-d6e8-4642-900f-a99333b3ba03 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffbfbf19509645f49dbf9566e447c8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:13:31.974171 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bba03e4-d6e8-4642-900f-a99333b3ba03 service swift] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:13:31.974554 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bba03e4-d6e8-4642-900f-a99333b3ba03 service swift] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:13:31.974976 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bba03e4-d6e8-4642-900f-a99333b3ba03 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:13:31.976702 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-0bba03e4-d6e8-4642-900f-a99333b3ba03 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:13:32.077163 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bba03e4-d6e8-4642-900f-a99333b3ba03 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:13:32.078749 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bba03e4-d6e8-4642-900f-a99333b3ba03 service swift] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:13:32.088258 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 711/1400] 10.222.0.47 () {60 vars in 1384 bytes} [Wed Aug 31 00:13:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 00:13:32.814540 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7483c454-5182-4c5b-bdd3-99aa5dd35655 None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:13:32.815074 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7483c454-5182-4c5b-bdd3-99aa5dd35655 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:13:32.815074 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7483c454-5182-4c5b-bdd3-99aa5dd35655 None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:13:32.819074 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 690/1401] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 00:13:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:13:32.822243 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88192626-8962-4e04-97fb-5c5bf435509b None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:13:32.822687 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88192626-8962-4e04-97fb-5c5bf435509b None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:13:32.822820 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88192626-8962-4e04-97fb-5c5bf435509b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:13:32.901584 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-88192626-8962-4e04-97fb-5c5bf435509b None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:13:32.902824 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-88192626-8962-4e04-97fb-5c5bf435509b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:13:32.997202 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:13:33.023052 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 712/1402] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 00:13:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:13:33.320467 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7483c454-5182-4c5b-bdd3-99aa5dd35655 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:13:33.322258 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-7483c454-5182-4c5b-bdd3-99aa5dd35655 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:13:33.496835 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7483c454-5182-4c5b-bdd3-99aa5dd35655 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:13:33.549038 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:13:33.642266 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6982ea-0365-43b9-ba5e-964bdc2f11ec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea002bf49c248dbae7147665fa10fd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:13:33.642884 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6982ea-0365-43b9-ba5e-964bdc2f11ec service nova] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:13:33.643161 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6982ea-0365-43b9-ba5e-964bdc2f11ec service nova] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:13:33.643451 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6982ea-0365-43b9-ba5e-964bdc2f11ec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:13:33.645935 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-cb6982ea-0365-43b9-ba5e-964bdc2f11ec service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:13:33.756953 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6982ea-0365-43b9-ba5e-964bdc2f11ec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:13:33.759287 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6982ea-0365-43b9-ba5e-964bdc2f11ec service nova] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:13:33.781167 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 691/1403] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:13:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:13:35.873881 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49272af8-6ba8-42b2-9c9c-19187d5da8d9 None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:13:35.874452 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49272af8-6ba8-42b2-9c9c-19187d5da8d9 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:13:35.874452 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49272af8-6ba8-42b2-9c9c-19187d5da8d9 None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:13:35.876329 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 713/1404] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 00:13:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:13:35.881461 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f29fe5-b1bf-4564-b440-286a666228f1 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:13:35.881916 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f29fe5-b1bf-4564-b440-286a666228f1 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:13:35.882029 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f29fe5-b1bf-4564-b440-286a666228f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:13:35.947619 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:13:35.957879 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-16f29fe5-b1bf-4564-b440-286a666228f1 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:13:35.959189 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-16f29fe5-b1bf-4564-b440-286a666228f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:13:36.073204 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 692/1405] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 00:13:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:13:36.367530 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49272af8-6ba8-42b2-9c9c-19187d5da8d9 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:13:36.370249 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-49272af8-6ba8-42b2-9c9c-19187d5da8d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:13:36.554289 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49272af8-6ba8-42b2-9c9c-19187d5da8d9 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:13:36.629688 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:13:36.693880 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6970483f-9b4f-4b39-85dd-9b4c1b1f7166 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea002bf49c248dbae7147665fa10fd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:13:36.694628 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6970483f-9b4f-4b39-85dd-9b4c1b1f7166 service nova] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:13:36.694913 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6970483f-9b4f-4b39-85dd-9b4c1b1f7166 service nova] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:13:36.695188 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6970483f-9b4f-4b39-85dd-9b4c1b1f7166 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:13:36.696838 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-6970483f-9b4f-4b39-85dd-9b4c1b1f7166 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:13:36.809248 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6970483f-9b4f-4b39-85dd-9b4c1b1f7166 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:13:36.810984 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6970483f-9b4f-4b39-85dd-9b4c1b1f7166 service nova] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:13:36.838520 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 714/1406] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:13:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 471 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:13:38.839593 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca8c4c2-b5a6-49f8-a546-832a775fa343 None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:13:38.840368 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca8c4c2-b5a6-49f8-a546-832a775fa343 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:13:38.840368 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca8c4c2-b5a6-49f8-a546-832a775fa343 None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:13:38.844713 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 693/1407] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 00:13:38 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:13:38.846737 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b63e171-da63-4e32-a610-bb87a65f93b1 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:13:38.847187 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b63e171-da63-4e32-a610-bb87a65f93b1 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:13:38.847796 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b63e171-da63-4e32-a610-bb87a65f93b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:13:38.929785 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-3b63e171-da63-4e32-a610-bb87a65f93b1 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:13:38.931367 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-3b63e171-da63-4e32-a610-bb87a65f93b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:13:38.958102 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:13:39.054599 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 715/1408] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 00:13:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:13:39.350537 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca8c4c2-b5a6-49f8-a546-832a775fa343 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:13:39.352055 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-bca8c4c2-b5a6-49f8-a546-832a775fa343 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:13:39.523352 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:13:39.590259 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca8c4c2-b5a6-49f8-a546-832a775fa343 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:13:39.783584 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9044812-d698-4bc1-8a6e-21bb11b36230 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea002bf49c248dbae7147665fa10fd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:13:39.784364 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9044812-d698-4bc1-8a6e-21bb11b36230 service nova] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:13:39.784659 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9044812-d698-4bc1-8a6e-21bb11b36230 service nova] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:13:39.785097 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9044812-d698-4bc1-8a6e-21bb11b36230 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:13:39.786972 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-f9044812-d698-4bc1-8a6e-21bb11b36230 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:13:39.885298 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:13:39.890214 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9044812-d698-4bc1-8a6e-21bb11b36230 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:13:39.891903 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9044812-d698-4bc1-8a6e-21bb11b36230 service nova] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:13:39.911930 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 694/1409] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:13:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 562 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:13:49.052370 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=33 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:13:49.909889 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=7 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:13:54.354732 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706ee093-5117-4e78-b6c0-48ee5f820885 None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:13:54.355273 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706ee093-5117-4e78-b6c0-48ee5f820885 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:13:54.355273 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706ee093-5117-4e78-b6c0-48ee5f820885 None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:13:54.356611 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 716/1410] 10.222.0.47 () {54 vars in 918 bytes} [Wed Aug 31 00:13:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:13:54.361592 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d72e07f-ddf7-454f-a8b5-0ae54bc760b4 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:13:54.362024 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d72e07f-ddf7-454f-a8b5-0ae54bc760b4 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:13:54.362153 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d72e07f-ddf7-454f-a8b5-0ae54bc760b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:13:54.438302 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-3d72e07f-ddf7-454f-a8b5-0ae54bc760b4 None None] MFA Rules not processed for user `8f76e01e32264ff7a6a7740ffa0a207d`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:13:54.439497 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-3d72e07f-ddf7-454f-a8b5-0ae54bc760b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:13:54.550981 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 695/1411] 10.222.0.47 () {58 vars in 1015 bytes} [Wed Aug 31 00:13:54 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:13:54.565021 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bbe154-011f-4d94-ad91-3b49a16be374 None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:13:54.565311 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bbe154-011f-4d94-ad91-3b49a16be374 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:13:54.565722 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bbe154-011f-4d94-ad91-3b49a16be374 None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:13:54.567068 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 717/1412] 10.222.0.47 () {54 vars in 918 bytes} [Wed Aug 31 00:13:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:13:54.571921 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90acdd14-5e6b-450f-9948-a51cff06c393 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:13:54.572236 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90acdd14-5e6b-450f-9948-a51cff06c393 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:13:54.572510 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90acdd14-5e6b-450f-9948-a51cff06c393 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:13:54.646758 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:13:54.649482 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-90acdd14-5e6b-450f-9948-a51cff06c393 None None] MFA Rules not processed for user `9ea002bf49c248dbae7147665fa10fd1`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:13:54.651206 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-90acdd14-5e6b-450f-9948-a51cff06c393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:13:54.769885 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 696/1413] 10.222.0.47 () {58 vars in 1015 bytes} [Wed Aug 31 00:13:54 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:13:57.196446 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a020b0-d97e-4145-8178-b3da045ff0cd None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:13:57.196988 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a020b0-d97e-4145-8178-b3da045ff0cd None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:13:57.196988 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a020b0-d97e-4145-8178-b3da045ff0cd None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:13:57.198337 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 718/1414] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 00:13:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:13:57.203656 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358e5a3c-41a5-45df-95df-c99f59f49624 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:13:57.204087 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358e5a3c-41a5-45df-95df-c99f59f49624 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:13:57.204211 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358e5a3c-41a5-45df-95df-c99f59f49624 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:13:57.273294 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-358e5a3c-41a5-45df-95df-c99f59f49624 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:13:57.274425 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-358e5a3c-41a5-45df-95df-c99f59f49624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:13:57.333110 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:13:57.376504 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 697/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 00:13:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:13:57.669438 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a020b0-d97e-4145-8178-b3da045ff0cd None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:13:57.670978 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-e0a020b0-d97e-4145-8178-b3da045ff0cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:13:57.816769 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a020b0-d97e-4145-8178-b3da045ff0cd None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:13:57.893395 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:13:57.935654 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093d18eb-62e1-4702-aff3-970bbbf2cc8a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea002bf49c248dbae7147665fa10fd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:13:57.936308 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093d18eb-62e1-4702-aff3-970bbbf2cc8a service nova] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:13:57.936588 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093d18eb-62e1-4702-aff3-970bbbf2cc8a service nova] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:13:57.936861 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093d18eb-62e1-4702-aff3-970bbbf2cc8a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:13:57.938460 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-093d18eb-62e1-4702-aff3-970bbbf2cc8a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:13:58.032830 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093d18eb-62e1-4702-aff3-970bbbf2cc8a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:13:58.034702 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093d18eb-62e1-4702-aff3-970bbbf2cc8a service nova] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:13:58.053326 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 719/1416] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:13:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:13:58.953368 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90967e0e-01a1-4015-b16c-c57a1bd8d807 None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:13:58.953918 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90967e0e-01a1-4015-b16c-c57a1bd8d807 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:13:58.953918 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90967e0e-01a1-4015-b16c-c57a1bd8d807 None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:13:58.955250 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 698/1417] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 00:13:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:13:58.960662 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299dfcf4-e57b-470c-aefe-b5aac10141b6 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:13:58.961185 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299dfcf4-e57b-470c-aefe-b5aac10141b6 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:13:58.961343 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299dfcf4-e57b-470c-aefe-b5aac10141b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:13:59.040447 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-299dfcf4-e57b-470c-aefe-b5aac10141b6 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:13:59.041674 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-299dfcf4-e57b-470c-aefe-b5aac10141b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:13:59.069681 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:13:59.140235 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 720/1418] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 00:13:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:13:59.292447 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90967e0e-01a1-4015-b16c-c57a1bd8d807 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:13:59.293888 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-90967e0e-01a1-4015-b16c-c57a1bd8d807 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:13:59.439966 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90967e0e-01a1-4015-b16c-c57a1bd8d807 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:13:59.481048 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:13:59.560429 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e3a105-d438-4450-a9b8-cebd9ba7eeff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea002bf49c248dbae7147665fa10fd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:13:59.560963 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e3a105-d438-4450-a9b8-cebd9ba7eeff service nova] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:13:59.561294 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e3a105-d438-4450-a9b8-cebd9ba7eeff service nova] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:13:59.561509 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e3a105-d438-4450-a9b8-cebd9ba7eeff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:13:59.563122 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-e7e3a105-d438-4450-a9b8-cebd9ba7eeff service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:13:59.654333 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e3a105-d438-4450-a9b8-cebd9ba7eeff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:13:59.655968 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e3a105-d438-4450-a9b8-cebd9ba7eeff service nova] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:13:59.674923 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 699/1419] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:13:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:14:00.557588 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbabf72a-76ae-480c-b74f-e947b48f6388 None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:00.558160 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbabf72a-76ae-480c-b74f-e947b48f6388 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:00.558160 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbabf72a-76ae-480c-b74f-e947b48f6388 None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:00.559487 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 721/1420] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 00:14:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:14:00.564526 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69138a1f-577b-43de-a932-3441a669f0ce None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:00.564928 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69138a1f-577b-43de-a932-3441a669f0ce None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:00.565101 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69138a1f-577b-43de-a932-3441a669f0ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:00.622111 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:14:00.645868 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-69138a1f-577b-43de-a932-3441a669f0ce None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:14:00.647111 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-69138a1f-577b-43de-a932-3441a669f0ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:14:00.747434 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 700/1421] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 00:14:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:14:00.899212 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbabf72a-76ae-480c-b74f-e947b48f6388 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:14:00.900987 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-bbabf72a-76ae-480c-b74f-e947b48f6388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:14:01.052070 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbabf72a-76ae-480c-b74f-e947b48f6388 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:14:01.064451 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:14:01.167599 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bea9680-493e-4961-afbb-cea360c27185 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea002bf49c248dbae7147665fa10fd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:14:01.168127 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bea9680-493e-4961-afbb-cea360c27185 service nova] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:01.168432 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bea9680-493e-4961-afbb-cea360c27185 service nova] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:01.168695 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bea9680-493e-4961-afbb-cea360c27185 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:01.170284 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-8bea9680-493e-4961-afbb-cea360c27185 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:14:01.261012 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bea9680-493e-4961-afbb-cea360c27185 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:14:01.262610 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bea9680-493e-4961-afbb-cea360c27185 service nova] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:14:01.281606 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 722/1422] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:14:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:14:02.162727 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ce1f7a-57c6-4e92-8e0e-49e5ad5bc0bf None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:02.163300 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ce1f7a-57c6-4e92-8e0e-49e5ad5bc0bf None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:02.163300 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ce1f7a-57c6-4e92-8e0e-49e5ad5bc0bf None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:02.164677 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 701/1423] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 00:14:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:14:02.169654 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8985692-91e4-47c6-a965-f14ae9c0e7f5 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:02.170109 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8985692-91e4-47c6-a965-f14ae9c0e7f5 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:02.170206 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8985692-91e4-47c6-a965-f14ae9c0e7f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:02.191534 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:14:02.248379 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-f8985692-91e4-47c6-a965-f14ae9c0e7f5 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:14:02.249508 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-f8985692-91e4-47c6-a965-f14ae9c0e7f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:14:02.348328 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 723/1424] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 00:14:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:14:02.499316 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ce1f7a-57c6-4e92-8e0e-49e5ad5bc0bf None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:14:02.500798 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-a0ce1f7a-57c6-4e92-8e0e-49e5ad5bc0bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:14:02.611636 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:14:02.649116 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ce1f7a-57c6-4e92-8e0e-49e5ad5bc0bf None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:14:02.764660 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343e3243-4191-42c9-ba76-0f8125e21b63 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea002bf49c248dbae7147665fa10fd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:14:02.765177 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343e3243-4191-42c9-ba76-0f8125e21b63 service nova] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:02.765450 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343e3243-4191-42c9-ba76-0f8125e21b63 service nova] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:02.765717 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343e3243-4191-42c9-ba76-0f8125e21b63 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:02.767301 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-343e3243-4191-42c9-ba76-0f8125e21b63 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:14:02.844051 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:14:02.858466 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343e3243-4191-42c9-ba76-0f8125e21b63 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:14:02.860117 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343e3243-4191-42c9-ba76-0f8125e21b63 service nova] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:14:02.888747 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 702/1425] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:14:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:14:03.769263 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3bbc31-c465-4ab5-84a7-de10c4c4f0fd None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:03.769808 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3bbc31-c465-4ab5-84a7-de10c4c4f0fd None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:03.769808 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3bbc31-c465-4ab5-84a7-de10c4c4f0fd None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:03.771165 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 724/1426] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 00:14:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:14:03.776270 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af138d58-0f95-464a-8b6a-b982bcb70727 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:03.776730 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af138d58-0f95-464a-8b6a-b982bcb70727 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:03.776837 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af138d58-0f95-464a-8b6a-b982bcb70727 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:03.855768 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-af138d58-0f95-464a-8b6a-b982bcb70727 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:14:03.856937 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-af138d58-0f95-464a-8b6a-b982bcb70727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:14:03.959602 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 703/1427] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 00:14:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:14:04.110145 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3bbc31-c465-4ab5-84a7-de10c4c4f0fd None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:14:04.111597 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-0d3bbc31-c465-4ab5-84a7-de10c4c4f0fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:14:04.199022 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:14:04.264335 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3bbc31-c465-4ab5-84a7-de10c4c4f0fd None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:14:04.378543 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7721c28-7ac2-4ec0-b5c3-59badc1987dd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea002bf49c248dbae7147665fa10fd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:14:04.379067 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7721c28-7ac2-4ec0-b5c3-59badc1987dd service nova] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:04.379347 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7721c28-7ac2-4ec0-b5c3-59badc1987dd service nova] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:04.379619 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7721c28-7ac2-4ec0-b5c3-59badc1987dd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:04.381264 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-a7721c28-7ac2-4ec0-b5c3-59badc1987dd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:14:04.430450 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:14:04.473013 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7721c28-7ac2-4ec0-b5c3-59badc1987dd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:14:04.474689 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7721c28-7ac2-4ec0-b5c3-59badc1987dd service nova] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:14:04.495161 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 725/1428] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:14:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:14:05.324657 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7f582a-0ecb-4095-a351-94d4ac47b024 None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:05.325208 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7f582a-0ecb-4095-a351-94d4ac47b024 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:05.325208 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7f582a-0ecb-4095-a351-94d4ac47b024 None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:05.326511 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 704/1429] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 00:14:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:14:05.332029 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef84ac49-3708-47fb-a903-b81c6c7ea395 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:05.332528 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef84ac49-3708-47fb-a903-b81c6c7ea395 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:05.332650 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef84ac49-3708-47fb-a903-b81c6c7ea395 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:05.409165 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-ef84ac49-3708-47fb-a903-b81c6c7ea395 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:14:05.410389 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-ef84ac49-3708-47fb-a903-b81c6c7ea395 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:14:05.508119 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 726/1430] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 00:14:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:14:05.662251 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7f582a-0ecb-4095-a351-94d4ac47b024 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:14:05.663780 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-5b7f582a-0ecb-4095-a351-94d4ac47b024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:14:05.713185 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:14:05.813913 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7f582a-0ecb-4095-a351-94d4ac47b024 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:14:05.928855 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971badd8-016f-4e1d-bb07-58b1d1d98ec2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea002bf49c248dbae7147665fa10fd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:14:05.929379 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971badd8-016f-4e1d-bb07-58b1d1d98ec2 service nova] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:05.929655 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971badd8-016f-4e1d-bb07-58b1d1d98ec2 service nova] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:05.929923 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971badd8-016f-4e1d-bb07-58b1d1d98ec2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:05.931548 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-971badd8-016f-4e1d-bb07-58b1d1d98ec2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:14:05.938575 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:14:06.023777 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971badd8-016f-4e1d-bb07-58b1d1d98ec2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:14:06.025428 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971badd8-016f-4e1d-bb07-58b1d1d98ec2 service nova] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:14:06.044822 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 705/1431] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:14:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:14:06.851169 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea583cf-0989-4653-9532-68ce09d91e4a None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:06.851732 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea583cf-0989-4653-9532-68ce09d91e4a None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:06.851732 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea583cf-0989-4653-9532-68ce09d91e4a None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:06.853011 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 727/1432] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 00:14:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:14:06.858396 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791e8537-33d1-40ac-b49e-66a3a0e25d20 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:06.858912 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791e8537-33d1-40ac-b49e-66a3a0e25d20 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:06.859065 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791e8537-33d1-40ac-b49e-66a3a0e25d20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:06.938734 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-791e8537-33d1-40ac-b49e-66a3a0e25d20 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:14:06.940577 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-791e8537-33d1-40ac-b49e-66a3a0e25d20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:14:07.017445 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:14:07.049965 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 706/1433] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 00:14:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:14:07.202656 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea583cf-0989-4653-9532-68ce09d91e4a None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:14:07.204198 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-5ea583cf-0989-4653-9532-68ce09d91e4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:14:07.223161 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:14:07.356084 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea583cf-0989-4653-9532-68ce09d91e4a None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:14:07.444776 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:14:07.471952 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0585f25-b7e5-434c-aa3d-d11f7c5c557c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea002bf49c248dbae7147665fa10fd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:14:07.472510 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0585f25-b7e5-434c-aa3d-d11f7c5c557c service nova] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:07.472814 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0585f25-b7e5-434c-aa3d-d11f7c5c557c service nova] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:07.473061 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0585f25-b7e5-434c-aa3d-d11f7c5c557c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:07.474715 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-c0585f25-b7e5-434c-aa3d-d11f7c5c557c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:14:07.567141 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0585f25-b7e5-434c-aa3d-d11f7c5c557c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:14:07.568779 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0585f25-b7e5-434c-aa3d-d11f7c5c557c service nova] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:14:07.587159 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 728/1434] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:14:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:14:08.390503 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8371ad-cfa8-41bd-adfb-7196779c38f1 None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:08.391060 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8371ad-cfa8-41bd-adfb-7196779c38f1 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:08.391060 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8371ad-cfa8-41bd-adfb-7196779c38f1 None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:08.392488 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 707/1435] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 00:14:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:14:08.398154 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e1d6a3-82ff-45b6-b2b4-d9d4fcb82ff3 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:08.398601 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e1d6a3-82ff-45b6-b2b4-d9d4fcb82ff3 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:08.398710 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e1d6a3-82ff-45b6-b2b4-d9d4fcb82ff3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:08.475278 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-c9e1d6a3-82ff-45b6-b2b4-d9d4fcb82ff3 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:14:08.476744 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-c9e1d6a3-82ff-45b6-b2b4-d9d4fcb82ff3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:14:08.519377 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:14:08.575637 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 729/1436] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 00:14:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:14:08.725777 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8371ad-cfa8-41bd-adfb-7196779c38f1 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:14:08.727297 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-2d8371ad-cfa8-41bd-adfb-7196779c38f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:14:08.874480 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8371ad-cfa8-41bd-adfb-7196779c38f1 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:14:08.929315 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:14:08.990056 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178949c9-748b-4825-b589-dc02933dd6f6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea002bf49c248dbae7147665fa10fd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:14:08.990668 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178949c9-748b-4825-b589-dc02933dd6f6 service nova] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:08.990946 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178949c9-748b-4825-b589-dc02933dd6f6 service nova] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:08.991218 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178949c9-748b-4825-b589-dc02933dd6f6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:08.992867 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-178949c9-748b-4825-b589-dc02933dd6f6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:14:09.084792 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178949c9-748b-4825-b589-dc02933dd6f6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:14:09.086413 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178949c9-748b-4825-b589-dc02933dd6f6 service nova] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:14:09.105732 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 708/1437] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:14:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:14:09.926877 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a383d60-cea0-4ccf-9437-95cf731ccefd None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:09.927416 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a383d60-cea0-4ccf-9437-95cf731ccefd None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:09.927416 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a383d60-cea0-4ccf-9437-95cf731ccefd None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:09.928810 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 730/1438] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 00:14:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:14:09.933988 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649bde1a-ae41-45ab-a9e1-9ed80e39ab9c None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:09.934436 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649bde1a-ae41-45ab-a9e1-9ed80e39ab9c None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:09.934559 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649bde1a-ae41-45ab-a9e1-9ed80e39ab9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:10.012515 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-649bde1a-ae41-45ab-a9e1-9ed80e39ab9c None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:14:10.013776 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-649bde1a-ae41-45ab-a9e1-9ed80e39ab9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:14:10.015836 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:14:10.112549 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 709/1439] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 00:14:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:14:10.266126 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a383d60-cea0-4ccf-9437-95cf731ccefd None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:14:10.267736 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-4a383d60-cea0-4ccf-9437-95cf731ccefd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:14:10.419085 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a383d60-cea0-4ccf-9437-95cf731ccefd None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:14:10.448883 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:14:10.537602 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb4d6aa-0d6b-41de-9757-7af7178090c2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea002bf49c248dbae7147665fa10fd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:14:10.538208 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb4d6aa-0d6b-41de-9757-7af7178090c2 service nova] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:10.538482 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb4d6aa-0d6b-41de-9757-7af7178090c2 service nova] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:10.538750 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb4d6aa-0d6b-41de-9757-7af7178090c2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:10.540381 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-fbb4d6aa-0d6b-41de-9757-7af7178090c2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:14:10.630489 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb4d6aa-0d6b-41de-9757-7af7178090c2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:14:10.632077 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb4d6aa-0d6b-41de-9757-7af7178090c2 service nova] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:14:10.649806 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 731/1440] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:14:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:14:12.500113 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74e111d-b302-4237-bc05-a6a667f7d6a1 None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:12.500727 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74e111d-b302-4237-bc05-a6a667f7d6a1 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:12.500727 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74e111d-b302-4237-bc05-a6a667f7d6a1 None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:12.502113 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 710/1441] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 00:14:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:14:12.507686 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920cecea-a557-4eb2-bfaf-378efff4a6a3 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:12.508178 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920cecea-a557-4eb2-bfaf-378efff4a6a3 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:12.508295 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920cecea-a557-4eb2-bfaf-378efff4a6a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:12.550598 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:14:12.576249 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-920cecea-a557-4eb2-bfaf-378efff4a6a3 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:14:12.577465 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-920cecea-a557-4eb2-bfaf-378efff4a6a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:14:12.675194 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 732/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 00:14:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:14:12.960636 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74e111d-b302-4237-bc05-a6a667f7d6a1 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:14:12.962388 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-b74e111d-b302-4237-bc05-a6a667f7d6a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:14:13.070101 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74e111d-b302-4237-bc05-a6a667f7d6a1 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:14:13.102035 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:14:13.145540 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba69085c-dab1-4b3b-8fe6-0935cb5b77ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'daae792cd11d4c4ca7aae0558998aced', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:14:13.146149 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba69085c-dab1-4b3b-8fe6-0935cb5b77ee service neutron] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:13.146428 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba69085c-dab1-4b3b-8fe6-0935cb5b77ee service neutron] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:13.146699 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba69085c-dab1-4b3b-8fe6-0935cb5b77ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:13.148365 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-ba69085c-dab1-4b3b-8fe6-0935cb5b77ee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:14:13.259609 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba69085c-dab1-4b3b-8fe6-0935cb5b77ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:14:13.260974 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba69085c-dab1-4b3b-8fe6-0935cb5b77ee service neutron] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:14:13.278982 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 711/1443] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:14:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:14:15.414224 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a96f6e-514c-43ae-b3fe-662c5f6149b6 None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:15.414786 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a96f6e-514c-43ae-b3fe-662c5f6149b6 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:15.414786 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a96f6e-514c-43ae-b3fe-662c5f6149b6 None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:15.416129 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 733/1444] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 00:14:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:14:15.421498 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01715f31-7f2c-45e3-85e4-a8781a45b879 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:15.421931 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01715f31-7f2c-45e3-85e4-a8781a45b879 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:15.422037 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01715f31-7f2c-45e3-85e4-a8781a45b879 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:15.494505 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-01715f31-7f2c-45e3-85e4-a8781a45b879 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:14:15.495717 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-01715f31-7f2c-45e3-85e4-a8781a45b879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:14:15.509290 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:14:15.599106 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 712/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 00:14:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:14:15.894972 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a96f6e-514c-43ae-b3fe-662c5f6149b6 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:14:15.896960 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-e2a96f6e-514c-43ae-b3fe-662c5f6149b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:14:16.006274 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a96f6e-514c-43ae-b3fe-662c5f6149b6 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:14:16.019648 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:14:16.084738 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef72f5d-ff0f-457b-8eba-10fa9130d41b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'daae792cd11d4c4ca7aae0558998aced', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:14:16.085348 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef72f5d-ff0f-457b-8eba-10fa9130d41b service neutron] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:16.085628 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef72f5d-ff0f-457b-8eba-10fa9130d41b service neutron] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:16.085901 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef72f5d-ff0f-457b-8eba-10fa9130d41b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:16.087791 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-0ef72f5d-ff0f-457b-8eba-10fa9130d41b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:14:16.199011 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef72f5d-ff0f-457b-8eba-10fa9130d41b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:14:16.200386 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef72f5d-ff0f-457b-8eba-10fa9130d41b service neutron] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:14:16.218578 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 734/1446] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:14:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 00:14:18.684828 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bc7174-fbf0-4efe-ba3f-404c65f2c21b None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:18.685412 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bc7174-fbf0-4efe-ba3f-404c65f2c21b None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:18.685412 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bc7174-fbf0-4efe-ba3f-404c65f2c21b None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:18.686703 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 713/1447] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 00:14:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:14:18.692496 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6c23bf-bb42-40e2-b96b-9b4f53dbedff None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:18.692906 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6c23bf-bb42-40e2-b96b-9b4f53dbedff None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:18.693045 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6c23bf-bb42-40e2-b96b-9b4f53dbedff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:18.741460 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:14:18.761013 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-ac6c23bf-bb42-40e2-b96b-9b4f53dbedff None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:14:18.762247 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-ac6c23bf-bb42-40e2-b96b-9b4f53dbedff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:14:18.859362 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 735/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 00:14:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:14:19.148144 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bc7174-fbf0-4efe-ba3f-404c65f2c21b None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:14:19.149702 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-98bc7174-fbf0-4efe-ba3f-404c65f2c21b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:14:19.258511 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bc7174-fbf0-4efe-ba3f-404c65f2c21b None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:14:19.299529 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:14:19.335235 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87061781-f55b-414d-be29-07f917c54830 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'daae792cd11d4c4ca7aae0558998aced', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:14:19.335854 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87061781-f55b-414d-be29-07f917c54830 service neutron] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:19.336122 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87061781-f55b-414d-be29-07f917c54830 service neutron] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:19.336428 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87061781-f55b-414d-be29-07f917c54830 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:19.338051 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-87061781-f55b-414d-be29-07f917c54830 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:14:19.447671 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87061781-f55b-414d-be29-07f917c54830 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:14:19.449130 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87061781-f55b-414d-be29-07f917c54830 service neutron] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:14:19.467223 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 714/1449] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:14:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:14:21.547171 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0b6043-65fc-4094-b4b2-35aefe1e7b9b None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:21.547751 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0b6043-65fc-4094-b4b2-35aefe1e7b9b None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:21.547751 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0b6043-65fc-4094-b4b2-35aefe1e7b9b None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:21.549414 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 736/1450] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 00:14:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:14:21.554751 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952d6ac9-f989-42cf-943d-33247c1bef06 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:21.555169 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952d6ac9-f989-42cf-943d-33247c1bef06 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:21.555332 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952d6ac9-f989-42cf-943d-33247c1bef06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:21.621620 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-952d6ac9-f989-42cf-943d-33247c1bef06 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:14:21.622836 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-952d6ac9-f989-42cf-943d-33247c1bef06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:14:21.644836 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:14:21.723856 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 715/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 00:14:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:14:22.012611 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0b6043-65fc-4094-b4b2-35aefe1e7b9b None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:14:22.014171 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-af0b6043-65fc-4094-b4b2-35aefe1e7b9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:14:22.119106 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0b6043-65fc-4094-b4b2-35aefe1e7b9b None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:14:22.138602 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:14:22.193285 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5d7ea4-33aa-419f-954a-4663770d4f80 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'daae792cd11d4c4ca7aae0558998aced', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:14:22.193892 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5d7ea4-33aa-419f-954a-4663770d4f80 service neutron] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:22.194171 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5d7ea4-33aa-419f-954a-4663770d4f80 service neutron] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:22.194459 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5d7ea4-33aa-419f-954a-4663770d4f80 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:22.196039 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-0e5d7ea4-33aa-419f-954a-4663770d4f80 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:14:22.307556 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5d7ea4-33aa-419f-954a-4663770d4f80 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:14:22.308945 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5d7ea4-33aa-419f-954a-4663770d4f80 service neutron] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:14:22.327021 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 737/1452] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:14:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:14:24.310912 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e0aaf7-6f93-4393-b2a0-0df60665fdc4 None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:24.311552 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e0aaf7-6f93-4393-b2a0-0df60665fdc4 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:24.311552 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e0aaf7-6f93-4393-b2a0-0df60665fdc4 None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:24.312734 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 716/1453] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 00:14:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:14:24.318746 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836da311-17d4-48ed-a66c-322cd72e4f3c None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:24.319212 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836da311-17d4-48ed-a66c-322cd72e4f3c None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:24.319328 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836da311-17d4-48ed-a66c-322cd72e4f3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:24.387812 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:14:24.391210 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-836da311-17d4-48ed-a66c-322cd72e4f3c None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:14:24.393766 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-836da311-17d4-48ed-a66c-322cd72e4f3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:14:24.494738 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 738/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 00:14:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:14:24.782156 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e0aaf7-6f93-4393-b2a0-0df60665fdc4 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:14:24.784334 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-80e0aaf7-6f93-4393-b2a0-0df60665fdc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:14:24.893111 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e0aaf7-6f93-4393-b2a0-0df60665fdc4 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:14:24.944852 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:14:24.969948 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e27504d-7adc-4078-9def-0b9011d23f82 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'daae792cd11d4c4ca7aae0558998aced', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:14:24.970777 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e27504d-7adc-4078-9def-0b9011d23f82 service neutron] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:24.971055 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e27504d-7adc-4078-9def-0b9011d23f82 service neutron] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:24.971322 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e27504d-7adc-4078-9def-0b9011d23f82 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:24.972953 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-7e27504d-7adc-4078-9def-0b9011d23f82 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:14:25.087484 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e27504d-7adc-4078-9def-0b9011d23f82 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:14:25.088876 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e27504d-7adc-4078-9def-0b9011d23f82 service neutron] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:14:25.107911 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 717/1455] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:14:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:14:27.120913 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8819c6a6-0b19-434d-8a31-af9714ca56a4 None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:27.121433 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8819c6a6-0b19-434d-8a31-af9714ca56a4 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:27.121433 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8819c6a6-0b19-434d-8a31-af9714ca56a4 None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:27.122743 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 739/1456] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 00:14:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:14:27.129104 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b93ac2-cdb0-4594-a595-60095c043855 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:27.129597 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b93ac2-cdb0-4594-a595-60095c043855 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:27.129689 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b93ac2-cdb0-4594-a595-60095c043855 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:27.196944 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-82b93ac2-cdb0-4594-a595-60095c043855 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:14:27.198160 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-82b93ac2-cdb0-4594-a595-60095c043855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:14:27.227193 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:14:27.296749 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 718/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 00:14:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:14:27.593301 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8819c6a6-0b19-434d-8a31-af9714ca56a4 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:14:27.594836 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-8819c6a6-0b19-434d-8a31-af9714ca56a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:14:27.699882 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8819c6a6-0b19-434d-8a31-af9714ca56a4 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:14:27.729553 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:14:27.776567 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e151d3b-09c4-4338-a481-28c1b20f7381 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'daae792cd11d4c4ca7aae0558998aced', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:14:27.777178 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e151d3b-09c4-4338-a481-28c1b20f7381 service neutron] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:27.777459 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e151d3b-09c4-4338-a481-28c1b20f7381 service neutron] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:27.777736 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e151d3b-09c4-4338-a481-28c1b20f7381 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:27.779354 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-9e151d3b-09c4-4338-a481-28c1b20f7381 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:14:27.896078 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e151d3b-09c4-4338-a481-28c1b20f7381 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:14:27.897566 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e151d3b-09c4-4338-a481-28c1b20f7381 service neutron] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:14:27.917246 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 740/1458] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:14:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:14:29.902481 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51138293-2113-47f2-b5a8-606d4e85bb5e None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:29.903034 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51138293-2113-47f2-b5a8-606d4e85bb5e None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:29.903034 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51138293-2113-47f2-b5a8-606d4e85bb5e None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:29.904385 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 719/1459] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 00:14:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:14:29.910576 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4764b3-f5c7-4b7c-a03d-d51cce286fdc None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:29.911016 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4764b3-f5c7-4b7c-a03d-d51cce286fdc None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:29.911138 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4764b3-f5c7-4b7c-a03d-d51cce286fdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:29.978788 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-3d4764b3-f5c7-4b7c-a03d-d51cce286fdc None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:14:29.980029 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-3d4764b3-f5c7-4b7c-a03d-d51cce286fdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:14:29.989355 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:14:30.080608 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 741/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 00:14:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:14:30.371291 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51138293-2113-47f2-b5a8-606d4e85bb5e None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:14:30.372912 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-51138293-2113-47f2-b5a8-606d4e85bb5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:14:30.482965 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51138293-2113-47f2-b5a8-606d4e85bb5e None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:14:30.539948 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:14:30.558421 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b8cc73-57a1-428b-8b9f-61ff8e497e1e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'daae792cd11d4c4ca7aae0558998aced', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:14:30.559040 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b8cc73-57a1-428b-8b9f-61ff8e497e1e service neutron] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:30.559309 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b8cc73-57a1-428b-8b9f-61ff8e497e1e service neutron] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:30.559579 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b8cc73-57a1-428b-8b9f-61ff8e497e1e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:30.561325 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-a7b8cc73-57a1-428b-8b9f-61ff8e497e1e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:14:30.674753 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b8cc73-57a1-428b-8b9f-61ff8e497e1e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:14:30.676241 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b8cc73-57a1-428b-8b9f-61ff8e497e1e service neutron] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:14:30.701088 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 720/1461] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:14:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:14:32.809593 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0cf9e1-9f12-4263-a6d6-92fc85394ab9 None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:32.810193 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0cf9e1-9f12-4263-a6d6-92fc85394ab9 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:32.810193 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0cf9e1-9f12-4263-a6d6-92fc85394ab9 None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:32.811583 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 742/1462] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 00:14:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:14:32.816872 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2565b9b-b486-4faf-a85c-70b1426dfb30 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:32.817288 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2565b9b-b486-4faf-a85c-70b1426dfb30 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:32.817426 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2565b9b-b486-4faf-a85c-70b1426dfb30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:32.884902 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-a2565b9b-b486-4faf-a85c-70b1426dfb30 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:14:32.886416 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-a2565b9b-b486-4faf-a85c-70b1426dfb30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:14:32.926377 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:14:32.991142 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 721/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 00:14:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:14:33.291029 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0cf9e1-9f12-4263-a6d6-92fc85394ab9 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:14:33.292594 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-2f0cf9e1-9f12-4263-a6d6-92fc85394ab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:14:33.398268 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0cf9e1-9f12-4263-a6d6-92fc85394ab9 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:14:33.436797 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:14:33.476238 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2430aab6-0af3-4572-9f1b-8b1e37d97a7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'daae792cd11d4c4ca7aae0558998aced', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:14:33.476860 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2430aab6-0af3-4572-9f1b-8b1e37d97a7f service neutron] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:33.477142 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2430aab6-0af3-4572-9f1b-8b1e37d97a7f service neutron] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:33.477425 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2430aab6-0af3-4572-9f1b-8b1e37d97a7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:33.479089 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-2430aab6-0af3-4572-9f1b-8b1e37d97a7f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:14:33.597825 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2430aab6-0af3-4572-9f1b-8b1e37d97a7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:14:33.599303 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2430aab6-0af3-4572-9f1b-8b1e37d97a7f service neutron] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:14:33.620171 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 743/1464] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:14:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:14:35.553707 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238c47d3-a891-47cc-acf3-1f8f31f14e91 None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:35.554295 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238c47d3-a891-47cc-acf3-1f8f31f14e91 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:35.554295 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238c47d3-a891-47cc-acf3-1f8f31f14e91 None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:35.555600 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 722/1465] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 00:14:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:14:35.561328 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25037b8f-ee09-4d27-8a5e-5dd21fd4f688 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:35.561751 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25037b8f-ee09-4d27-8a5e-5dd21fd4f688 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:35.561901 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25037b8f-ee09-4d27-8a5e-5dd21fd4f688 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:35.632683 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-25037b8f-ee09-4d27-8a5e-5dd21fd4f688 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:14:35.633937 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-25037b8f-ee09-4d27-8a5e-5dd21fd4f688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:14:35.652574 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:14:35.735106 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 744/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 00:14:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:14:36.023545 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238c47d3-a891-47cc-acf3-1f8f31f14e91 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:14:36.025163 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-238c47d3-a891-47cc-acf3-1f8f31f14e91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:14:36.142900 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238c47d3-a891-47cc-acf3-1f8f31f14e91 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:14:36.211182 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:14:36.221106 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd55d9ee-d088-44c6-b4e0-01a04dec02a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'daae792cd11d4c4ca7aae0558998aced', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:14:36.221977 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd55d9ee-d088-44c6-b4e0-01a04dec02a0 service neutron] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:36.222270 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd55d9ee-d088-44c6-b4e0-01a04dec02a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:36.222546 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd55d9ee-d088-44c6-b4e0-01a04dec02a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:36.224214 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-fd55d9ee-d088-44c6-b4e0-01a04dec02a0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:14:36.337155 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd55d9ee-d088-44c6-b4e0-01a04dec02a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:14:36.338509 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd55d9ee-d088-44c6-b4e0-01a04dec02a0 service neutron] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:14:36.357170 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 723/1467] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:14:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:14:38.307658 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e025130d-f391-4970-8cb2-bdc5b37b1705 None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:38.308278 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e025130d-f391-4970-8cb2-bdc5b37b1705 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:38.308278 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e025130d-f391-4970-8cb2-bdc5b37b1705 None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:38.309528 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 745/1468] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 00:14:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:14:38.315241 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d85d98-edf1-4e6a-8706-397b8a67b80d None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:38.315728 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d85d98-edf1-4e6a-8706-397b8a67b80d None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:38.315835 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d85d98-edf1-4e6a-8706-397b8a67b80d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:38.383331 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-f6d85d98-edf1-4e6a-8706-397b8a67b80d None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:14:38.384561 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-f6d85d98-edf1-4e6a-8706-397b8a67b80d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:14:38.432903 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:14:38.482367 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 724/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 00:14:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:14:38.766789 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e025130d-f391-4970-8cb2-bdc5b37b1705 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:14:38.768354 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-e025130d-f391-4970-8cb2-bdc5b37b1705 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:14:38.873201 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e025130d-f391-4970-8cb2-bdc5b37b1705 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:14:38.922227 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:14:38.949593 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435c819a-f357-48c6-8f98-71f287600b10 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'daae792cd11d4c4ca7aae0558998aced', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:14:38.950210 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435c819a-f357-48c6-8f98-71f287600b10 service neutron] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:38.950489 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435c819a-f357-48c6-8f98-71f287600b10 service neutron] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:38.950762 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435c819a-f357-48c6-8f98-71f287600b10 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:38.952392 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-435c819a-f357-48c6-8f98-71f287600b10 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:14:39.061942 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435c819a-f357-48c6-8f98-71f287600b10 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:14:39.063797 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435c819a-f357-48c6-8f98-71f287600b10 service neutron] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:14:39.082926 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 746/1470] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:14:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:14:48.480486 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=22 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:14:49.080631 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=66 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:14:58.721944 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b581bdbd-b811-4c04-873e-d46913b25115 None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:58.722554 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b581bdbd-b811-4c04-873e-d46913b25115 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:58.722554 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b581bdbd-b811-4c04-873e-d46913b25115 None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:58.723988 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 725/1471] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 00:14:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:14:58.729201 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44eca98-81b2-4e53-bec6-51f26684fae2 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:58.729644 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44eca98-81b2-4e53-bec6-51f26684fae2 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:58.729767 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44eca98-81b2-4e53-bec6-51f26684fae2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:58.802315 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-d44eca98-81b2-4e53-bec6-51f26684fae2 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:14:58.803534 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-d44eca98-81b2-4e53-bec6-51f26684fae2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:14:58.901182 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 747/1472] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 00:14:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:14:59.197133 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84275fbf-9600-4194-bf1a-1c3f20a74adb None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:59.197417 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84275fbf-9600-4194-bf1a-1c3f20a74adb None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:59.197689 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84275fbf-9600-4194-bf1a-1c3f20a74adb None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:59.199017 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 726/1473] 10.222.0.47 () {54 vars in 967 bytes} [Wed Aug 31 00:14:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:14:59.204082 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6121989e-32e7-42d5-af03-1807c73a01f4 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:59.204402 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6121989e-32e7-42d5-af03-1807c73a01f4 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:59.204677 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6121989e-32e7-42d5-af03-1807c73a01f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:59.284121 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-6121989e-32e7-42d5-af03-1807c73a01f4 None None] MFA Rules not processed for user `cc025521e1dc4c91ab50a8718a87754f`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:14:59.285264 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-6121989e-32e7-42d5-af03-1807c73a01f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:14:59.306156 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:14:59.363134 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 748/1474] 10.222.0.47 () {58 vars in 1064 bytes} [Wed Aug 31 00:14:59 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:14:59.370613 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84275fbf-9600-4194-bf1a-1c3f20a74adb None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:14:59.372180 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-84275fbf-9600-4194-bf1a-1c3f20a74adb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:14:59.476616 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84275fbf-9600-4194-bf1a-1c3f20a74adb None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:14:59.556726 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df77f98-c164-4f6a-ad2d-c77a54e9149d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc025521e1dc4c91ab50a8718a87754f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:14:59.557227 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df77f98-c164-4f6a-ad2d-c77a54e9149d service glance] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:59.557513 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df77f98-c164-4f6a-ad2d-c77a54e9149d service glance] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:59.557786 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df77f98-c164-4f6a-ad2d-c77a54e9149d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:59.559391 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-3df77f98-c164-4f6a-ad2d-c77a54e9149d service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:14:59.616142 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:14:59.673581 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df77f98-c164-4f6a-ad2d-c77a54e9149d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:14:59.675031 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df77f98-c164-4f6a-ad2d-c77a54e9149d service glance] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:14:59.693821 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 727/1475] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:14:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:15:01.719997 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a511fda8-610f-4fb9-8c89-63beda8e3565 None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:01.720618 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a511fda8-610f-4fb9-8c89-63beda8e3565 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:01.720618 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a511fda8-610f-4fb9-8c89-63beda8e3565 None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:01.722162 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 749/1476] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 00:15:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:15:01.727492 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb09098-f192-4b25-9df7-66767e523f42 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:01.727907 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb09098-f192-4b25-9df7-66767e523f42 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:01.728055 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb09098-f192-4b25-9df7-66767e523f42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:01.794129 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-bbb09098-f192-4b25-9df7-66767e523f42 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:15:01.795319 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-bbb09098-f192-4b25-9df7-66767e523f42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:15:01.893432 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 728/1477] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 00:15:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:15:02.172056 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a511fda8-610f-4fb9-8c89-63beda8e3565 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:02.173654 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-a511fda8-610f-4fb9-8c89-63beda8e3565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:15:02.300356 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a511fda8-610f-4fb9-8c89-63beda8e3565 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:02.349943 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:02.397996 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6232b2ae-806d-4338-8169-d439ce0f195c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:02.398602 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6232b2ae-806d-4338-8169-d439ce0f195c admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:02.398880 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6232b2ae-806d-4338-8169-d439ce0f195c admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:02.399150 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6232b2ae-806d-4338-8169-d439ce0f195c admin admin] PATH_INFO: `/v3/projects` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:02.399790 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6232b2ae-806d-4338-8169-d439ce0f195c admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:02.401532 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: WARNING py.warnings [None req-6232b2ae-806d-4338-8169-d439ce0f195c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 00:15:02.401532 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: warnings.warn(msg) Aug 31 00:15:02.401532 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: Aug 31 00:15:02.402677 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6232b2ae-806d-4338-8169-d439ce0f195c admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:02.421550 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 750/1478] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 00:15:02 2022] GET /identity/v3/projects => generated 2553 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:15:04.392941 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d317d7-bc0f-45c0-b2e7-7028e9593aad None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:04.393507 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d317d7-bc0f-45c0-b2e7-7028e9593aad None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:04.393507 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d317d7-bc0f-45c0-b2e7-7028e9593aad None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:04.394821 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 729/1479] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 00:15:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:15:04.399976 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9547ad53-cfba-44f5-875d-44f5e317e813 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:04.400433 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9547ad53-cfba-44f5-875d-44f5e317e813 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:04.400546 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9547ad53-cfba-44f5-875d-44f5e317e813 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:04.467916 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-9547ad53-cfba-44f5-875d-44f5e317e813 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:15:04.469696 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-9547ad53-cfba-44f5-875d-44f5e317e813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:15:04.571717 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 751/1480] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 00:15:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:15:04.862790 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d317d7-bc0f-45c0-b2e7-7028e9593aad None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:04.864328 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-b1d317d7-bc0f-45c0-b2e7-7028e9593aad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:15:04.874028 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:05.028166 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d317d7-bc0f-45c0-b2e7-7028e9593aad None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:05.113074 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:05.148252 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f64a364-f171-4116-983f-1e53b807ca5e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea002bf49c248dbae7147665fa10fd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:05.148897 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f64a364-f171-4116-983f-1e53b807ca5e service nova] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:05.149175 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f64a364-f171-4116-983f-1e53b807ca5e service nova] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:05.149469 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f64a364-f171-4116-983f-1e53b807ca5e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:05.151143 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-4f64a364-f171-4116-983f-1e53b807ca5e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:15:05.246971 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f64a364-f171-4116-983f-1e53b807ca5e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:05.248612 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f64a364-f171-4116-983f-1e53b807ca5e service nova] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:05.267533 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 730/1481] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:15:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:15:07.413659 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484f7395-d1ca-4975-a739-7637e5992c54 None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:07.414259 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484f7395-d1ca-4975-a739-7637e5992c54 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:07.414259 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484f7395-d1ca-4975-a739-7637e5992c54 None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:07.415557 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 752/1482] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 00:15:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:15:07.420842 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c4c002-649b-4625-b56d-5ee3b432302d None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:07.421314 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c4c002-649b-4625-b56d-5ee3b432302d None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:07.421438 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c4c002-649b-4625-b56d-5ee3b432302d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:07.497559 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-98c4c002-649b-4625-b56d-5ee3b432302d None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:15:07.498796 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-98c4c002-649b-4625-b56d-5ee3b432302d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:15:07.547467 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:07.602002 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 731/1483] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 00:15:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:15:07.891912 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484f7395-d1ca-4975-a739-7637e5992c54 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:07.893503 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-484f7395-d1ca-4975-a739-7637e5992c54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:15:07.917663 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:07.999144 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484f7395-d1ca-4975-a739-7637e5992c54 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:08.075131 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b6f575-fd7f-40b3-ae7e-7afde6b9c413 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'daae792cd11d4c4ca7aae0558998aced', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:08.075741 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b6f575-fd7f-40b3-ae7e-7afde6b9c413 service neutron] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:08.076026 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b6f575-fd7f-40b3-ae7e-7afde6b9c413 service neutron] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:08.076346 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b6f575-fd7f-40b3-ae7e-7afde6b9c413 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:08.078542 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-b7b6f575-fd7f-40b3-ae7e-7afde6b9c413 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:15:08.154980 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:08.192227 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b6f575-fd7f-40b3-ae7e-7afde6b9c413 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:08.193675 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b6f575-fd7f-40b3-ae7e-7afde6b9c413 service neutron] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:08.215892 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 753/1484] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:15:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 00:15:10.184827 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e7be02-2bbb-4eb0-8969-fc69857a0401 None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:10.185390 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e7be02-2bbb-4eb0-8969-fc69857a0401 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:10.185390 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e7be02-2bbb-4eb0-8969-fc69857a0401 None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:10.186709 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 732/1485] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 00:15:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:15:10.192750 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd05ea12-53c8-4b79-90f2-b273d2e060ca None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:10.193156 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd05ea12-53c8-4b79-90f2-b273d2e060ca None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:10.193335 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd05ea12-53c8-4b79-90f2-b273d2e060ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:10.267756 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-dd05ea12-53c8-4b79-90f2-b273d2e060ca None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:15:10.268917 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-dd05ea12-53c8-4b79-90f2-b273d2e060ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:15:10.366633 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 754/1486] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 00:15:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:15:10.660911 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e7be02-2bbb-4eb0-8969-fc69857a0401 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:10.662491 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-d1e7be02-2bbb-4eb0-8969-fc69857a0401 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:15:10.777553 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e7be02-2bbb-4eb0-8969-fc69857a0401 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:10.849806 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:10.851570 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5895eea7-7b60-4801-b42c-1f7727cdcb5c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'daae792cd11d4c4ca7aae0558998aced', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:10.852200 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5895eea7-7b60-4801-b42c-1f7727cdcb5c service neutron] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:10.852662 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5895eea7-7b60-4801-b42c-1f7727cdcb5c service neutron] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:10.853152 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5895eea7-7b60-4801-b42c-1f7727cdcb5c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:10.854931 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-5895eea7-7b60-4801-b42c-1f7727cdcb5c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:15:10.966545 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5895eea7-7b60-4801-b42c-1f7727cdcb5c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:10.967895 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5895eea7-7b60-4801-b42c-1f7727cdcb5c service neutron] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:10.987068 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 733/1487] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:15:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:15:13.132350 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c2e895-6259-459d-806d-c1e352ef1b5c None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:13.132941 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c2e895-6259-459d-806d-c1e352ef1b5c None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:13.132941 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c2e895-6259-459d-806d-c1e352ef1b5c None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:13.134250 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 755/1488] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 00:15:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:15:13.139672 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89807e94-e573-4ebb-899e-aa254a41d167 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:13.140762 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89807e94-e573-4ebb-899e-aa254a41d167 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:13.140879 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89807e94-e573-4ebb-899e-aa254a41d167 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:13.334821 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-89807e94-e573-4ebb-899e-aa254a41d167 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:15:13.335973 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-89807e94-e573-4ebb-899e-aa254a41d167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:15:13.392449 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:13.435782 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 734/1489] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 00:15:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:15:13.735219 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c2e895-6259-459d-806d-c1e352ef1b5c None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:13.736824 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-b1c2e895-6259-459d-806d-c1e352ef1b5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:15:13.773973 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:13.869902 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c2e895-6259-459d-806d-c1e352ef1b5c None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:13.950936 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6515e356-8c0f-478d-bd4e-67c9d76b4a0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'daae792cd11d4c4ca7aae0558998aced', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:13.951685 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6515e356-8c0f-478d-bd4e-67c9d76b4a0c service neutron] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:13.951970 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6515e356-8c0f-478d-bd4e-67c9d76b4a0c service neutron] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:13.952338 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6515e356-8c0f-478d-bd4e-67c9d76b4a0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:13.954036 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-6515e356-8c0f-478d-bd4e-67c9d76b4a0c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:15:14.044953 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:14.079279 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6515e356-8c0f-478d-bd4e-67c9d76b4a0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:14.080777 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6515e356-8c0f-478d-bd4e-67c9d76b4a0c service neutron] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:14.100529 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 756/1490] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:15:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:15:16.336405 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b1aa1f-1ca5-48f0-8584-143d87684375 None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:16.336940 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b1aa1f-1ca5-48f0-8584-143d87684375 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:16.336940 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b1aa1f-1ca5-48f0-8584-143d87684375 None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:16.338211 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 735/1491] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 00:15:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:15:16.344238 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8a5127-bf61-4e6d-a76b-10389b451978 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:16.344693 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8a5127-bf61-4e6d-a76b-10389b451978 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:16.344801 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8a5127-bf61-4e6d-a76b-10389b451978 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:16.413272 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-ed8a5127-bf61-4e6d-a76b-10389b451978 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:15:16.414477 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-ed8a5127-bf61-4e6d-a76b-10389b451978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:15:16.515396 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 757/1492] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 00:15:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:15:16.805444 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b1aa1f-1ca5-48f0-8584-143d87684375 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:16.806993 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-22b1aa1f-1ca5-48f0-8584-143d87684375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:15:16.914605 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b1aa1f-1ca5-48f0-8584-143d87684375 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:17.011127 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d8ae90-3ae0-442c-a589-59b75b7b011f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'daae792cd11d4c4ca7aae0558998aced', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:17.011740 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d8ae90-3ae0-442c-a589-59b75b7b011f service neutron] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:17.012020 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d8ae90-3ae0-442c-a589-59b75b7b011f service neutron] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:17.012336 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d8ae90-3ae0-442c-a589-59b75b7b011f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:17.013963 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-e5d8ae90-3ae0-442c-a589-59b75b7b011f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:15:17.023349 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:17.128648 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d8ae90-3ae0-442c-a589-59b75b7b011f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:17.130010 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d8ae90-3ae0-442c-a589-59b75b7b011f service neutron] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:17.148509 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 736/1493] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:15:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:15:26.513300 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=82 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:27.146135 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=50 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:31.477945 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1488d3-8f2d-40b9-8ce1-85fd927dd99d None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:31.477945 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1488d3-8f2d-40b9-8ce1-85fd927dd99d None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:31.477945 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1488d3-8f2d-40b9-8ce1-85fd927dd99d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:31.557700 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-5b1488d3-8f2d-40b9-8ce1-85fd927dd99d None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:16:31.558979 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-5b1488d3-8f2d-40b9-8ce1-85fd927dd99d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:31.660308 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 758/1494] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:16:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:16:31.668213 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970e56a3-897a-471f-a475-4e7c1fcbd517 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:31.668739 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970e56a3-897a-471f-a475-4e7c1fcbd517 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:31.668739 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970e56a3-897a-471f-a475-4e7c1fcbd517 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:31.746353 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-970e56a3-897a-471f-a475-4e7c1fcbd517 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:16:31.748198 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-970e56a3-897a-471f-a475-4e7c1fcbd517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:31.843981 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 737/1495] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:16:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:16:31.848629 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1488d3-8f2d-40b9-8ce1-85fd927dd99d None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:31.849912 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-5b1488d3-8f2d-40b9-8ce1-85fd927dd99d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:31.862138 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1488d3-8f2d-40b9-8ce1-85fd927dd99d None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:31.927387 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:31.968532 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bd7606-a5f5-4197-a5b2-eea656ee256e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:31.969141 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bd7606-a5f5-4197-a5b2-eea656ee256e admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:31.969443 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bd7606-a5f5-4197-a5b2-eea656ee256e admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:31.969710 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bd7606-a5f5-4197-a5b2-eea656ee256e admin admin] PATH_INFO: `/v3/domains` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:31.970352 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bd7606-a5f5-4197-a5b2-eea656ee256e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:16:31.970648 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bd7606-a5f5-4197-a5b2-eea656ee256e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:31.971660 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: WARNING py.warnings [None req-77bd7606-a5f5-4197-a5b2-eea656ee256e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 31 00:16:31.971660 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: warnings.warn(msg) Aug 31 00:16:31.971660 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: Aug 31 00:16:31.972575 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bd7606-a5f5-4197-a5b2-eea656ee256e admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:31.986458 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 759/1496] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 31 00:16:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:16:31.993873 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970e56a3-897a-471f-a475-4e7c1fcbd517 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:32.003933 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970e56a3-897a-471f-a475-4e7c1fcbd517 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:32.069202 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:32.103918 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4b68b3-aeea-448a-a19f-38f98e245c71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:32.104558 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4b68b3-aeea-448a-a19f-38f98e245c71 admin admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:32.104835 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4b68b3-aeea-448a-a19f-38f98e245c71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:32.105104 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4b68b3-aeea-448a-a19f-38f98e245c71 admin admin] PATH_INFO: `/v3/projects` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:32.105740 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4b68b3-aeea-448a-a19f-38f98e245c71 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:32.107619 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: WARNING py.warnings [None req-1a4b68b3-aeea-448a-a19f-38f98e245c71 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 00:16:32.107619 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: warnings.warn(msg) Aug 31 00:16:32.107619 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: Aug 31 00:16:32.108840 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4b68b3-aeea-448a-a19f-38f98e245c71 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:32.166497 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 738/1497] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 31 00:16:31 2022] POST /identity/v3/projects => generated 377 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:16:32.171086 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bd7606-a5f5-4197-a5b2-eea656ee256e admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:32.172656 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-77bd7606-a5f5-4197-a5b2-eea656ee256e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:32.207330 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bd7606-a5f5-4197-a5b2-eea656ee256e admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:32.304226 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71601116-9740-4f34-baa0-67b596974f74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:32.304975 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71601116-9740-4f34-baa0-67b596974f74 admin admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:32.305695 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71601116-9740-4f34-baa0-67b596974f74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:32.305695 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71601116-9740-4f34-baa0-67b596974f74 admin admin] PATH_INFO: `/v3/users` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:32.305913 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71601116-9740-4f34-baa0-67b596974f74 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:32.306880 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: WARNING py.warnings [None req-71601116-9740-4f34-baa0-67b596974f74 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 00:16:32.306880 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: warnings.warn(msg) Aug 31 00:16:32.306880 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: Aug 31 00:16:32.308100 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71601116-9740-4f34-baa0-67b596974f74 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:32.351677 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 760/1498] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 31 00:16:32 2022] POST /identity/v3/users => generated 289 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:16:32.356130 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4b68b3-aeea-448a-a19f-38f98e245c71 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:32.357689 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-1a4b68b3-aeea-448a-a19f-38f98e245c71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:32.423150 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4b68b3-aeea-448a-a19f-38f98e245c71 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:32.513632 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:32.526175 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee52d978-ff2a-41a6-af9a-61e374cf9db3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:32.526778 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee52d978-ff2a-41a6-af9a-61e374cf9db3 admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:32.527050 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee52d978-ff2a-41a6-af9a-61e374cf9db3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:32.527315 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee52d978-ff2a-41a6-af9a-61e374cf9db3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:32.527947 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee52d978-ff2a-41a6-af9a-61e374cf9db3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:32.529843 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: WARNING py.warnings [None req-ee52d978-ff2a-41a6-af9a-61e374cf9db3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 31 00:16:32.529843 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: warnings.warn(msg) Aug 31 00:16:32.529843 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: Aug 31 00:16:32.530746 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee52d978-ff2a-41a6-af9a-61e374cf9db3 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:32.543635 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 739/1499] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 00:16:32 2022] GET /identity/v3/roles => generated 1420 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:16:32.547916 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71601116-9740-4f34-baa0-67b596974f74 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:32.549466 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-71601116-9740-4f34-baa0-67b596974f74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:32.561305 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71601116-9740-4f34-baa0-67b596974f74 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:32.587231 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:32.659552 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0308099-b8f6-4361-ba33-d8d0c9fdebdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:32.660178 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0308099-b8f6-4361-ba33-d8d0c9fdebdd admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:32.660479 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0308099-b8f6-4361-ba33-d8d0c9fdebdd admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:32.660753 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0308099-b8f6-4361-ba33-d8d0c9fdebdd admin admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:32.661401 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0308099-b8f6-4361-ba33-d8d0c9fdebdd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:32.662407 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: WARNING py.warnings [None req-b0308099-b8f6-4361-ba33-d8d0c9fdebdd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 31 00:16:32.662407 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: warnings.warn(msg) Aug 31 00:16:32.662407 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: Aug 31 00:16:32.663298 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0308099-b8f6-4361-ba33-d8d0c9fdebdd admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:32.676645 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 761/1500] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 00:16:32 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:16:32.680847 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee52d978-ff2a-41a6-af9a-61e374cf9db3 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:32.682386 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-ee52d978-ff2a-41a6-af9a-61e374cf9db3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:32.717720 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee52d978-ff2a-41a6-af9a-61e374cf9db3 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:32.813008 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44e3518-19da-4ee7-9095-47945cb1c06e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:32.813579 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44e3518-19da-4ee7-9095-47945cb1c06e admin admin] REQUEST_METHOD: `PUT` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:32.813852 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44e3518-19da-4ee7-9095-47945cb1c06e admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:32.814119 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44e3518-19da-4ee7-9095-47945cb1c06e admin admin] PATH_INFO: `/v3/projects/f2c2a34f639a4edb80f3a493cb65a2b6/users/5ece256a835d44718aec2480b866b6c7/roles/fdad79ffbcbb4fa380dc9cf7dd108618` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:32.836021 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44e3518-19da-4ee7-9095-47945cb1c06e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2c2a34f639a4edb80f3a493cb65a2b6, user_id=5ece256a835d44718aec2480b866b6c7, role_id=fdad79ffbcbb4fa380dc9cf7dd108618)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:32.837085 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: WARNING py.warnings [None req-f44e3518-19da-4ee7-9095-47945cb1c06e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 00:16:32.837085 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: warnings.warn(msg) Aug 31 00:16:32.837085 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: Aug 31 00:16:32.839029 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44e3518-19da-4ee7-9095-47945cb1c06e admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:32.865331 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 740/1501] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 00:16:32 2022] PUT /identity/v3/projects/f2c2a34f639a4edb80f3a493cb65a2b6/users/5ece256a835d44718aec2480b866b6c7/roles/fdad79ffbcbb4fa380dc9cf7dd108618 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:16:32.877983 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be35233e-9667-4eae-8c93-44a9a5d8947e None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:32.878289 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be35233e-9667-4eae-8c93-44a9a5d8947e None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:32.878550 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be35233e-9667-4eae-8c93-44a9a5d8947e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:32.939664 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-be35233e-9667-4eae-8c93-44a9a5d8947e None None] MFA Rules not processed for user `5ece256a835d44718aec2480b866b6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:16:32.940919 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-be35233e-9667-4eae-8c93-44a9a5d8947e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:33.025019 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 762/1502] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:16:32 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:16:33.039460 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fa902f-3cee-4152-8b41-32c760a7b1d9 None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:33.039762 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fa902f-3cee-4152-8b41-32c760a7b1d9 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:33.040015 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fa902f-3cee-4152-8b41-32c760a7b1d9 None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:33.041407 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 741/1503] 10.222.0.47 () {54 vars in 964 bytes} [Wed Aug 31 00:16:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:16:33.047058 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08185219-deb1-47b0-865e-3b09a2c87d17 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:33.047332 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08185219-deb1-47b0-865e-3b09a2c87d17 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:33.047610 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08185219-deb1-47b0-865e-3b09a2c87d17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:33.081317 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:33.129026 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-08185219-deb1-47b0-865e-3b09a2c87d17 None None] MFA Rules not processed for user `beecda6e9feb400288618745c784989f`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:16:33.130229 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-08185219-deb1-47b0-865e-3b09a2c87d17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:33.207029 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 763/1504] 10.222.0.47 () {58 vars in 1061 bytes} [Wed Aug 31 00:16:33 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:16:33.214875 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fa902f-3cee-4152-8b41-32c760a7b1d9 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:33.217437 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-f7fa902f-3cee-4152-8b41-32c760a7b1d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:33.267505 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:33.322794 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fa902f-3cee-4152-8b41-32c760a7b1d9 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:33.399389 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d89673-3c8c-44a1-8e16-f9db61419369 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beecda6e9feb400288618745c784989f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:33.400139 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d89673-3c8c-44a1-8e16-f9db61419369 service cinder] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:33.400445 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d89673-3c8c-44a1-8e16-f9db61419369 service cinder] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:33.400739 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d89673-3c8c-44a1-8e16-f9db61419369 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:33.402336 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-86d89673-3c8c-44a1-8e16-f9db61419369 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:33.513608 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d89673-3c8c-44a1-8e16-f9db61419369 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:33.515080 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d89673-3c8c-44a1-8e16-f9db61419369 service cinder] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:33.518638 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:33.534642 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 742/1505] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:16:33 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 00:16:33.581340 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d271be5-57e7-42be-9844-21be5ea71b31 None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:33.581811 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d271be5-57e7-42be-9844-21be5ea71b31 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:33.581923 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d271be5-57e7-42be-9844-21be5ea71b31 None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:33.583284 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 764/1506] 10.222.0.47 () {52 vars in 830 bytes} [Wed Aug 31 00:16:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:16:33.586872 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d89673-3c8c-44a1-8e16-f9db61419369 service cinder] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:33.588136 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-86d89673-3c8c-44a1-8e16-f9db61419369 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:33.690527 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d89673-3c8c-44a1-8e16-f9db61419369 service cinder] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:33.786739 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f82ecf8-c10a-49ac-a7c3-36353e745d9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:33.787376 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f82ecf8-c10a-49ac-a7c3-36353e745d9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:33.787651 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f82ecf8-c10a-49ac-a7c3-36353e745d9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:33.787923 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f82ecf8-c10a-49ac-a7c3-36353e745d9d admin admin] PATH_INFO: `/v3/users/5ece256a835d44718aec2480b866b6c7` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:33.801161 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f82ecf8-c10a-49ac-a7c3-36353e745d9d admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ece256a835d44718aec2480b866b6c7)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:33.802198 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: WARNING py.warnings [None req-2f82ecf8-c10a-49ac-a7c3-36353e745d9d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 00:16:33.802198 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: warnings.warn(msg) Aug 31 00:16:33.802198 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: Aug 31 00:16:33.803424 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f82ecf8-c10a-49ac-a7c3-36353e745d9d admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:33.813866 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:33.873503 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-2f82ecf8-c10a-49ac-a7c3-36353e745d9d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ece256a835d44718aec2480b866b6c7'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:33.888618 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-2f82ecf8-c10a-49ac-a7c3-36353e745d9d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ece256a835d44718aec2480b866b6c7'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:33.898578 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-2f82ecf8-c10a-49ac-a7c3-36353e745d9d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ece256a835d44718aec2480b866b6c7'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:33.924989 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-2f82ecf8-c10a-49ac-a7c3-36353e745d9d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ece256a835d44718aec2480b866b6c7'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:33.925596 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-2f82ecf8-c10a-49ac-a7c3-36353e745d9d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ece256a835d44718aec2480b866b6c7'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:33.931534 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 743/1507] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 31 00:16:33 2022] DELETE /identity/v3/users/5ece256a835d44718aec2480b866b6c7 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:16:33.936542 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34ae37e-a93d-4025-bd66-bf20115b6b39 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:33.936876 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34ae37e-a93d-4025-bd66-bf20115b6b39 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:33.937195 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34ae37e-a93d-4025-bd66-bf20115b6b39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:33.999655 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-d34ae37e-a93d-4025-bd66-bf20115b6b39 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:16:34.000914 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-d34ae37e-a93d-4025-bd66-bf20115b6b39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:34.082549 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:34.096887 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 765/1508] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:16:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:16:34.106473 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f82ecf8-c10a-49ac-a7c3-36353e745d9d admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:34.107977 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-2f82ecf8-c10a-49ac-a7c3-36353e745d9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:34.209330 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f82ecf8-c10a-49ac-a7c3-36353e745d9d admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:34.265625 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:34.288626 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020434cf-715f-41dc-8a45-306dff49b20f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'daae792cd11d4c4ca7aae0558998aced', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:34.289541 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020434cf-715f-41dc-8a45-306dff49b20f service neutron] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:34.290186 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020434cf-715f-41dc-8a45-306dff49b20f service neutron] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:34.290798 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020434cf-715f-41dc-8a45-306dff49b20f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:34.292463 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-020434cf-715f-41dc-8a45-306dff49b20f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:34.405288 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020434cf-715f-41dc-8a45-306dff49b20f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:34.406882 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020434cf-715f-41dc-8a45-306dff49b20f service neutron] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:34.429657 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 744/1509] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:16:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:16:34.811170 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34ae37e-a93d-4025-bd66-bf20115b6b39 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:34.812503 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-d34ae37e-a93d-4025-bd66-bf20115b6b39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:34.824274 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34ae37e-a93d-4025-bd66-bf20115b6b39 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:34.930829 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f18774-1cda-4364-be44-707ebd868d46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:34.931378 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f18774-1cda-4364-be44-707ebd868d46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:34.931656 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f18774-1cda-4364-be44-707ebd868d46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:34.931932 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f18774-1cda-4364-be44-707ebd868d46 admin admin] PATH_INFO: `/v3/projects/f2c2a34f639a4edb80f3a493cb65a2b6` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:34.943810 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f18774-1cda-4364-be44-707ebd868d46 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2c2a34f639a4edb80f3a493cb65a2b6)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:34.944905 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: WARNING py.warnings [None req-03f18774-1cda-4364-be44-707ebd868d46 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 00:16:34.944905 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: warnings.warn(msg) Aug 31 00:16:34.944905 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: Aug 31 00:16:34.946145 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f18774-1cda-4364-be44-707ebd868d46 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:35.015180 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-03f18774-1cda-4364-be44-707ebd868d46 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2c2a34f639a4edb80f3a493cb65a2b6', 'request_id': 'req-03f18774-1cda-4364-be44-707ebd868d46'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:35.029024 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-03f18774-1cda-4364-be44-707ebd868d46 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2c2a34f639a4edb80f3a493cb65a2b6', 'request_id': 'req-03f18774-1cda-4364-be44-707ebd868d46'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:35.035349 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-03f18774-1cda-4364-be44-707ebd868d46 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2c2a34f639a4edb80f3a493cb65a2b6', 'request_id': 'req-03f18774-1cda-4364-be44-707ebd868d46'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:35.064214 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-03f18774-1cda-4364-be44-707ebd868d46 admin admin] The token cache is being invalidate because project f2c2a34f639a4edb80f3a493cb65a2b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:16:35.064507 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-03f18774-1cda-4364-be44-707ebd868d46 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:35.064958 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-03f18774-1cda-4364-be44-707ebd868d46 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:16:35.066391 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 766/1510] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 31 00:16:34 2022] DELETE /identity/v3/projects/f2c2a34f639a4edb80f3a493cb65a2b6 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:16:44.427251 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=62 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:45.062076 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:18:04.514318 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5be420-2db5-4884-bcaa-e28e77619720 None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:18:04.514318 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5be420-2db5-4884-bcaa-e28e77619720 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:18:04.514318 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5be420-2db5-4884-bcaa-e28e77619720 None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:18:04.516852 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 745/1511] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 00:18:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:18:04.523740 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2517d7e3-76a9-4bc6-af6c-bc5f9ce03852 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:18:04.524442 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2517d7e3-76a9-4bc6-af6c-bc5f9ce03852 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:18:04.524442 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2517d7e3-76a9-4bc6-af6c-bc5f9ce03852 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:18:04.633675 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-2517d7e3-76a9-4bc6-af6c-bc5f9ce03852 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:18:04.635035 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-2517d7e3-76a9-4bc6-af6c-bc5f9ce03852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:18:04.788923 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 767/1512] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 00:18:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:18:04.960028 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5be420-2db5-4884-bcaa-e28e77619720 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:18:04.962662 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-2b5be420-2db5-4884-bcaa-e28e77619720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:18:05.114855 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5be420-2db5-4884-bcaa-e28e77619720 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:18:05.121051 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5b9481-aa15-40ae-932e-a7d5ddea4215 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea002bf49c248dbae7147665fa10fd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:18:05.121691 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5b9481-aa15-40ae-932e-a7d5ddea4215 service nova] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:18:05.121967 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5b9481-aa15-40ae-932e-a7d5ddea4215 service nova] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:18:05.122257 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5b9481-aa15-40ae-932e-a7d5ddea4215 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:18:05.132186 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5b9481-aa15-40ae-932e-a7d5ddea4215 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:18:05.133807 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5b9481-aa15-40ae-932e-a7d5ddea4215 service nova] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:18:05.145459 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 746/1513] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:18:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:18:06.064623 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aa40ea-1e0c-45c6-b0a1-02a2760f42f0 None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:18:06.065231 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aa40ea-1e0c-45c6-b0a1-02a2760f42f0 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:18:06.065231 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aa40ea-1e0c-45c6-b0a1-02a2760f42f0 None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:18:06.066553 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 768/1514] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 00:18:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 00:18:06.072952 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6306e7e2-07e4-4f25-93df-d5c96d89710b None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:18:06.073595 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6306e7e2-07e4-4f25-93df-d5c96d89710b None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:18:06.073595 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6306e7e2-07e4-4f25-93df-d5c96d89710b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:18:06.096003 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-6306e7e2-07e4-4f25-93df-d5c96d89710b None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:18:06.097352 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-6306e7e2-07e4-4f25-93df-d5c96d89710b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:18:06.106227 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 747/1515] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 00:18:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:18:06.266733 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94aa40ea-1e0c-45c6-b0a1-02a2760f42f0 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:18:06.282797 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94aa40ea-1e0c-45c6-b0a1-02a2760f42f0 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:18:06.288612 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ffb1b1-28c7-40ac-96ad-760ffb461ea9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea002bf49c248dbae7147665fa10fd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:18:06.289242 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ffb1b1-28c7-40ac-96ad-760ffb461ea9 service nova] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:18:06.289522 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ffb1b1-28c7-40ac-96ad-760ffb461ea9 service nova] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:18:06.289815 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ffb1b1-28c7-40ac-96ad-760ffb461ea9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:18:06.299776 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ffb1b1-28c7-40ac-96ad-760ffb461ea9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:18:06.301447 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ffb1b1-28c7-40ac-96ad-760ffb461ea9 service nova] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:18:06.313315 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 769/1516] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:18:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:18:07.055637 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35aec0d-03bd-44b2-b050-b77c32d1c0c5 None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:18:07.056053 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35aec0d-03bd-44b2-b050-b77c32d1c0c5 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:18:07.056500 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35aec0d-03bd-44b2-b050-b77c32d1c0c5 None None] PATH_INFO: `/v3` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:18:07.058557 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 748/1517] 10.222.0.70 () {54 vars in 925 bytes} [Wed Aug 31 00:18:07 2022] GET /identity/v3 => generated 255 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:18:07.067688 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591af49e-0086-43c9-89c4-ddf219ad3393 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:18:07.068410 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591af49e-0086-43c9-89c4-ddf219ad3393 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:18:07.068410 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591af49e-0086-43c9-89c4-ddf219ad3393 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:18:07.183470 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-591af49e-0086-43c9-89c4-ddf219ad3393 None None] MFA Rules not processed for user `8f76e01e32264ff7a6a7740ffa0a207d`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:18:07.185632 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-591af49e-0086-43c9-89c4-ddf219ad3393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:18:07.218736 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:18:07.322441 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 770/1518] 10.222.0.70 () {58 vars in 1015 bytes} [Wed Aug 31 00:18:07 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:18:16.090198 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=56 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:18:16.820320 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36527f3-6582-4e36-b3b3-348ac776d177 None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:18:16.820753 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36527f3-6582-4e36-b3b3-348ac776d177 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:18:16.821288 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36527f3-6582-4e36-b3b3-348ac776d177 None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:18:16.824349 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 749/1519] 10.222.0.47 () {54 vars in 961 bytes} [Wed Aug 31 00:18:16 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:18:16.833408 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546de8a1-ef0f-4053-9987-f34de0cf6b76 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:18:16.834073 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546de8a1-ef0f-4053-9987-f34de0cf6b76 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:18:16.834309 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546de8a1-ef0f-4053-9987-f34de0cf6b76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:18:16.863608 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-546de8a1-ef0f-4053-9987-f34de0cf6b76 None None] MFA Rules not processed for user `8f76e01e32264ff7a6a7740ffa0a207d`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:18:16.865058 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-546de8a1-ef0f-4053-9987-f34de0cf6b76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:18:16.879433 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 771/1520] 10.222.0.47 () {58 vars in 1058 bytes} [Wed Aug 31 00:18:16 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:18:16.889012 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36527f3-6582-4e36-b3b3-348ac776d177 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:18:16.908623 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36527f3-6582-4e36-b3b3-348ac776d177 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:18:16.914520 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1a07a8-44dc-4816-9a65-fa1785863a8a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f76e01e32264ff7a6a7740ffa0a207d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:18:16.915319 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1a07a8-44dc-4816-9a65-fa1785863a8a service placement] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:18:16.916423 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1a07a8-44dc-4816-9a65-fa1785863a8a service placement] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:18:16.917472 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1a07a8-44dc-4816-9a65-fa1785863a8a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:18:16.928326 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1a07a8-44dc-4816-9a65-fa1785863a8a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:18:16.930631 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1a07a8-44dc-4816-9a65-fa1785863a8a service placement] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:18:16.944013 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 750/1521] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:18:16 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:18:17.703915 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cef41b-f57e-4c1b-a81d-4adf5b90aea6 None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:18:17.704468 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cef41b-f57e-4c1b-a81d-4adf5b90aea6 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:18:17.704945 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cef41b-f57e-4c1b-a81d-4adf5b90aea6 None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:18:17.707687 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 772/1522] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 00:18:17 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:18:17.714019 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6af549-23ea-44e5-b8cc-e38944ff381f None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:18:17.714639 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6af549-23ea-44e5-b8cc-e38944ff381f None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:18:17.714639 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6af549-23ea-44e5-b8cc-e38944ff381f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:18:17.737875 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-da6af549-23ea-44e5-b8cc-e38944ff381f None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:18:17.739168 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-da6af549-23ea-44e5-b8cc-e38944ff381f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:18:17.748523 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 751/1523] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 00:18:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:18:17.920030 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cef41b-f57e-4c1b-a81d-4adf5b90aea6 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:18:17.936461 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cef41b-f57e-4c1b-a81d-4adf5b90aea6 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:18:17.942195 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6785ab-26d5-48a6-bc8f-d4bbf3f64584 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea002bf49c248dbae7147665fa10fd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:18:17.942833 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6785ab-26d5-48a6-bc8f-d4bbf3f64584 service nova] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:18:17.943119 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6785ab-26d5-48a6-bc8f-d4bbf3f64584 service nova] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:18:17.943392 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6785ab-26d5-48a6-bc8f-d4bbf3f64584 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:18:17.954049 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6785ab-26d5-48a6-bc8f-d4bbf3f64584 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:18:17.955742 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6785ab-26d5-48a6-bc8f-d4bbf3f64584 service nova] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:18:17.967968 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 773/1524] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:18:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 00:18:18.924867 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819a04b8-b42e-40f1-81ed-9376fada69cb None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:18:18.925495 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819a04b8-b42e-40f1-81ed-9376fada69cb None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:18:18.925851 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819a04b8-b42e-40f1-81ed-9376fada69cb None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:18:18.927331 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 752/1525] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 00:18:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:18:18.933799 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a15b8b-f0b4-462c-b57a-cc40d9ad6796 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:18:18.934493 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a15b8b-f0b4-462c-b57a-cc40d9ad6796 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:18:18.934493 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a15b8b-f0b4-462c-b57a-cc40d9ad6796 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:18:18.956662 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-41a15b8b-f0b4-462c-b57a-cc40d9ad6796 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:18:18.957939 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-41a15b8b-f0b4-462c-b57a-cc40d9ad6796 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:18:18.967260 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 774/1526] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 00:18:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:18:19.131037 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819a04b8-b42e-40f1-81ed-9376fada69cb None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:18:19.146550 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819a04b8-b42e-40f1-81ed-9376fada69cb None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:18:19.152978 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f8b604-ae96-45f2-bcc5-07fd9b7b1d93 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea002bf49c248dbae7147665fa10fd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:18:19.153654 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f8b604-ae96-45f2-bcc5-07fd9b7b1d93 service nova] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:18:19.154006 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f8b604-ae96-45f2-bcc5-07fd9b7b1d93 service nova] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:18:19.154336 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f8b604-ae96-45f2-bcc5-07fd9b7b1d93 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:18:19.164042 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f8b604-ae96-45f2-bcc5-07fd9b7b1d93 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:18:19.166417 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f8b604-ae96-45f2-bcc5-07fd9b7b1d93 service nova] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:18:19.178556 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 753/1527] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:18:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:18:23.825375 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0c8d45-d6f3-4081-82ab-dff356cbd2eb None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:18:23.826015 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0c8d45-d6f3-4081-82ab-dff356cbd2eb None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:18:23.826015 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0c8d45-d6f3-4081-82ab-dff356cbd2eb None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:18:23.827745 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 775/1528] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 00:18:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:18:23.834860 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ca89b2-c936-451b-b7d9-93ebfceaf73b None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:18:23.835469 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ca89b2-c936-451b-b7d9-93ebfceaf73b None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:18:23.835851 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ca89b2-c936-451b-b7d9-93ebfceaf73b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:18:23.869850 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-74ca89b2-c936-451b-b7d9-93ebfceaf73b None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:18:23.872449 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-74ca89b2-c936-451b-b7d9-93ebfceaf73b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:18:23.886562 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 754/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 00:18:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:18:24.187618 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0c8d45-d6f3-4081-82ab-dff356cbd2eb None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:18:24.189544 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-4a0c8d45-d6f3-4081-82ab-dff356cbd2eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:18:24.311362 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0c8d45-d6f3-4081-82ab-dff356cbd2eb None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:18:24.315537 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b73029-b6ca-435c-b755-46131a7b0de0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'daae792cd11d4c4ca7aae0558998aced', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:18:24.316304 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b73029-b6ca-435c-b755-46131a7b0de0 service neutron] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:18:24.316640 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b73029-b6ca-435c-b755-46131a7b0de0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:18:24.316960 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b73029-b6ca-435c-b755-46131a7b0de0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:18:24.328093 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b73029-b6ca-435c-b755-46131a7b0de0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:18:24.329795 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b73029-b6ca-435c-b755-46131a7b0de0 service neutron] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:18:24.341934 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 776/1530] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:18:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 00:18:26.500563 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f694a5-af8e-4480-8e23-2dfbc9cd0e99 None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:18:26.501372 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f694a5-af8e-4480-8e23-2dfbc9cd0e99 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:18:26.501372 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f694a5-af8e-4480-8e23-2dfbc9cd0e99 None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:18:26.502539 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 755/1531] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 00:18:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 00:18:26.508898 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c3cbe4-f82e-4b39-bf8b-76b4afecd880 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:18:26.510264 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c3cbe4-f82e-4b39-bf8b-76b4afecd880 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:18:26.510264 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c3cbe4-f82e-4b39-bf8b-76b4afecd880 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:18:26.536988 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-c4c3cbe4-f82e-4b39-bf8b-76b4afecd880 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:18:26.539133 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-c4c3cbe4-f82e-4b39-bf8b-76b4afecd880 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:18:26.552203 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 777/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 00:18:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:18:26.856589 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f694a5-af8e-4480-8e23-2dfbc9cd0e99 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:18:26.869003 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f694a5-af8e-4480-8e23-2dfbc9cd0e99 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:18:26.873337 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc092a3-1e42-4890-84dd-4c4ab9a32c7e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'daae792cd11d4c4ca7aae0558998aced', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:18:26.873962 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc092a3-1e42-4890-84dd-4c4ab9a32c7e service neutron] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:18:26.874240 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc092a3-1e42-4890-84dd-4c4ab9a32c7e service neutron] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:18:26.874510 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc092a3-1e42-4890-84dd-4c4ab9a32c7e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:18:26.885003 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc092a3-1e42-4890-84dd-4c4ab9a32c7e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:18:26.886557 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc092a3-1e42-4890-84dd-4c4ab9a32c7e service neutron] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:18:26.897303 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 756/1533] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:18:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 00:18:30.676876 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83192fd-5dcc-4205-94b9-19064523da4a None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:18:30.677759 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83192fd-5dcc-4205-94b9-19064523da4a None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:18:30.677759 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83192fd-5dcc-4205-94b9-19064523da4a None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:18:30.679349 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 778/1534] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 00:18:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 00:18:30.687917 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05700d3-d889-46e9-ae40-02ee326e3d99 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:18:30.688512 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05700d3-d889-46e9-ae40-02ee326e3d99 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:18:30.688955 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05700d3-d889-46e9-ae40-02ee326e3d99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:18:30.717717 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-f05700d3-d889-46e9-ae40-02ee326e3d99 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:18:30.719823 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-f05700d3-d889-46e9-ae40-02ee326e3d99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:18:30.733603 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 757/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 00:18:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:18:31.367714 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83192fd-5dcc-4205-94b9-19064523da4a None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:18:31.370940 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-e83192fd-5dcc-4205-94b9-19064523da4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:18:31.459217 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:18:31.479165 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83192fd-5dcc-4205-94b9-19064523da4a None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:18:31.485373 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4364c591-52eb-4ed3-99a8-3cae2609d023 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beecda6e9feb400288618745c784989f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:18:31.486420 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4364c591-52eb-4ed3-99a8-3cae2609d023 service cinder] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:18:31.486913 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4364c591-52eb-4ed3-99a8-3cae2609d023 service cinder] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:18:31.487392 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4364c591-52eb-4ed3-99a8-3cae2609d023 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:18:31.505797 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4364c591-52eb-4ed3-99a8-3cae2609d023 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:18:31.507756 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4364c591-52eb-4ed3-99a8-3cae2609d023 service cinder] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:18:31.519333 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 779/1536] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:18:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 00:18:33.714758 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5ff2ab-78ac-450d-a1dd-bce5dc63e6a8 None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:18:33.715439 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5ff2ab-78ac-450d-a1dd-bce5dc63e6a8 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:18:33.715439 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5ff2ab-78ac-450d-a1dd-bce5dc63e6a8 None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:18:33.716973 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 758/1537] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 00:18:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:18:33.726787 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb87c961-375c-411d-8648-2250313e45d9 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:18:33.727603 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb87c961-375c-411d-8648-2250313e45d9 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:18:33.727603 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb87c961-375c-411d-8648-2250313e45d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:18:33.750939 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-eb87c961-375c-411d-8648-2250313e45d9 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:18:33.752191 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-eb87c961-375c-411d-8648-2250313e45d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:18:33.761089 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 780/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 00:18:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:18:34.357819 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5ff2ab-78ac-450d-a1dd-bce5dc63e6a8 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:18:34.359693 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-ca5ff2ab-78ac-450d-a1dd-bce5dc63e6a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:18:34.373427 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5ff2ab-78ac-450d-a1dd-bce5dc63e6a8 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:18:34.377324 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb93ee5-54b4-43df-9f4f-ae06fb09b2c8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beecda6e9feb400288618745c784989f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:18:34.378084 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb93ee5-54b4-43df-9f4f-ae06fb09b2c8 service cinder] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:18:34.378362 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb93ee5-54b4-43df-9f4f-ae06fb09b2c8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:18:34.378631 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb93ee5-54b4-43df-9f4f-ae06fb09b2c8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:18:34.389167 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb93ee5-54b4-43df-9f4f-ae06fb09b2c8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:18:34.390640 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb93ee5-54b4-43df-9f4f-ae06fb09b2c8 service cinder] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:18:34.403001 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 759/1539] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:18:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 00:18:43.744987 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=11 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:18:44.397054 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=33 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:20:05.501846 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d28773-7604-4711-be94-8e4655e986c7 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:05.502937 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d28773-7604-4711-be94-8e4655e986c7 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:05.502937 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d28773-7604-4711-be94-8e4655e986c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:05.547468 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-76d28773-7604-4711-be94-8e4655e986c7 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:20:05.549560 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-76d28773-7604-4711-be94-8e4655e986c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:05.571744 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 781/1540] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:20:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:20:05.581175 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5928085f-97cd-4206-a4b0-06ba428e9daf None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:05.582045 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5928085f-97cd-4206-a4b0-06ba428e9daf None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:05.582045 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5928085f-97cd-4206-a4b0-06ba428e9daf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:05.612552 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-5928085f-97cd-4206-a4b0-06ba428e9daf None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:20:05.613839 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-5928085f-97cd-4206-a4b0-06ba428e9daf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:05.624917 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 760/1541] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:20:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:20:05.631046 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d28773-7604-4711-be94-8e4655e986c7 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:05.654898 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d28773-7604-4711-be94-8e4655e986c7 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:05.664763 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe04c044-ec78-4451-a253-550ecfaa862a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:05.665834 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe04c044-ec78-4451-a253-550ecfaa862a admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:05.666315 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe04c044-ec78-4451-a253-550ecfaa862a admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:05.666791 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe04c044-ec78-4451-a253-550ecfaa862a admin admin] PATH_INFO: `/v3/domains` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:05.668401 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe04c044-ec78-4451-a253-550ecfaa862a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:20:05.668812 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe04c044-ec78-4451-a253-550ecfaa862a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:05.671900 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe04c044-ec78-4451-a253-550ecfaa862a admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:05.703078 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 782/1542] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 31 00:20:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:20:05.711536 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5928085f-97cd-4206-a4b0-06ba428e9daf None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:05.728872 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5928085f-97cd-4206-a4b0-06ba428e9daf None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:05.738743 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ce2e10-1258-490c-9fcc-f5e5a8fed407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:05.739394 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ce2e10-1258-490c-9fcc-f5e5a8fed407 admin admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:05.739668 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ce2e10-1258-490c-9fcc-f5e5a8fed407 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:05.739937 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ce2e10-1258-490c-9fcc-f5e5a8fed407 admin admin] PATH_INFO: `/v3/projects` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:05.740646 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ce2e10-1258-490c-9fcc-f5e5a8fed407 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:05.744141 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ce2e10-1258-490c-9fcc-f5e5a8fed407 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:05.824310 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 761/1543] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 31 00:20:05 2022] POST /identity/v3/projects => generated 375 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:20:05.829566 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe04c044-ec78-4451-a253-550ecfaa862a admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:05.854875 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe04c044-ec78-4451-a253-550ecfaa862a admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:05.973384 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e269ace-e4b4-4446-9cf9-6fa0a781c122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:05.974044 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e269ace-e4b4-4446-9cf9-6fa0a781c122 admin admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:05.974328 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e269ace-e4b4-4446-9cf9-6fa0a781c122 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:05.974588 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e269ace-e4b4-4446-9cf9-6fa0a781c122 admin admin] PATH_INFO: `/v3/users` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:05.976265 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e269ace-e4b4-4446-9cf9-6fa0a781c122 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:05.978395 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e269ace-e4b4-4446-9cf9-6fa0a781c122 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:06.034913 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 783/1544] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 31 00:20:05 2022] POST /identity/v3/users => generated 288 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:20:06.039859 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ce2e10-1258-490c-9fcc-f5e5a8fed407 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:06.054983 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ce2e10-1258-490c-9fcc-f5e5a8fed407 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:06.066308 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1fa6d2-41d5-45c7-bd5a-c28e0623aa28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:06.066972 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1fa6d2-41d5-45c7-bd5a-c28e0623aa28 admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:06.067251 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1fa6d2-41d5-45c7-bd5a-c28e0623aa28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:06.067606 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1fa6d2-41d5-45c7-bd5a-c28e0623aa28 admin admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:06.068315 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1fa6d2-41d5-45c7-bd5a-c28e0623aa28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:06.071006 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1fa6d2-41d5-45c7-bd5a-c28e0623aa28 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:06.088241 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 762/1545] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 00:20:06 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:20:06.093564 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e269ace-e4b4-4446-9cf9-6fa0a781c122 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:06.117521 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e269ace-e4b4-4446-9cf9-6fa0a781c122 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:06.126492 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ad145a-8092-43f1-a4d1-a5164630f0c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:06.127545 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ad145a-8092-43f1-a4d1-a5164630f0c6 admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:06.128035 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ad145a-8092-43f1-a4d1-a5164630f0c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:06.128568 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ad145a-8092-43f1-a4d1-a5164630f0c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:06.129712 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ad145a-8092-43f1-a4d1-a5164630f0c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:06.133703 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ad145a-8092-43f1-a4d1-a5164630f0c6 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:06.161934 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 784/1546] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 00:20:06 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:20:06.169319 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1fa6d2-41d5-45c7-bd5a-c28e0623aa28 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:06.190225 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1fa6d2-41d5-45c7-bd5a-c28e0623aa28 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:06.202252 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b451f4-9ff7-48a1-829e-b7d869acbfc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:06.203416 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b451f4-9ff7-48a1-829e-b7d869acbfc8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:06.203898 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b451f4-9ff7-48a1-829e-b7d869acbfc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:06.204426 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b451f4-9ff7-48a1-829e-b7d869acbfc8 admin admin] PATH_INFO: `/v3/projects/5d71e648b9ff42fb8b29beabe01a5512/users/bc018a253e0a4b0bb96097ce4cc72c21/roles/fdad79ffbcbb4fa380dc9cf7dd108618` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:06.244216 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b451f4-9ff7-48a1-829e-b7d869acbfc8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d71e648b9ff42fb8b29beabe01a5512, user_id=bc018a253e0a4b0bb96097ce4cc72c21, role_id=fdad79ffbcbb4fa380dc9cf7dd108618)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:06.250236 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b451f4-9ff7-48a1-829e-b7d869acbfc8 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:06.299646 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 763/1547] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 00:20:06 2022] PUT /identity/v3/projects/5d71e648b9ff42fb8b29beabe01a5512/users/bc018a253e0a4b0bb96097ce4cc72c21/roles/fdad79ffbcbb4fa380dc9cf7dd108618 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:20:06.312342 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4f3270-67c9-47ea-a323-e96b59091ef7 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:06.312935 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4f3270-67c9-47ea-a323-e96b59091ef7 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:06.313404 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4f3270-67c9-47ea-a323-e96b59091ef7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:06.360890 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-3f4f3270-67c9-47ea-a323-e96b59091ef7 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:20:06.363291 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-3f4f3270-67c9-47ea-a323-e96b59091ef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:06.479176 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 785/1548] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:20:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:20:06.503305 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b451f4-9ff7-48a1-829e-b7d869acbfc8 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:06.656315 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b06404b-adc4-4a6d-bb48-c3d1a497cbda None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:06.657161 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b06404b-adc4-4a6d-bb48-c3d1a497cbda None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:06.657353 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b06404b-adc4-4a6d-bb48-c3d1a497cbda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:06.681923 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b451f4-9ff7-48a1-829e-b7d869acbfc8 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:06.692574 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78df485e-e767-49aa-a135-f76373dab40d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'daae792cd11d4c4ca7aae0558998aced', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:06.693750 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78df485e-e767-49aa-a135-f76373dab40d service neutron] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:06.694802 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78df485e-e767-49aa-a135-f76373dab40d service neutron] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:06.695941 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78df485e-e767-49aa-a135-f76373dab40d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:06.716208 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-0b06404b-adc4-4a6d-bb48-c3d1a497cbda None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:20:06.718285 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-0b06404b-adc4-4a6d-bb48-c3d1a497cbda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:06.729244 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78df485e-e767-49aa-a135-f76373dab40d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:06.732076 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78df485e-e767-49aa-a135-f76373dab40d service neutron] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:06.740076 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 786/1549] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:20:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:20:06.743345 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f5dacc-17e8-4bf5-aa15-c5518f1bced6 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:06.743842 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f5dacc-17e8-4bf5-aa15-c5518f1bced6 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:06.744437 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f5dacc-17e8-4bf5-aa15-c5518f1bced6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:06.778558 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 764/1550] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:20:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:20:06.780713 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df70c61f-bd6b-48a8-9afa-5461d722a58f None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:06.781111 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df70c61f-bd6b-48a8-9afa-5461d722a58f None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:06.781488 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df70c61f-bd6b-48a8-9afa-5461d722a58f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:06.784013 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-d6f5dacc-17e8-4bf5-aa15-c5518f1bced6 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:20:06.786032 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-d6f5dacc-17e8-4bf5-aa15-c5518f1bced6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:06.810615 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 787/1551] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:20:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:20:06.837660 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a108765-a4c6-438b-b630-b0fcd9d58db8 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:06.838151 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a108765-a4c6-438b-b630-b0fcd9d58db8 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:06.838685 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a108765-a4c6-438b-b630-b0fcd9d58db8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:06.876212 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-df70c61f-bd6b-48a8-9afa-5461d722a58f None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:20:06.877175 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-df70c61f-bd6b-48a8-9afa-5461d722a58f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:06.887875 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-9a108765-a4c6-438b-b630-b0fcd9d58db8 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:20:06.887875 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-9a108765-a4c6-438b-b630-b0fcd9d58db8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:06.916817 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 788/1552] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:20:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:20:06.922765 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2d3b9f-25c1-4055-8811-b1f38a7c3799 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:06.923308 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2d3b9f-25c1-4055-8811-b1f38a7c3799 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:06.923774 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2d3b9f-25c1-4055-8811-b1f38a7c3799 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:06.927483 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 765/1553] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:20:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:20:06.934460 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df70c61f-bd6b-48a8-9afa-5461d722a58f None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:06.977282 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df70c61f-bd6b-48a8-9afa-5461d722a58f None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:07.007167 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-bd2d3b9f-25c1-4055-8811-b1f38a7c3799 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:20:07.007167 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-bd2d3b9f-25c1-4055-8811-b1f38a7c3799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:07.012088 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce79b38f-fe5b-4c2c-bc6c-a95733d88860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:07.013154 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce79b38f-fe5b-4c2c-bc6c-a95733d88860 admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:07.014266 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce79b38f-fe5b-4c2c-bc6c-a95733d88860 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:07.014738 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce79b38f-fe5b-4c2c-bc6c-a95733d88860 admin admin] PATH_INFO: `/v3/domains` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:07.025785 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce79b38f-fe5b-4c2c-bc6c-a95733d88860 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:20:07.026314 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce79b38f-fe5b-4c2c-bc6c-a95733d88860 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:07.028284 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: WARNING py.warnings [None req-ce79b38f-fe5b-4c2c-bc6c-a95733d88860 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 31 00:20:07.028284 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: warnings.warn(msg) Aug 31 00:20:07.028284 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: Aug 31 00:20:07.030013 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce79b38f-fe5b-4c2c-bc6c-a95733d88860 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:07.050654 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 789/1554] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:20:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:20:07.053007 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2d3b9f-25c1-4055-8811-b1f38a7c3799 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:07.089375 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 766/1555] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 31 00:20:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:20:07.093300 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedeef15-4abf-489f-b724-dba29a242692 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:07.093300 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedeef15-4abf-489f-b724-dba29a242692 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:07.093300 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedeef15-4abf-489f-b724-dba29a242692 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:07.109948 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2d3b9f-25c1-4055-8811-b1f38a7c3799 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:07.138528 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ee85db-30c0-4bd4-a3d3-abf4843b8d03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:07.139668 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ee85db-30c0-4bd4-a3d3-abf4843b8d03 admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:07.140126 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ee85db-30c0-4bd4-a3d3-abf4843b8d03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:07.145000 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ee85db-30c0-4bd4-a3d3-abf4843b8d03 admin admin] PATH_INFO: `/v3/domains` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:07.146268 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ee85db-30c0-4bd4-a3d3-abf4843b8d03 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:20:07.146897 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ee85db-30c0-4bd4-a3d3-abf4843b8d03 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:07.161306 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ee85db-30c0-4bd4-a3d3-abf4843b8d03 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:07.171364 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-fedeef15-4abf-489f-b724-dba29a242692 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:20:07.181431 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-fedeef15-4abf-489f-b724-dba29a242692 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:07.227831 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 767/1556] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:20:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:20:07.233342 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 790/1557] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 31 00:20:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:20:07.233652 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c28222-9aea-48df-b65f-2c4edf74861a None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:07.233652 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c28222-9aea-48df-b65f-2c4edf74861a None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:07.233652 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c28222-9aea-48df-b65f-2c4edf74861a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:07.240666 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ee85db-30c0-4bd4-a3d3-abf4843b8d03 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:07.297929 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ee85db-30c0-4bd4-a3d3-abf4843b8d03 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:07.309896 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-84c28222-9aea-48df-b65f-2c4edf74861a None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:20:07.313880 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-84c28222-9aea-48df-b65f-2c4edf74861a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:07.321566 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b75240-b783-4015-8ab3-964af1b011b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:07.323293 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b75240-b783-4015-8ab3-964af1b011b6 admin admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:07.324316 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b75240-b783-4015-8ab3-964af1b011b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:07.326705 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b75240-b783-4015-8ab3-964af1b011b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:07.328268 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b75240-b783-4015-8ab3-964af1b011b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:07.332192 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: WARNING py.warnings [None req-c2b75240-b783-4015-8ab3-964af1b011b6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 00:20:07.332192 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: warnings.warn(msg) Aug 31 00:20:07.332192 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: Aug 31 00:20:07.340173 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b75240-b783-4015-8ab3-964af1b011b6 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:07.366379 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 768/1558] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:20:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:20:07.366379 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c28222-9aea-48df-b65f-2c4edf74861a None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:07.400334 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c28222-9aea-48df-b65f-2c4edf74861a None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:07.411024 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969fbab7-aa43-4b3d-aff6-7025c7399ec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:07.412329 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969fbab7-aa43-4b3d-aff6-7025c7399ec8 admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:07.413661 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969fbab7-aa43-4b3d-aff6-7025c7399ec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:07.414422 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969fbab7-aa43-4b3d-aff6-7025c7399ec8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:07.415296 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969fbab7-aa43-4b3d-aff6-7025c7399ec8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:20:07.415744 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969fbab7-aa43-4b3d-aff6-7025c7399ec8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:07.418675 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969fbab7-aa43-4b3d-aff6-7025c7399ec8 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:07.429158 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:20:07.447898 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 769/1559] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 31 00:20:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:20:07.449137 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969fbab7-aa43-4b3d-aff6-7025c7399ec8 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:07.455102 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 791/1560] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 31 00:20:07 2022] POST /identity/v3/projects => generated 387 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:20:07.458424 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfd0e81-99b4-4b61-a413-813a801e95fc None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:07.459502 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfd0e81-99b4-4b61-a413-813a801e95fc None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:07.460318 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfd0e81-99b4-4b61-a413-813a801e95fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:07.466942 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969fbab7-aa43-4b3d-aff6-7025c7399ec8 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:07.495134 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-9bfd0e81-99b4-4b61-a413-813a801e95fc None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:20:07.497329 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-9bfd0e81-99b4-4b61-a413-813a801e95fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:07.566575 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:20:07.599608 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fdc317-9aac-43c2-8302-b6d25b3a6a58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:07.601684 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fdc317-9aac-43c2-8302-b6d25b3a6a58 admin admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:07.602013 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fdc317-9aac-43c2-8302-b6d25b3a6a58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:07.602369 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fdc317-9aac-43c2-8302-b6d25b3a6a58 admin admin] PATH_INFO: `/v3/projects` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:07.603390 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fdc317-9aac-43c2-8302-b6d25b3a6a58 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:07.607383 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fdc317-9aac-43c2-8302-b6d25b3a6a58 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:07.618550 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 792/1561] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:20:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:20:07.620485 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f87123-8737-4c5b-91d8-34a5c9d66896 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:07.621012 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f87123-8737-4c5b-91d8-34a5c9d66896 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:07.621717 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f87123-8737-4c5b-91d8-34a5c9d66896 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:07.649387 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-32f87123-8737-4c5b-91d8-34a5c9d66896 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:20:07.651519 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-32f87123-8737-4c5b-91d8-34a5c9d66896 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:07.653309 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 770/1562] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 31 00:20:07 2022] POST /identity/v3/projects => generated 375 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:20:07.654704 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b3c8d7-d92a-451f-8b11-ee250e0463d5 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:07.654986 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b3c8d7-d92a-451f-8b11-ee250e0463d5 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:07.655253 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b3c8d7-d92a-451f-8b11-ee250e0463d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:07.701288 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-a8b3c8d7-d92a-451f-8b11-ee250e0463d5 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:20:07.702654 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-a8b3c8d7-d92a-451f-8b11-ee250e0463d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:07.804339 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 793/1563] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:20:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:20:07.807216 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe93b83-9ed6-427b-b629-11b5216736b1 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:07.807862 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe93b83-9ed6-427b-b629-11b5216736b1 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:07.808410 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe93b83-9ed6-427b-b629-11b5216736b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:07.825761 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 771/1564] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:20:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:20:07.827546 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b3c8d7-d92a-451f-8b11-ee250e0463d5 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:07.847468 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b3c8d7-d92a-451f-8b11-ee250e0463d5 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:07.859099 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504fba7d-672b-4f4e-ac01-7faa965acb1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:07.861192 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504fba7d-672b-4f4e-ac01-7faa965acb1c admin admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:07.861587 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-1fe93b83-9ed6-427b-b629-11b5216736b1 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:20:07.862357 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504fba7d-672b-4f4e-ac01-7faa965acb1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:07.863496 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504fba7d-672b-4f4e-ac01-7faa965acb1c admin admin] PATH_INFO: `/v3/users` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:07.863816 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-1fe93b83-9ed6-427b-b629-11b5216736b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:07.865402 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504fba7d-672b-4f4e-ac01-7faa965acb1c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:07.868018 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: WARNING py.warnings [None req-504fba7d-672b-4f4e-ac01-7faa965acb1c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 00:20:07.868018 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: warnings.warn(msg) Aug 31 00:20:07.868018 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: Aug 31 00:20:07.870856 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504fba7d-672b-4f4e-ac01-7faa965acb1c admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:07.881510 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 794/1565] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:20:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:20:07.883671 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe93b83-9ed6-427b-b629-11b5216736b1 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:07.909509 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe93b83-9ed6-427b-b629-11b5216736b1 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:07.910437 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 772/1566] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 31 00:20:07 2022] POST /identity/v3/users => generated 294 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:20:07.912368 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3f1a97-b59e-4dd2-be25-01bc6bbebd49 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:07.913749 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3f1a97-b59e-4dd2-be25-01bc6bbebd49 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:07.914458 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3f1a97-b59e-4dd2-be25-01bc6bbebd49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:07.920527 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c713ae5e-f0b9-4221-9032-ee740b383910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:07.921799 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c713ae5e-f0b9-4221-9032-ee740b383910 admin admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:07.922557 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c713ae5e-f0b9-4221-9032-ee740b383910 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:07.923039 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c713ae5e-f0b9-4221-9032-ee740b383910 admin admin] PATH_INFO: `/v3/projects` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:07.924505 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c713ae5e-f0b9-4221-9032-ee740b383910 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:07.928279 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c713ae5e-f0b9-4221-9032-ee740b383910 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:07.939842 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-2c3f1a97-b59e-4dd2-be25-01bc6bbebd49 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:20:07.941138 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-2c3f1a97-b59e-4dd2-be25-01bc6bbebd49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:07.950508 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 773/1567] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:20:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:20:07.951415 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3f1a97-b59e-4dd2-be25-01bc6bbebd49 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:07.963452 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3f1a97-b59e-4dd2-be25-01bc6bbebd49 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:07.968589 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b9efb4-9b48-4d3c-bf32-d7093abab419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:07.969224 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b9efb4-9b48-4d3c-bf32-d7093abab419 admin admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:07.969500 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b9efb4-9b48-4d3c-bf32-d7093abab419 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:07.969768 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b9efb4-9b48-4d3c-bf32-d7093abab419 admin admin] PATH_INFO: `/v3/users` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:07.970417 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b9efb4-9b48-4d3c-bf32-d7093abab419 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:07.973199 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b9efb4-9b48-4d3c-bf32-d7093abab419 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:08.004809 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 774/1568] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 31 00:20:07 2022] POST /identity/v3/users => generated 288 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:20:08.006082 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b9efb4-9b48-4d3c-bf32-d7093abab419 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:08.015385 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 795/1569] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 31 00:20:07 2022] POST /identity/v3/projects => generated 405 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:20:08.017849 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0a2ac3-818d-4ebd-b941-a42c5b3560ff None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:08.018621 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0a2ac3-818d-4ebd-b941-a42c5b3560ff None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:08.018911 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0a2ac3-818d-4ebd-b941-a42c5b3560ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:08.020874 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b9efb4-9b48-4d3c-bf32-d7093abab419 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:08.058720 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-3a0a2ac3-818d-4ebd-b941-a42c5b3560ff None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:20:08.061366 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-3a0a2ac3-818d-4ebd-b941-a42c5b3560ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:08.118075 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67db69ef-9816-4f18-95b6-7fc15ce62aff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:08.119069 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67db69ef-9816-4f18-95b6-7fc15ce62aff admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:08.120093 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67db69ef-9816-4f18-95b6-7fc15ce62aff admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:08.120556 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67db69ef-9816-4f18-95b6-7fc15ce62aff admin admin] PATH_INFO: `/v3/domains` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:08.121910 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67db69ef-9816-4f18-95b6-7fc15ce62aff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:20:08.122375 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67db69ef-9816-4f18-95b6-7fc15ce62aff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:08.125353 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67db69ef-9816-4f18-95b6-7fc15ce62aff admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:08.151591 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 775/1570] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 31 00:20:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:20:08.154338 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c57815-96c7-4e4b-bc89-eb974bc64161 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:08.154876 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c57815-96c7-4e4b-bc89-eb974bc64161 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:08.155395 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c57815-96c7-4e4b-bc89-eb974bc64161 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:08.186595 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-f7c57815-96c7-4e4b-bc89-eb974bc64161 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:20:08.187473 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-f7c57815-96c7-4e4b-bc89-eb974bc64161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:08.199700 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 776/1571] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:20:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:20:08.201185 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c57815-96c7-4e4b-bc89-eb974bc64161 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:08.203942 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 796/1572] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:20:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:20:08.210296 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0a2ac3-818d-4ebd-b941-a42c5b3560ff None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:08.220263 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c57815-96c7-4e4b-bc89-eb974bc64161 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:08.226508 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e74aea-1893-4870-aa74-3e0c6659e916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:08.227144 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e74aea-1893-4870-aa74-3e0c6659e916 admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:08.227433 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e74aea-1893-4870-aa74-3e0c6659e916 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:08.227708 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e74aea-1893-4870-aa74-3e0c6659e916 admin admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:08.228427 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e74aea-1893-4870-aa74-3e0c6659e916 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:08.230447 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e74aea-1893-4870-aa74-3e0c6659e916 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:08.233854 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0a2ac3-818d-4ebd-b941-a42c5b3560ff None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:08.241870 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b329ac-fa6a-4c4c-9e9a-44b4ebad80f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:08.243090 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b329ac-fa6a-4c4c-9e9a-44b4ebad80f8 admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:08.243538 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b329ac-fa6a-4c4c-9e9a-44b4ebad80f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:08.243855 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 777/1573] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 00:20:08 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:20:08.244290 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b329ac-fa6a-4c4c-9e9a-44b4ebad80f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:08.245378 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b329ac-fa6a-4c4c-9e9a-44b4ebad80f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:20:08.246019 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b329ac-fa6a-4c4c-9e9a-44b4ebad80f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:08.247775 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e74aea-1893-4870-aa74-3e0c6659e916 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:08.248608 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b329ac-fa6a-4c4c-9e9a-44b4ebad80f8 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:08.255123 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:20:08.261835 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e74aea-1893-4870-aa74-3e0c6659e916 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:08.262290 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:20:08.269104 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e727db00-9d16-4e03-81bd-7ae86a59414a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:08.269900 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e727db00-9d16-4e03-81bd-7ae86a59414a admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:08.270220 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e727db00-9d16-4e03-81bd-7ae86a59414a admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:08.270568 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e727db00-9d16-4e03-81bd-7ae86a59414a admin admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:08.271418 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e727db00-9d16-4e03-81bd-7ae86a59414a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:08.274758 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e727db00-9d16-4e03-81bd-7ae86a59414a admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:08.277722 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 797/1574] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 31 00:20:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:20:08.279305 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b329ac-fa6a-4c4c-9e9a-44b4ebad80f8 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:08.290128 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 778/1575] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 00:20:08 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:20:08.291094 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e727db00-9d16-4e03-81bd-7ae86a59414a admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:08.293993 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b329ac-fa6a-4c4c-9e9a-44b4ebad80f8 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:08.300986 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7850cf2-e789-4629-b616-f9e451b6dd7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:08.302035 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7850cf2-e789-4629-b616-f9e451b6dd7e admin admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:08.302512 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7850cf2-e789-4629-b616-f9e451b6dd7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:08.303038 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7850cf2-e789-4629-b616-f9e451b6dd7e admin admin] PATH_INFO: `/v3/users` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:08.304645 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7850cf2-e789-4629-b616-f9e451b6dd7e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:08.304949 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e727db00-9d16-4e03-81bd-7ae86a59414a admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:08.307837 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7850cf2-e789-4629-b616-f9e451b6dd7e admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:08.310513 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f69842-64e5-4b65-9659-b4f9fc20ba36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:08.311612 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f69842-64e5-4b65-9659-b4f9fc20ba36 admin admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:08.311612 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f69842-64e5-4b65-9659-b4f9fc20ba36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:08.311920 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f69842-64e5-4b65-9659-b4f9fc20ba36 admin admin] PATH_INFO: `/v3/projects` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:08.312691 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f69842-64e5-4b65-9659-b4f9fc20ba36 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:08.315591 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f69842-64e5-4b65-9659-b4f9fc20ba36 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:08.359442 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 798/1576] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 31 00:20:08 2022] POST /identity/v3/users => generated 303 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:20:08.359442 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7850cf2-e789-4629-b616-f9e451b6dd7e admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:08.374198 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7850cf2-e789-4629-b616-f9e451b6dd7e admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:08.381258 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 779/1577] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 31 00:20:08 2022] POST /identity/v3/projects => generated 379 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:20:08.381258 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f69842-64e5-4b65-9659-b4f9fc20ba36 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:08.480001 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f69842-64e5-4b65-9659-b4f9fc20ba36 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:08.485679 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8b627c-5b99-4d3b-94cb-aff7d045b25b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:08.486708 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8b627c-5b99-4d3b-94cb-aff7d045b25b admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:08.487075 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8b627c-5b99-4d3b-94cb-aff7d045b25b admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:08.487581 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8b627c-5b99-4d3b-94cb-aff7d045b25b admin admin] PATH_INFO: `/v3/domains` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:08.488571 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8b627c-5b99-4d3b-94cb-aff7d045b25b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:20:08.488989 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8b627c-5b99-4d3b-94cb-aff7d045b25b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:08.491046 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8b627c-5b99-4d3b-94cb-aff7d045b25b admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:08.508949 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 780/1578] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 31 00:20:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:20:08.511002 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8b627c-5b99-4d3b-94cb-aff7d045b25b admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:08.527266 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8345467-17a9-4bde-a6c1-7cbc93b823fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:08.528571 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8345467-17a9-4bde-a6c1-7cbc93b823fa admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:08.530008 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8345467-17a9-4bde-a6c1-7cbc93b823fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:08.530514 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8345467-17a9-4bde-a6c1-7cbc93b823fa admin admin] PATH_INFO: `/v3/domains` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:08.532344 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8345467-17a9-4bde-a6c1-7cbc93b823fa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:20:08.532899 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8345467-17a9-4bde-a6c1-7cbc93b823fa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:08.534029 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8b627c-5b99-4d3b-94cb-aff7d045b25b admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:08.537519 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8345467-17a9-4bde-a6c1-7cbc93b823fa admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:08.540466 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbb3a14-9ce9-478a-bfe7-dc0915ff1c74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:08.541559 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbb3a14-9ce9-478a-bfe7-dc0915ff1c74 admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:08.541957 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbb3a14-9ce9-478a-bfe7-dc0915ff1c74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:08.542423 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbb3a14-9ce9-478a-bfe7-dc0915ff1c74 admin admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:08.543259 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbb3a14-9ce9-478a-bfe7-dc0915ff1c74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:08.545261 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbb3a14-9ce9-478a-bfe7-dc0915ff1c74 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:08.569892 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 799/1579] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 31 00:20:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:20:08.569892 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8345467-17a9-4bde-a6c1-7cbc93b823fa admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:08.570353 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 781/1580] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 00:20:08 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:20:08.570353 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbb3a14-9ce9-478a-bfe7-dc0915ff1c74 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:08.570648 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8345467-17a9-4bde-a6c1-7cbc93b823fa admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:08.576809 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba37f77-e64c-4a95-85c5-f1c15bf45056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:08.577445 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba37f77-e64c-4a95-85c5-f1c15bf45056 admin admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:08.577719 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba37f77-e64c-4a95-85c5-f1c15bf45056 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:08.577989 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba37f77-e64c-4a95-85c5-f1c15bf45056 admin admin] PATH_INFO: `/v3/projects` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:08.578635 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba37f77-e64c-4a95-85c5-f1c15bf45056 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:08.579468 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbb3a14-9ce9-478a-bfe7-dc0915ff1c74 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:08.580788 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba37f77-e64c-4a95-85c5-f1c15bf45056 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:08.586587 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faaaf6e-ab26-4592-8300-936e810badfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:08.587836 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faaaf6e-ab26-4592-8300-936e810badfe admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:08.588553 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faaaf6e-ab26-4592-8300-936e810badfe admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:08.588902 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faaaf6e-ab26-4592-8300-936e810badfe admin admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:08.589812 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2faaaf6e-ab26-4592-8300-936e810badfe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:08.592141 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2faaaf6e-ab26-4592-8300-936e810badfe admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:08.607890 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 782/1581] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 00:20:08 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:20:08.613932 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faaaf6e-ab26-4592-8300-936e810badfe admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:08.623693 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faaaf6e-ab26-4592-8300-936e810badfe admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:08.628342 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 800/1582] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 31 00:20:08 2022] POST /identity/v3/projects => generated 385 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:20:08.629291 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba37f77-e64c-4a95-85c5-f1c15bf45056 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:08.716850 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6b9e7a-7294-4347-8004-2ad4dd87df31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:08.717455 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6b9e7a-7294-4347-8004-2ad4dd87df31 admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:08.717712 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6b9e7a-7294-4347-8004-2ad4dd87df31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:08.718119 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6b9e7a-7294-4347-8004-2ad4dd87df31 admin admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:08.718783 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6b9e7a-7294-4347-8004-2ad4dd87df31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:08.720618 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6b9e7a-7294-4347-8004-2ad4dd87df31 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:08.732044 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba37f77-e64c-4a95-85c5-f1c15bf45056 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:08.737592 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0890f9aa-8c6e-47cf-9761-2035605002ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:08.738661 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 783/1583] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 00:20:08 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:20:08.738982 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0890f9aa-8c6e-47cf-9761-2035605002ea admin admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:08.739468 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0890f9aa-8c6e-47cf-9761-2035605002ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:08.739661 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6b9e7a-7294-4347-8004-2ad4dd87df31 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:08.740395 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0890f9aa-8c6e-47cf-9761-2035605002ea admin admin] PATH_INFO: `/v3/users` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:08.741507 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0890f9aa-8c6e-47cf-9761-2035605002ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:08.743924 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0890f9aa-8c6e-47cf-9761-2035605002ea admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:08.753937 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6b9e7a-7294-4347-8004-2ad4dd87df31 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:08.763034 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffd0191-39e1-416c-be59-32321c6c2443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:08.763981 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffd0191-39e1-416c-be59-32321c6c2443 admin admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:08.764488 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffd0191-39e1-416c-be59-32321c6c2443 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:08.765049 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffd0191-39e1-416c-be59-32321c6c2443 admin admin] PATH_INFO: `/v3/projects` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:08.765876 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffd0191-39e1-416c-be59-32321c6c2443 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:08.769550 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffd0191-39e1-416c-be59-32321c6c2443 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:08.777346 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 801/1584] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 31 00:20:08 2022] POST /identity/v3/users => generated 290 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:20:08.778543 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0890f9aa-8c6e-47cf-9761-2035605002ea admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:08.792783 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0890f9aa-8c6e-47cf-9761-2035605002ea admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:08.798197 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be9e9ce-ef5f-40e9-b0b5-d5319ac5b2df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:08.798878 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be9e9ce-ef5f-40e9-b0b5-d5319ac5b2df admin admin] REQUEST_METHOD: `PUT` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:08.799217 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be9e9ce-ef5f-40e9-b0b5-d5319ac5b2df admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:08.799482 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be9e9ce-ef5f-40e9-b0b5-d5319ac5b2df admin admin] PATH_INFO: `/v3/projects/e53c8a6e81fe48d5b9609b921283e64d/users/08fa033114244fc89c82939202f911e7/roles/fdad79ffbcbb4fa380dc9cf7dd108618` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:08.817005 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 784/1585] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 31 00:20:08 2022] POST /identity/v3/projects => generated 381 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:20:08.818228 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffd0191-39e1-416c-be59-32321c6c2443 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:08.839626 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be9e9ce-ef5f-40e9-b0b5-d5319ac5b2df admin admin] RBAC: Authorizing `identity:create_grant(project_id=e53c8a6e81fe48d5b9609b921283e64d, user_id=08fa033114244fc89c82939202f911e7, role_id=fdad79ffbcbb4fa380dc9cf7dd108618)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:08.842762 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: WARNING py.warnings [None req-3be9e9ce-ef5f-40e9-b0b5-d5319ac5b2df admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 00:20:08.842762 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: warnings.warn(msg) Aug 31 00:20:08.842762 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: Aug 31 00:20:08.847366 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:20:08.851100 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be9e9ce-ef5f-40e9-b0b5-d5319ac5b2df admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:08.883569 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 802/1586] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 00:20:08 2022] PUT /identity/v3/projects/e53c8a6e81fe48d5b9609b921283e64d/users/08fa033114244fc89c82939202f911e7/roles/fdad79ffbcbb4fa380dc9cf7dd108618 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:20:08.883569 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be9e9ce-ef5f-40e9-b0b5-d5319ac5b2df admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:08.921738 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:20:08.967746 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffd0191-39e1-416c-be59-32321c6c2443 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:08.997371 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be9e9ce-ef5f-40e9-b0b5-d5319ac5b2df admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:09.011916 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe100ba-24a9-455e-aa2f-1c56101bd6d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:09.012749 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe100ba-24a9-455e-aa2f-1c56101bd6d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:09.013038 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe100ba-24a9-455e-aa2f-1c56101bd6d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:09.013312 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe100ba-24a9-455e-aa2f-1c56101bd6d7 admin admin] PATH_INFO: `/v3/projects/04549bf2ddd64141b2783feb6e7acb66/users/14a25c9de67c4274b2a83ee0e1a5dbe4/roles/fdad79ffbcbb4fa380dc9cf7dd108618` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:09.040198 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe100ba-24a9-455e-aa2f-1c56101bd6d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=04549bf2ddd64141b2783feb6e7acb66, user_id=14a25c9de67c4274b2a83ee0e1a5dbe4, role_id=fdad79ffbcbb4fa380dc9cf7dd108618)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:09.045451 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe100ba-24a9-455e-aa2f-1c56101bd6d7 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:09.084135 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 803/1587] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 00:20:08 2022] PUT /identity/v3/projects/04549bf2ddd64141b2783feb6e7acb66/users/14a25c9de67c4274b2a83ee0e1a5dbe4/roles/fdad79ffbcbb4fa380dc9cf7dd108618 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:20:09.084135 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe100ba-24a9-455e-aa2f-1c56101bd6d7 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:09.093309 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2ecff0-998e-4601-b291-a031ea2f6542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:09.093972 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2ecff0-998e-4601-b291-a031ea2f6542 admin admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:09.094310 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2ecff0-998e-4601-b291-a031ea2f6542 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:09.094578 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2ecff0-998e-4601-b291-a031ea2f6542 admin admin] PATH_INFO: `/v3/projects` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:09.095329 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2ecff0-998e-4601-b291-a031ea2f6542 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:09.097851 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2ecff0-998e-4601-b291-a031ea2f6542 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:09.159079 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 785/1588] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 31 00:20:08 2022] POST /identity/v3/projects => generated 393 bytes in 341 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:20:09.160379 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2ecff0-998e-4601-b291-a031ea2f6542 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:09.236118 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe100ba-24a9-455e-aa2f-1c56101bd6d7 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:09.266604 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2ecff0-998e-4601-b291-a031ea2f6542 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:09.275102 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb804cfa-0772-4f7f-ae13-595d02f080bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:09.276382 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb804cfa-0772-4f7f-ae13-595d02f080bc admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:09.276851 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb804cfa-0772-4f7f-ae13-595d02f080bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:09.277955 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb804cfa-0772-4f7f-ae13-595d02f080bc admin admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:09.278798 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb804cfa-0772-4f7f-ae13-595d02f080bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:09.281234 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb804cfa-0772-4f7f-ae13-595d02f080bc admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:09.300034 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 786/1589] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 00:20:09 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:20:09.300995 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb804cfa-0772-4f7f-ae13-595d02f080bc admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:09.317019 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb804cfa-0772-4f7f-ae13-595d02f080bc admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:09.325211 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f336d9e-f564-4887-9af6-fb48af0188df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:09.326266 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f336d9e-f564-4887-9af6-fb48af0188df admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:09.326548 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f336d9e-f564-4887-9af6-fb48af0188df admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:09.327450 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f336d9e-f564-4887-9af6-fb48af0188df admin admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:09.328356 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f336d9e-f564-4887-9af6-fb48af0188df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:09.330122 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f336d9e-f564-4887-9af6-fb48af0188df admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:09.363323 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 787/1590] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 00:20:09 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:20:09.364097 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f336d9e-f564-4887-9af6-fb48af0188df admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:09.365068 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e21ed0b-59f2-43bb-889b-81160293de4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:09.366562 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e21ed0b-59f2-43bb-889b-81160293de4c admin admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:09.366911 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e21ed0b-59f2-43bb-889b-81160293de4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:09.367190 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e21ed0b-59f2-43bb-889b-81160293de4c admin admin] PATH_INFO: `/v3/users` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:09.367852 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e21ed0b-59f2-43bb-889b-81160293de4c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:09.369837 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e21ed0b-59f2-43bb-889b-81160293de4c admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:09.393840 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f336d9e-f564-4887-9af6-fb48af0188df admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:09.406031 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbe81a1-3392-4c27-a35f-619d0556bebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:09.406860 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbe81a1-3392-4c27-a35f-619d0556bebb admin admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:09.407144 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbe81a1-3392-4c27-a35f-619d0556bebb admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:09.412070 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 804/1591] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 31 00:20:09 2022] POST /identity/v3/users => generated 293 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:20:09.414258 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5f9aaa-04ea-43bd-b0c6-e5d1425e348e None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:09.414549 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5f9aaa-04ea-43bd-b0c6-e5d1425e348e None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:09.414825 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5f9aaa-04ea-43bd-b0c6-e5d1425e348e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:09.417235 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbe81a1-3392-4c27-a35f-619d0556bebb admin admin] PATH_INFO: `/v3/users` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:09.418431 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbe81a1-3392-4c27-a35f-619d0556bebb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:09.419944 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbe81a1-3392-4c27-a35f-619d0556bebb admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:09.461955 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-ea5f9aaa-04ea-43bd-b0c6-e5d1425e348e None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:20:09.464364 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-ea5f9aaa-04ea-43bd-b0c6-e5d1425e348e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:09.471088 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 788/1592] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 31 00:20:09 2022] POST /identity/v3/users => generated 291 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:20:09.472738 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636e9b5c-6d38-49f3-aec5-cab98b3c4757 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:09.473044 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636e9b5c-6d38-49f3-aec5-cab98b3c4757 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:09.473319 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636e9b5c-6d38-49f3-aec5-cab98b3c4757 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:09.478831 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 805/1593] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:20:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:20:09.479840 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5f9aaa-04ea-43bd-b0c6-e5d1425e348e None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:09.492373 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5f9aaa-04ea-43bd-b0c6-e5d1425e348e None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:09.499427 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd6cba3-43e6-4a5b-a54f-1dab85a97bd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:09.500058 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd6cba3-43e6-4a5b-a54f-1dab85a97bd2 admin admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:09.500368 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd6cba3-43e6-4a5b-a54f-1dab85a97bd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:09.500639 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd6cba3-43e6-4a5b-a54f-1dab85a97bd2 admin admin] PATH_INFO: `/v3/users` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:09.501308 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd6cba3-43e6-4a5b-a54f-1dab85a97bd2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:09.503253 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd6cba3-43e6-4a5b-a54f-1dab85a97bd2 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:09.538680 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 806/1594] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 31 00:20:09 2022] POST /identity/v3/users => generated 297 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:20:09.538680 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd6cba3-43e6-4a5b-a54f-1dab85a97bd2 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:09.542358 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-636e9b5c-6d38-49f3-aec5-cab98b3c4757 None None] MFA Rules not processed for user `14a25c9de67c4274b2a83ee0e1a5dbe4`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:20:09.544906 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-636e9b5c-6d38-49f3-aec5-cab98b3c4757 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:09.566006 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd6cba3-43e6-4a5b-a54f-1dab85a97bd2 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:09.570281 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:20:09.575012 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15a6dae-f9fa-4040-aeb0-2d22f2d65439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:09.575328 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15a6dae-f9fa-4040-aeb0-2d22f2d65439 admin admin] REQUEST_METHOD: `PUT` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:09.575542 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15a6dae-f9fa-4040-aeb0-2d22f2d65439 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:09.575769 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15a6dae-f9fa-4040-aeb0-2d22f2d65439 admin admin] PATH_INFO: `/v3/projects/eef77c3c5d6646a0a72600ebee4ad7cc/users/bb16f5a85246405fafb16c5338bf6907/roles/fdad79ffbcbb4fa380dc9cf7dd108618` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:09.598865 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:20:09.607798 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15a6dae-f9fa-4040-aeb0-2d22f2d65439 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eef77c3c5d6646a0a72600ebee4ad7cc, user_id=bb16f5a85246405fafb16c5338bf6907, role_id=fdad79ffbcbb4fa380dc9cf7dd108618)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:09.611407 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15a6dae-f9fa-4040-aeb0-2d22f2d65439 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:09.635864 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 807/1595] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 00:20:09 2022] PUT /identity/v3/projects/eef77c3c5d6646a0a72600ebee4ad7cc/users/bb16f5a85246405fafb16c5338bf6907/roles/fdad79ffbcbb4fa380dc9cf7dd108618 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:20:09.652415 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15a6dae-f9fa-4040-aeb0-2d22f2d65439 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:09.685016 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 789/1596] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:20:09 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:20:09.689168 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636e9b5c-6d38-49f3-aec5-cab98b3c4757 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:09.711771 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636e9b5c-6d38-49f3-aec5-cab98b3c4757 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:09.809925 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15a6dae-f9fa-4040-aeb0-2d22f2d65439 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:09.837213 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a1b4ed-4981-4e4e-808c-03378bc38d30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:09.841199 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a1b4ed-4981-4e4e-808c-03378bc38d30 admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:09.842113 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a1b4ed-4981-4e4e-808c-03378bc38d30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:09.842113 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a1b4ed-4981-4e4e-808c-03378bc38d30 admin admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:09.842553 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a1b4ed-4981-4e4e-808c-03378bc38d30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:09.845938 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a1b4ed-4981-4e4e-808c-03378bc38d30 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:09.884371 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 808/1597] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 00:20:09 2022] GET /identity/v3/roles => generated 1420 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:20:09.885933 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a1b4ed-4981-4e4e-808c-03378bc38d30 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:09.909293 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a1b4ed-4981-4e4e-808c-03378bc38d30 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:09.919354 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae00f26-f63d-4418-9c6e-c5b154456287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:09.920583 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae00f26-f63d-4418-9c6e-c5b154456287 admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:09.920870 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae00f26-f63d-4418-9c6e-c5b154456287 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:09.920980 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a25491-e50c-4aba-abdd-8392f06ce33f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:09.921478 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae00f26-f63d-4418-9c6e-c5b154456287 admin admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:09.921595 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a25491-e50c-4aba-abdd-8392f06ce33f admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:09.921806 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae00f26-f63d-4418-9c6e-c5b154456287 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:09.921922 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a25491-e50c-4aba-abdd-8392f06ce33f admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:09.922372 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a25491-e50c-4aba-abdd-8392f06ce33f admin admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:09.923283 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a25491-e50c-4aba-abdd-8392f06ce33f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:09.923608 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae00f26-f63d-4418-9c6e-c5b154456287 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:09.925018 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a25491-e50c-4aba-abdd-8392f06ce33f admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:09.943934 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 809/1598] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 00:20:09 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:20:09.946111 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae00f26-f63d-4418-9c6e-c5b154456287 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:09.948105 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-4ae00f26-f63d-4418-9c6e-c5b154456287 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:09.950759 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 790/1599] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 00:20:09 2022] GET /identity/v3/roles => generated 1420 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:20:09.955228 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a25491-e50c-4aba-abdd-8392f06ce33f admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:09.989322 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a25491-e50c-4aba-abdd-8392f06ce33f admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:10.002242 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2994521e-3afd-413f-b29e-e2606ae0dbad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:10.003061 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2994521e-3afd-413f-b29e-e2606ae0dbad admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:10.003349 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2994521e-3afd-413f-b29e-e2606ae0dbad admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:10.003625 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2994521e-3afd-413f-b29e-e2606ae0dbad admin admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:10.004353 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2994521e-3afd-413f-b29e-e2606ae0dbad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:10.006047 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2994521e-3afd-413f-b29e-e2606ae0dbad admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:10.027155 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 791/1600] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 00:20:09 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:20:10.027155 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df31410-499e-4de5-85ec-e220de9e41cc None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:10.027155 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df31410-499e-4de5-85ec-e220de9e41cc None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:10.027155 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df31410-499e-4de5-85ec-e220de9e41cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:10.071619 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-3df31410-499e-4de5-85ec-e220de9e41cc None None] MFA Rules not processed for user `bb16f5a85246405fafb16c5338bf6907`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:20:10.072650 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae00f26-f63d-4418-9c6e-c5b154456287 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:10.074563 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-3df31410-499e-4de5-85ec-e220de9e41cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:10.082135 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c519882-8c49-4f04-a999-b0c606364b29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'daae792cd11d4c4ca7aae0558998aced', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:10.083670 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c519882-8c49-4f04-a999-b0c606364b29 service neutron] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:10.084201 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c519882-8c49-4f04-a999-b0c606364b29 service neutron] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:10.085458 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c519882-8c49-4f04-a999-b0c606364b29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:10.111820 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c519882-8c49-4f04-a999-b0c606364b29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:10.115740 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c519882-8c49-4f04-a999-b0c606364b29 service neutron] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:10.149386 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 810/1601] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:20:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:20:10.152419 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c519882-8c49-4f04-a999-b0c606364b29 service neutron] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:10.180538 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c519882-8c49-4f04-a999-b0c606364b29 service neutron] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:10.190682 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4ff3f5-6921-48c4-8c4c-72736ca224ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:10.191933 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4ff3f5-6921-48c4-8c4c-72736ca224ff admin admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:10.192851 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4ff3f5-6921-48c4-8c4c-72736ca224ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:10.193362 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4ff3f5-6921-48c4-8c4c-72736ca224ff admin admin] PATH_INFO: `/v3/projects` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:10.195679 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4ff3f5-6921-48c4-8c4c-72736ca224ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:10.200628 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4ff3f5-6921-48c4-8c4c-72736ca224ff admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:10.260584 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 792/1602] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:20:10 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:20:10.261228 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df31410-499e-4de5-85ec-e220de9e41cc None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:10.281319 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df31410-499e-4de5-85ec-e220de9e41cc None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:10.286153 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 811/1603] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 31 00:20:10 2022] POST /identity/v3/projects => generated 375 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:20:10.289940 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4ff3f5-6921-48c4-8c4c-72736ca224ff admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:10.314746 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:20:10.387385 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482861e2-5ce6-4361-9a98-39ea6b33f13e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:10.388736 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482861e2-5ce6-4361-9a98-39ea6b33f13e admin admin] REQUEST_METHOD: `PUT` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:10.389019 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482861e2-5ce6-4361-9a98-39ea6b33f13e admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:10.389291 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482861e2-5ce6-4361-9a98-39ea6b33f13e admin admin] PATH_INFO: `/v3/projects/d3406349e71d4d96bd33248ce77d5066/users/2ae7c3709577481b8661ccd80369bd4a/roles/fdad79ffbcbb4fa380dc9cf7dd108618` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:10.425711 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482861e2-5ce6-4361-9a98-39ea6b33f13e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3406349e71d4d96bd33248ce77d5066, user_id=2ae7c3709577481b8661ccd80369bd4a, role_id=fdad79ffbcbb4fa380dc9cf7dd108618)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:10.431357 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482861e2-5ce6-4361-9a98-39ea6b33f13e admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:10.456503 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:20:10.465801 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4ff3f5-6921-48c4-8c4c-72736ca224ff admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:10.473452 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 793/1604] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 00:20:10 2022] PUT /identity/v3/projects/d3406349e71d4d96bd33248ce77d5066/users/2ae7c3709577481b8661ccd80369bd4a/roles/fdad79ffbcbb4fa380dc9cf7dd108618 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:20:10.474868 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482861e2-5ce6-4361-9a98-39ea6b33f13e admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:10.615057 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482861e2-5ce6-4361-9a98-39ea6b33f13e admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:10.621199 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1ab56e-4cfc-4909-bafc-7ad725e06e54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:10.621922 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1ab56e-4cfc-4909-bafc-7ad725e06e54 admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:10.622279 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1ab56e-4cfc-4909-bafc-7ad725e06e54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:10.622636 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1ab56e-4cfc-4909-bafc-7ad725e06e54 admin admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:10.623389 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1ab56e-4cfc-4909-bafc-7ad725e06e54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:10.625542 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1ab56e-4cfc-4909-bafc-7ad725e06e54 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:10.639407 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 794/1605] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 00:20:10 2022] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:20:10.640636 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1ab56e-4cfc-4909-bafc-7ad725e06e54 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:10.643058 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff9a334-e320-4fae-ba79-b6fb44a6aefe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:10.643712 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff9a334-e320-4fae-ba79-b6fb44a6aefe admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:10.643994 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff9a334-e320-4fae-ba79-b6fb44a6aefe admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:10.644323 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff9a334-e320-4fae-ba79-b6fb44a6aefe admin admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:10.647725 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff9a334-e320-4fae-ba79-b6fb44a6aefe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:10.651364 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff9a334-e320-4fae-ba79-b6fb44a6aefe admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:10.654750 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1ab56e-4cfc-4909-bafc-7ad725e06e54 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:10.660453 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349dbc19-4ac8-4402-bf26-79d0961a5ca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:10.661199 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349dbc19-4ac8-4402-bf26-79d0961a5ca1 admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:10.661549 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349dbc19-4ac8-4402-bf26-79d0961a5ca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:10.661890 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349dbc19-4ac8-4402-bf26-79d0961a5ca1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:10.663208 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349dbc19-4ac8-4402-bf26-79d0961a5ca1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:10.665085 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349dbc19-4ac8-4402-bf26-79d0961a5ca1 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:10.679352 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 812/1606] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 00:20:10 2022] GET /identity/v3/roles => generated 1420 bytes in 393 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:20:10.681398 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff9a334-e320-4fae-ba79-b6fb44a6aefe admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:10.699466 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 795/1607] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 00:20:10 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:20:10.700682 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349dbc19-4ac8-4402-bf26-79d0961a5ca1 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:10.709994 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff9a334-e320-4fae-ba79-b6fb44a6aefe admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:10.719967 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349dbc19-4ac8-4402-bf26-79d0961a5ca1 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:10.727092 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786fde84-a989-4930-b60d-c1e642c250c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:10.727874 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786fde84-a989-4930-b60d-c1e642c250c8 admin admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:10.728168 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786fde84-a989-4930-b60d-c1e642c250c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:10.728451 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786fde84-a989-4930-b60d-c1e642c250c8 admin admin] PATH_INFO: `/v3/users` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:10.729165 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786fde84-a989-4930-b60d-c1e642c250c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:10.731298 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786fde84-a989-4930-b60d-c1e642c250c8 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:10.739540 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942668c5-2037-4514-a377-8e5b60ca89d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:10.740420 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942668c5-2037-4514-a377-8e5b60ca89d9 admin admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:10.741556 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942668c5-2037-4514-a377-8e5b60ca89d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:10.742790 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942668c5-2037-4514-a377-8e5b60ca89d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:10.743352 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942668c5-2037-4514-a377-8e5b60ca89d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:10.747520 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942668c5-2037-4514-a377-8e5b60ca89d9 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:10.774371 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 796/1608] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 31 00:20:10 2022] POST /identity/v3/users => generated 294 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:20:10.780509 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3ec96f-03e0-4ef4-bb8e-5da4c2af5ce7 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:10.780789 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3ec96f-03e0-4ef4-bb8e-5da4c2af5ce7 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:10.781069 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3ec96f-03e0-4ef4-bb8e-5da4c2af5ce7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:10.810222 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-1f3ec96f-03e0-4ef4-bb8e-5da4c2af5ce7 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:20:10.811630 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-1f3ec96f-03e0-4ef4-bb8e-5da4c2af5ce7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:10.814816 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 813/1609] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 31 00:20:10 2022] POST /identity/v3/projects => generated 405 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:20:10.815962 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942668c5-2037-4514-a377-8e5b60ca89d9 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:10.916588 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 797/1610] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:20:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:20:10.917632 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3ec96f-03e0-4ef4-bb8e-5da4c2af5ce7 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:10.931346 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3ec96f-03e0-4ef4-bb8e-5da4c2af5ce7 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:10.941559 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346b79a6-3238-4915-8bff-3820999bed83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:10.942266 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346b79a6-3238-4915-8bff-3820999bed83 admin admin] REQUEST_METHOD: `PUT` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:10.942542 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346b79a6-3238-4915-8bff-3820999bed83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:10.942815 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346b79a6-3238-4915-8bff-3820999bed83 admin admin] PATH_INFO: `/v3/projects/dbe3f343119e4f10828c98ef17e8da5c/users/b3da9d7af0fd4c1d99973e6b277b16d2/roles/fdad79ffbcbb4fa380dc9cf7dd108618` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:10.949790 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942668c5-2037-4514-a377-8e5b60ca89d9 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:10.955862 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e0b515-0aa6-4a52-b2ed-0ee2227330c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:10.956795 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e0b515-0aa6-4a52-b2ed-0ee2227330c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:10.957078 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e0b515-0aa6-4a52-b2ed-0ee2227330c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:10.957342 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e0b515-0aa6-4a52-b2ed-0ee2227330c1 admin admin] PATH_INFO: `/v3/projects/8bfbcafcbbb146d5a4b79d249c45e756/users/de220ec24fa9417db0bd62e4b712ce47/roles/fdad79ffbcbb4fa380dc9cf7dd108618` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:10.967130 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:20:10.978729 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346b79a6-3238-4915-8bff-3820999bed83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dbe3f343119e4f10828c98ef17e8da5c, user_id=b3da9d7af0fd4c1d99973e6b277b16d2, role_id=fdad79ffbcbb4fa380dc9cf7dd108618)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:10.985592 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346b79a6-3238-4915-8bff-3820999bed83 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:10.994668 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e0b515-0aa6-4a52-b2ed-0ee2227330c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8bfbcafcbbb146d5a4b79d249c45e756, user_id=de220ec24fa9417db0bd62e4b712ce47, role_id=fdad79ffbcbb4fa380dc9cf7dd108618)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:11.006213 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e0b515-0aa6-4a52-b2ed-0ee2227330c1 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:11.016464 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 798/1611] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 00:20:10 2022] PUT /identity/v3/projects/dbe3f343119e4f10828c98ef17e8da5c/users/b3da9d7af0fd4c1d99973e6b277b16d2/roles/fdad79ffbcbb4fa380dc9cf7dd108618 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:20:11.017470 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346b79a6-3238-4915-8bff-3820999bed83 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:11.041086 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 814/1612] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 00:20:10 2022] PUT /identity/v3/projects/8bfbcafcbbb146d5a4b79d249c45e756/users/de220ec24fa9417db0bd62e4b712ce47/roles/fdad79ffbcbb4fa380dc9cf7dd108618 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:20:11.045812 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e0b515-0aa6-4a52-b2ed-0ee2227330c1 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:11.111967 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346b79a6-3238-4915-8bff-3820999bed83 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:11.223448 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09956007-345c-4c2f-b152-846e9d218944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:11.224430 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09956007-345c-4c2f-b152-846e9d218944 admin admin] REQUEST_METHOD: `PUT` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:11.224879 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09956007-345c-4c2f-b152-846e9d218944 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:11.226670 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09956007-345c-4c2f-b152-846e9d218944 admin admin] PATH_INFO: `/v3/projects/af873e6a013c457aa2407fb24423ddc1/users/f8ffd2d3c0c141118a7a9a5696c383e1/roles/fdad79ffbcbb4fa380dc9cf7dd108618` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:11.258653 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e0b515-0aa6-4a52-b2ed-0ee2227330c1 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:11.265982 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3134fb-4f2e-4704-8867-d8d147f3535d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:11.267396 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3134fb-4f2e-4704-8867-d8d147f3535d admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:11.267782 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3134fb-4f2e-4704-8867-d8d147f3535d admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:11.268262 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3134fb-4f2e-4704-8867-d8d147f3535d admin admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:11.269039 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3134fb-4f2e-4704-8867-d8d147f3535d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:11.271495 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3134fb-4f2e-4704-8867-d8d147f3535d admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:11.273777 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09956007-345c-4c2f-b152-846e9d218944 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af873e6a013c457aa2407fb24423ddc1, user_id=f8ffd2d3c0c141118a7a9a5696c383e1, role_id=fdad79ffbcbb4fa380dc9cf7dd108618)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:11.275781 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:20:11.279127 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09956007-345c-4c2f-b152-846e9d218944 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:11.303706 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 815/1613] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 00:20:11 2022] GET /identity/v3/roles => generated 1420 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:20:11.306578 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3134fb-4f2e-4704-8867-d8d147f3535d admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:11.320565 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 799/1614] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 00:20:11 2022] PUT /identity/v3/projects/af873e6a013c457aa2407fb24423ddc1/users/f8ffd2d3c0c141118a7a9a5696c383e1/roles/fdad79ffbcbb4fa380dc9cf7dd108618 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:20:11.322002 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09956007-345c-4c2f-b152-846e9d218944 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:11.332441 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3134fb-4f2e-4704-8867-d8d147f3535d admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:11.436488 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09956007-345c-4c2f-b152-846e9d218944 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:11.452228 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5caba8aa-8ee8-411e-9ccf-a6f918dc60ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'daae792cd11d4c4ca7aae0558998aced', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:11.457491 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caba8aa-8ee8-411e-9ccf-a6f918dc60ff service neutron] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:11.457491 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caba8aa-8ee8-411e-9ccf-a6f918dc60ff service neutron] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:11.463439 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caba8aa-8ee8-411e-9ccf-a6f918dc60ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:11.522512 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116e6df9-4fb5-4d06-92f2-d93724577043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:11.523237 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116e6df9-4fb5-4d06-92f2-d93724577043 admin admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:11.523527 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116e6df9-4fb5-4d06-92f2-d93724577043 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:11.526853 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116e6df9-4fb5-4d06-92f2-d93724577043 admin admin] PATH_INFO: `/v3/users` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:11.526853 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116e6df9-4fb5-4d06-92f2-d93724577043 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:11.531815 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116e6df9-4fb5-4d06-92f2-d93724577043 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:11.558760 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:20:11.604974 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 816/1615] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 31 00:20:11 2022] POST /identity/v3/users => generated 309 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:20:11.608264 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f5e2d7-0e04-42c2-8111-907531096558 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:11.609575 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f5e2d7-0e04-42c2-8111-907531096558 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:11.614682 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f5e2d7-0e04-42c2-8111-907531096558 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:11.689473 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5caba8aa-8ee8-411e-9ccf-a6f918dc60ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:11.693651 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5caba8aa-8ee8-411e-9ccf-a6f918dc60ff service neutron] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:11.705878 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-53f5e2d7-0e04-42c2-8111-907531096558 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:20:11.707142 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-53f5e2d7-0e04-42c2-8111-907531096558 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:11.728250 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 800/1616] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:20:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:20:11.731008 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9e787e-aed2-4cca-ba0e-9e01c6874b7e None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:11.731487 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9e787e-aed2-4cca-ba0e-9e01c6874b7e None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:11.733171 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9e787e-aed2-4cca-ba0e-9e01c6874b7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:11.748445 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 817/1617] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:20:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:20:11.749519 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f5e2d7-0e04-42c2-8111-907531096558 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:11.795847 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f5e2d7-0e04-42c2-8111-907531096558 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:11.805889 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de7ecb9-14a3-4410-91c3-6db0b1002a2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:11.806705 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de7ecb9-14a3-4410-91c3-6db0b1002a2c admin admin] REQUEST_METHOD: `PUT` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:11.807009 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de7ecb9-14a3-4410-91c3-6db0b1002a2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:11.807474 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de7ecb9-14a3-4410-91c3-6db0b1002a2c admin admin] PATH_INFO: `/v3/projects/d77c09bb9c6d4635acffe542e7e9bbf5/users/5a08dd8a491c414ab4763fe3d2bfd1c2/roles/12f6817f9aaa4e2bb477095a6bed5d0f` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:11.822086 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-1e9e787e-aed2-4cca-ba0e-9e01c6874b7e None None] MFA Rules not processed for user `de220ec24fa9417db0bd62e4b712ce47`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:20:11.826090 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-1e9e787e-aed2-4cca-ba0e-9e01c6874b7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:11.846370 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de7ecb9-14a3-4410-91c3-6db0b1002a2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d77c09bb9c6d4635acffe542e7e9bbf5, user_id=5a08dd8a491c414ab4763fe3d2bfd1c2, role_id=12f6817f9aaa4e2bb477095a6bed5d0f)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:11.852622 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de7ecb9-14a3-4410-91c3-6db0b1002a2c admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:11.886294 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 818/1618] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 00:20:11 2022] PUT /identity/v3/projects/d77c09bb9c6d4635acffe542e7e9bbf5/users/5a08dd8a491c414ab4763fe3d2bfd1c2/roles/12f6817f9aaa4e2bb477095a6bed5d0f => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:20:11.886294 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23228adb-f164-43fc-9afe-947eab0fff2a None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:11.886294 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23228adb-f164-43fc-9afe-947eab0fff2a None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:11.886294 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23228adb-f164-43fc-9afe-947eab0fff2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:11.957447 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-23228adb-f164-43fc-9afe-947eab0fff2a None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:20:11.966065 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-23228adb-f164-43fc-9afe-947eab0fff2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:12.059386 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 801/1619] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:20:11 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 330 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:20:12.063642 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9e787e-aed2-4cca-ba0e-9e01c6874b7e None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:12.090899 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9e787e-aed2-4cca-ba0e-9e01c6874b7e None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:12.148525 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 819/1620] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:20:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:20:12.149662 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23228adb-f164-43fc-9afe-947eab0fff2a None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:12.246250 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364637e0-0beb-4f91-bd88-1c24b7e2c261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:12.247345 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364637e0-0beb-4f91-bd88-1c24b7e2c261 admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:12.249732 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364637e0-0beb-4f91-bd88-1c24b7e2c261 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:12.250213 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364637e0-0beb-4f91-bd88-1c24b7e2c261 admin admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:12.251092 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364637e0-0beb-4f91-bd88-1c24b7e2c261 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:12.255051 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364637e0-0beb-4f91-bd88-1c24b7e2c261 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:12.290560 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 802/1621] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 00:20:12 2022] GET /identity/v3/roles => generated 1420 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:20:12.291168 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23228adb-f164-43fc-9afe-947eab0fff2a None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:12.291661 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364637e0-0beb-4f91-bd88-1c24b7e2c261 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:12.304254 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db0abb2-adbd-4c4f-a0c8-bcd434862ed6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'daae792cd11d4c4ca7aae0558998aced', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:12.304908 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db0abb2-adbd-4c4f-a0c8-bcd434862ed6 service neutron] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:12.305201 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db0abb2-adbd-4c4f-a0c8-bcd434862ed6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:12.305478 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db0abb2-adbd-4c4f-a0c8-bcd434862ed6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:12.321126 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364637e0-0beb-4f91-bd88-1c24b7e2c261 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:12.323243 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db0abb2-adbd-4c4f-a0c8-bcd434862ed6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:12.325026 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db0abb2-adbd-4c4f-a0c8-bcd434862ed6 service neutron] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:12.335314 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff741cad-49f8-4087-a9b6-f9fe9105fcc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:12.336011 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff741cad-49f8-4087-a9b6-f9fe9105fcc4 admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:12.336377 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff741cad-49f8-4087-a9b6-f9fe9105fcc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:12.336692 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff741cad-49f8-4087-a9b6-f9fe9105fcc4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:12.340960 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:20:12.341552 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff741cad-49f8-4087-a9b6-f9fe9105fcc4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:12.346433 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff741cad-49f8-4087-a9b6-f9fe9105fcc4 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:12.351624 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 820/1622] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:20:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:20:12.352780 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db0abb2-adbd-4c4f-a0c8-bcd434862ed6 service neutron] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:12.380026 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 803/1623] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 00:20:12 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:20:12.385099 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff741cad-49f8-4087-a9b6-f9fe9105fcc4 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:12.387685 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db0abb2-adbd-4c4f-a0c8-bcd434862ed6 service neutron] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:12.396692 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd66c92-ce4d-43d6-92d4-9c865614f75c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:12.398318 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd66c92-ce4d-43d6-92d4-9c865614f75c admin admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:12.398612 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd66c92-ce4d-43d6-92d4-9c865614f75c admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:12.398897 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd66c92-ce4d-43d6-92d4-9c865614f75c admin admin] PATH_INFO: `/v3/projects` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:12.399707 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd66c92-ce4d-43d6-92d4-9c865614f75c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:12.402200 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd66c92-ce4d-43d6-92d4-9c865614f75c admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:12.414763 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff741cad-49f8-4087-a9b6-f9fe9105fcc4 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:12.428147 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc417aa-7932-4c0f-a8ed-b7f50265b76d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'daae792cd11d4c4ca7aae0558998aced', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:12.432486 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc417aa-7932-4c0f-a8ed-b7f50265b76d service neutron] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:12.434766 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc417aa-7932-4c0f-a8ed-b7f50265b76d service neutron] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:12.435933 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc417aa-7932-4c0f-a8ed-b7f50265b76d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:12.471140 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 821/1624] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 31 00:20:12 2022] POST /identity/v3/projects => generated 387 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:20:12.472753 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd66c92-ce4d-43d6-92d4-9c865614f75c admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:12.480827 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc417aa-7932-4c0f-a8ed-b7f50265b76d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:12.488323 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc417aa-7932-4c0f-a8ed-b7f50265b76d service neutron] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:12.528828 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 804/1625] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:20:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:20:12.530038 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc417aa-7932-4c0f-a8ed-b7f50265b76d service neutron] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:12.552703 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc417aa-7932-4c0f-a8ed-b7f50265b76d service neutron] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:12.616887 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd66c92-ce4d-43d6-92d4-9c865614f75c admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:12.628766 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2aa189-a8e1-405a-a823-886e994f6ce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:12.629475 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2aa189-a8e1-405a-a823-886e994f6ce4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:12.629754 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2aa189-a8e1-405a-a823-886e994f6ce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:12.630042 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2aa189-a8e1-405a-a823-886e994f6ce4 admin admin] PATH_INFO: `/v3/projects/31459d2156ed401aa1326bc6b6ce0162/users/93b1ce6d369f42f099205e50b06f0b95/roles/12f6817f9aaa4e2bb477095a6bed5d0f` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:12.659266 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:20:12.673823 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2aa189-a8e1-405a-a823-886e994f6ce4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=31459d2156ed401aa1326bc6b6ce0162, user_id=93b1ce6d369f42f099205e50b06f0b95, role_id=12f6817f9aaa4e2bb477095a6bed5d0f)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:12.681339 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2aa189-a8e1-405a-a823-886e994f6ce4 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:12.723684 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 822/1626] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 00:20:12 2022] PUT /identity/v3/projects/31459d2156ed401aa1326bc6b6ce0162/users/93b1ce6d369f42f099205e50b06f0b95/roles/12f6817f9aaa4e2bb477095a6bed5d0f => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:20:12.727007 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2aa189-a8e1-405a-a823-886e994f6ce4 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:12.759711 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24d6386-7cca-4f28-8c31-99cc2897b1bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:12.762935 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24d6386-7cca-4f28-8c31-99cc2897b1bf admin admin] REQUEST_METHOD: `PUT` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:12.763956 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24d6386-7cca-4f28-8c31-99cc2897b1bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:12.764893 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24d6386-7cca-4f28-8c31-99cc2897b1bf admin admin] PATH_INFO: `/v3/projects/d77c09bb9c6d4635acffe542e7e9bbf5/users/5a08dd8a491c414ab4763fe3d2bfd1c2/roles/12f6817f9aaa4e2bb477095a6bed5d0f` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:12.770148 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24d6386-7cca-4f28-8c31-99cc2897b1bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=d77c09bb9c6d4635acffe542e7e9bbf5, user_id=5a08dd8a491c414ab4763fe3d2bfd1c2, role_id=12f6817f9aaa4e2bb477095a6bed5d0f)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:12.777613 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24d6386-7cca-4f28-8c31-99cc2897b1bf admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:12.813527 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 805/1627] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 00:20:12 2022] PUT /identity/v3/projects/d77c09bb9c6d4635acffe542e7e9bbf5/users/5a08dd8a491c414ab4763fe3d2bfd1c2/roles/12f6817f9aaa4e2bb477095a6bed5d0f => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:20:12.818115 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24d6386-7cca-4f28-8c31-99cc2897b1bf admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:12.955638 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2aa189-a8e1-405a-a823-886e994f6ce4 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:13.012336 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24d6386-7cca-4f28-8c31-99cc2897b1bf admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:13.042917 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdbfa6f-c8e3-435f-bc90-c156ceb9f81d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:13.043987 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdbfa6f-c8e3-435f-bc90-c156ceb9f81d admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:13.044511 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdbfa6f-c8e3-435f-bc90-c156ceb9f81d admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:13.044996 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdbfa6f-c8e3-435f-bc90-c156ceb9f81d admin admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:13.045975 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdbfa6f-c8e3-435f-bc90-c156ceb9f81d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:13.049496 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdbfa6f-c8e3-435f-bc90-c156ceb9f81d admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:13.083313 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 806/1628] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 00:20:12 2022] GET /identity/v3/roles => generated 1420 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:20:13.089120 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d10436-e3b7-48cd-80e1-652722269457 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:13.089804 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d10436-e3b7-48cd-80e1-652722269457 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:13.090295 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d10436-e3b7-48cd-80e1-652722269457 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:13.167287 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283e64e5-7ad5-45fd-bb64-7d6d8d3cacdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:13.168455 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283e64e5-7ad5-45fd-bb64-7d6d8d3cacdf admin admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:13.169236 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283e64e5-7ad5-45fd-bb64-7d6d8d3cacdf admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:13.169749 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283e64e5-7ad5-45fd-bb64-7d6d8d3cacdf admin admin] PATH_INFO: `/v3/users` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:13.170641 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-37d10436-e3b7-48cd-80e1-652722269457 None None] MFA Rules not processed for user `5a08dd8a491c414ab4763fe3d2bfd1c2`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:20:13.170951 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283e64e5-7ad5-45fd-bb64-7d6d8d3cacdf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:13.172687 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-37d10436-e3b7-48cd-80e1-652722269457 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:13.174849 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283e64e5-7ad5-45fd-bb64-7d6d8d3cacdf admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:13.213218 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:20:13.238544 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 823/1629] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 31 00:20:12 2022] POST /identity/v3/users => generated 300 bytes in 514 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:20:13.240356 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283e64e5-7ad5-45fd-bb64-7d6d8d3cacdf admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:13.279904 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283e64e5-7ad5-45fd-bb64-7d6d8d3cacdf admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:13.291908 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f87fba-41c5-4777-bcc6-a2e70ea1b8f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:13.293138 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f87fba-41c5-4777-bcc6-a2e70ea1b8f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:13.293676 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f87fba-41c5-4777-bcc6-a2e70ea1b8f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:13.294501 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f87fba-41c5-4777-bcc6-a2e70ea1b8f5 admin admin] PATH_INFO: `/v3/projects/31459d2156ed401aa1326bc6b6ce0162/users/93b1ce6d369f42f099205e50b06f0b95/roles/12f6817f9aaa4e2bb477095a6bed5d0f` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:13.300025 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f87fba-41c5-4777-bcc6-a2e70ea1b8f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=31459d2156ed401aa1326bc6b6ce0162, user_id=93b1ce6d369f42f099205e50b06f0b95, role_id=12f6817f9aaa4e2bb477095a6bed5d0f)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:13.312446 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f87fba-41c5-4777-bcc6-a2e70ea1b8f5 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:13.345221 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 824/1630] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 00:20:13 2022] PUT /identity/v3/projects/31459d2156ed401aa1326bc6b6ce0162/users/93b1ce6d369f42f099205e50b06f0b95/roles/12f6817f9aaa4e2bb477095a6bed5d0f => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:20:13.369429 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f87fba-41c5-4777-bcc6-a2e70ea1b8f5 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:13.373229 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 807/1631] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:20:13 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:20:13.374831 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e8449e-b661-42eb-ae74-606fdb930c19 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:13.375229 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e8449e-b661-42eb-ae74-606fdb930c19 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:13.375513 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e8449e-b661-42eb-ae74-606fdb930c19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:13.442949 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-48e8449e-b661-42eb-ae74-606fdb930c19 None None] MFA Rules not processed for user `93b1ce6d369f42f099205e50b06f0b95`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:20:13.448527 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-48e8449e-b661-42eb-ae74-606fdb930c19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:13.530541 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:20:13.573739 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f87fba-41c5-4777-bcc6-a2e70ea1b8f5 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:13.595188 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8d406b-f33b-4c74-8d93-8c66c2120a53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:13.596985 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8d406b-f33b-4c74-8d93-8c66c2120a53 admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:13.597292 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8d406b-f33b-4c74-8d93-8c66c2120a53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:13.597564 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8d406b-f33b-4c74-8d93-8c66c2120a53 admin admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:13.598254 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8d406b-f33b-4c74-8d93-8c66c2120a53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:13.603907 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8d406b-f33b-4c74-8d93-8c66c2120a53 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:13.626738 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 808/1632] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:20:13 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:20:13.627969 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e8449e-b661-42eb-ae74-606fdb930c19 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:13.641040 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 825/1633] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 00:20:13 2022] GET /identity/v3/roles => generated 1420 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:20:13.644267 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8d406b-f33b-4c74-8d93-8c66c2120a53 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:13.676708 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8d406b-f33b-4c74-8d93-8c66c2120a53 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:13.691797 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28980975-96b6-45e6-8640-8d68b0675e7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:13.692525 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28980975-96b6-45e6-8640-8d68b0675e7b admin admin] REQUEST_METHOD: `PUT` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:13.692802 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28980975-96b6-45e6-8640-8d68b0675e7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:13.695124 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28980975-96b6-45e6-8640-8d68b0675e7b admin admin] PATH_INFO: `/v3/projects/814f03ef8b864f54b54b11cf60865ff9/users/93b2c0f58c0548278e1c86c69e879db0/roles/12f6817f9aaa4e2bb477095a6bed5d0f` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:13.750792 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28980975-96b6-45e6-8640-8d68b0675e7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=814f03ef8b864f54b54b11cf60865ff9, user_id=93b2c0f58c0548278e1c86c69e879db0, role_id=12f6817f9aaa4e2bb477095a6bed5d0f)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:13.759339 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28980975-96b6-45e6-8640-8d68b0675e7b admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:13.827190 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 826/1634] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 00:20:13 2022] PUT /identity/v3/projects/814f03ef8b864f54b54b11cf60865ff9/users/93b2c0f58c0548278e1c86c69e879db0/roles/12f6817f9aaa4e2bb477095a6bed5d0f => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:20:13.830158 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28980975-96b6-45e6-8640-8d68b0675e7b admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:13.849354 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e8449e-b661-42eb-ae74-606fdb930c19 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:13.985595 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21baf47-6ffe-4762-b868-f5d5929c5540 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beecda6e9feb400288618745c784989f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:13.985595 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21baf47-6ffe-4762-b868-f5d5929c5540 service cinder] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:13.985595 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21baf47-6ffe-4762-b868-f5d5929c5540 service cinder] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:13.985595 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21baf47-6ffe-4762-b868-f5d5929c5540 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:14.034077 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28980975-96b6-45e6-8640-8d68b0675e7b admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:14.047676 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc542a98-4394-46c1-be8e-e78cac2b5ec7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beecda6e9feb400288618745c784989f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:14.048743 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc542a98-4394-46c1-be8e-e78cac2b5ec7 service cinder] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:14.049223 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc542a98-4394-46c1-be8e-e78cac2b5ec7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:14.049667 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc542a98-4394-46c1-be8e-e78cac2b5ec7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:14.149659 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21baf47-6ffe-4762-b868-f5d5929c5540 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:14.154203 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21baf47-6ffe-4762-b868-f5d5929c5540 service cinder] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:14.182735 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 809/1635] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:20:13 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 556 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:20:14.184275 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21baf47-6ffe-4762-b868-f5d5929c5540 service cinder] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:14.244342 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc542a98-4394-46c1-be8e-e78cac2b5ec7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:14.245849 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc542a98-4394-46c1-be8e-e78cac2b5ec7 service cinder] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:14.284144 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 827/1636] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:20:13 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:20:14.374669 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:20:14.464234 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21baf47-6ffe-4762-b868-f5d5929c5540 service cinder] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:14.483500 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1348fb-c6a5-4614-a7e9-570e1ff1221c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:14.485244 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1348fb-c6a5-4614-a7e9-570e1ff1221c admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:14.485903 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1348fb-c6a5-4614-a7e9-570e1ff1221c admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:14.501336 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1348fb-c6a5-4614-a7e9-570e1ff1221c admin admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:14.505016 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1348fb-c6a5-4614-a7e9-570e1ff1221c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:14.526490 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1348fb-c6a5-4614-a7e9-570e1ff1221c admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:14.561445 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 810/1637] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 00:20:14 2022] GET /identity/v3/roles => generated 1420 bytes in 378 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:20:14.565607 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc542a98-4394-46c1-be8e-e78cac2b5ec7 service cinder] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:14.574082 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:20:14.585974 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc542a98-4394-46c1-be8e-e78cac2b5ec7 service cinder] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:14.603269 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232bd817-c7b9-4536-9a77-14c7f6cf9069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:14.604034 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232bd817-c7b9-4536-9a77-14c7f6cf9069 admin admin] REQUEST_METHOD: `PUT` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:14.604352 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232bd817-c7b9-4536-9a77-14c7f6cf9069 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:14.604697 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232bd817-c7b9-4536-9a77-14c7f6cf9069 admin admin] PATH_INFO: `/v3/projects/814f03ef8b864f54b54b11cf60865ff9/users/93b2c0f58c0548278e1c86c69e879db0/roles/12f6817f9aaa4e2bb477095a6bed5d0f` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:14.608591 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232bd817-c7b9-4536-9a77-14c7f6cf9069 admin admin] RBAC: Authorizing `identity:create_grant(project_id=814f03ef8b864f54b54b11cf60865ff9, user_id=93b2c0f58c0548278e1c86c69e879db0, role_id=12f6817f9aaa4e2bb477095a6bed5d0f)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:14.614439 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232bd817-c7b9-4536-9a77-14c7f6cf9069 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:14.670913 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 828/1638] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 00:20:14 2022] PUT /identity/v3/projects/814f03ef8b864f54b54b11cf60865ff9/users/93b2c0f58c0548278e1c86c69e879db0/roles/12f6817f9aaa4e2bb477095a6bed5d0f => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:20:14.683328 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02b44b6-027b-4f75-8d0a-1bb1a5301d9e None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:14.683945 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02b44b6-027b-4f75-8d0a-1bb1a5301d9e None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:14.684564 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02b44b6-027b-4f75-8d0a-1bb1a5301d9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:14.776101 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232bd817-c7b9-4536-9a77-14c7f6cf9069 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:14.864610 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-d02b44b6-027b-4f75-8d0a-1bb1a5301d9e None None] MFA Rules not processed for user `93b2c0f58c0548278e1c86c69e879db0`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:20:14.870647 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-d02b44b6-027b-4f75-8d0a-1bb1a5301d9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:15.181781 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 811/1639] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:20:14 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 510 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:20:15.210694 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02b44b6-027b-4f75-8d0a-1bb1a5301d9e None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:15.233546 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232bd817-c7b9-4536-9a77-14c7f6cf9069 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:15.242300 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64895b48-23b1-4079-971a-b5045b3cf4ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:15.243603 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64895b48-23b1-4079-971a-b5045b3cf4ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:15.244229 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64895b48-23b1-4079-971a-b5045b3cf4ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:15.244888 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64895b48-23b1-4079-971a-b5045b3cf4ff admin admin] PATH_INFO: `/v3/users/bb16f5a85246405fafb16c5338bf6907` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:15.247029 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64895b48-23b1-4079-971a-b5045b3cf4ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb16f5a85246405fafb16c5338bf6907)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:15.259685 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: WARNING py.warnings [None req-64895b48-23b1-4079-971a-b5045b3cf4ff admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 00:20:15.259685 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: warnings.warn(msg) Aug 31 00:20:15.259685 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: Aug 31 00:20:15.262687 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64895b48-23b1-4079-971a-b5045b3cf4ff admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:15.467265 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02b44b6-027b-4f75-8d0a-1bb1a5301d9e None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:15.487883 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799949ac-13ad-40cb-9252-1ffd42e1593e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beecda6e9feb400288618745c784989f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:15.490119 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799949ac-13ad-40cb-9252-1ffd42e1593e service cinder] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:15.490272 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-64895b48-23b1-4079-971a-b5045b3cf4ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb16f5a85246405fafb16c5338bf6907'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:15.490843 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799949ac-13ad-40cb-9252-1ffd42e1593e service cinder] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:15.492947 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799949ac-13ad-40cb-9252-1ffd42e1593e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:15.518323 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799949ac-13ad-40cb-9252-1ffd42e1593e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:15.520360 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799949ac-13ad-40cb-9252-1ffd42e1593e service cinder] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:15.549030 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-64895b48-23b1-4079-971a-b5045b3cf4ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb16f5a85246405fafb16c5338bf6907'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:15.557214 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 812/1640] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:20:15 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:20:15.572945 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-64895b48-23b1-4079-971a-b5045b3cf4ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb16f5a85246405fafb16c5338bf6907'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:15.574149 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-64895b48-23b1-4079-971a-b5045b3cf4ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb16f5a85246405fafb16c5338bf6907'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:15.663523 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799949ac-13ad-40cb-9252-1ffd42e1593e service cinder] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:15.682850 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-64895b48-23b1-4079-971a-b5045b3cf4ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb16f5a85246405fafb16c5338bf6907'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:15.686046 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799949ac-13ad-40cb-9252-1ffd42e1593e service cinder] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:15.700341 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 829/1641] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 31 00:20:14 2022] DELETE /identity/v3/users/bb16f5a85246405fafb16c5338bf6907 => generated 0 bytes in 926 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:20:15.706588 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6910d63-9fd8-42dd-880a-089403dacd69 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:15.706923 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb33d435-d7e8-4a0c-aa94-2de6d2bc9a7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:15.707549 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb33d435-d7e8-4a0c-aa94-2de6d2bc9a7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:15.707864 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb33d435-d7e8-4a0c-aa94-2de6d2bc9a7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:15.708099 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb33d435-d7e8-4a0c-aa94-2de6d2bc9a7f admin admin] PATH_INFO: `/v3/users/de220ec24fa9417db0bd62e4b712ce47` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:15.708832 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6910d63-9fd8-42dd-880a-089403dacd69 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:15.709695 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6910d63-9fd8-42dd-880a-089403dacd69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:15.712381 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb33d435-d7e8-4a0c-aa94-2de6d2bc9a7f admin admin] RBAC: Authorizing `identity:delete_user(user_id=de220ec24fa9417db0bd62e4b712ce47)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:15.743226 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb33d435-d7e8-4a0c-aa94-2de6d2bc9a7f admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:15.843809 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-f6910d63-9fd8-42dd-880a-089403dacd69 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:20:15.858767 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-f6910d63-9fd8-42dd-880a-089403dacd69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:16.059807 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-fb33d435-d7e8-4a0c-aa94-2de6d2bc9a7f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de220ec24fa9417db0bd62e4b712ce47'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:16.081065 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-fb33d435-d7e8-4a0c-aa94-2de6d2bc9a7f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de220ec24fa9417db0bd62e4b712ce47'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:16.091265 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:20:16.106344 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-fb33d435-d7e8-4a0c-aa94-2de6d2bc9a7f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de220ec24fa9417db0bd62e4b712ce47'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:16.155273 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-fb33d435-d7e8-4a0c-aa94-2de6d2bc9a7f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de220ec24fa9417db0bd62e4b712ce47'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:16.156297 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-fb33d435-d7e8-4a0c-aa94-2de6d2bc9a7f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de220ec24fa9417db0bd62e4b712ce47'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:16.176346 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 813/1642] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 31 00:20:15 2022] DELETE /identity/v3/users/de220ec24fa9417db0bd62e4b712ce47 => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:20:16.181435 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7e6ec7-e13f-4ae7-9818-8816ef9bacab None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:16.181810 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7e6ec7-e13f-4ae7-9818-8816ef9bacab None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:16.182383 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7e6ec7-e13f-4ae7-9818-8816ef9bacab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:16.191920 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 830/1643] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:20:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 486 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:20:16.212184 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-4e7e6ec7-e13f-4ae7-9818-8816ef9bacab None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:20:16.213735 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-4e7e6ec7-e13f-4ae7-9818-8816ef9bacab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:16.246556 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6910d63-9fd8-42dd-880a-089403dacd69 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:16.250547 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-f6910d63-9fd8-42dd-880a-089403dacd69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:16.291544 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:20:16.404382 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 814/1644] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:20:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:20:16.425329 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6910d63-9fd8-42dd-880a-089403dacd69 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:16.541346 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7e6ec7-e13f-4ae7-9818-8816ef9bacab None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:16.669344 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7e6ec7-e13f-4ae7-9818-8816ef9bacab None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:16.673429 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811d4e2a-c6c4-4bc0-a4c6-835b7c4bca09 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'daae792cd11d4c4ca7aae0558998aced', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:16.674525 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811d4e2a-c6c4-4bc0-a4c6-835b7c4bca09 service neutron] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:16.674905 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811d4e2a-c6c4-4bc0-a4c6-835b7c4bca09 service neutron] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:16.675926 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811d4e2a-c6c4-4bc0-a4c6-835b7c4bca09 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:16.700268 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811d4e2a-c6c4-4bc0-a4c6-835b7c4bca09 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:16.703271 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811d4e2a-c6c4-4bc0-a4c6-835b7c4bca09 service neutron] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:16.736692 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 815/1645] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:20:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:20:16.770008 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe6c9e1-dcc7-402f-afee-c44fbf3eb0e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'daae792cd11d4c4ca7aae0558998aced', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:16.771038 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe6c9e1-dcc7-402f-afee-c44fbf3eb0e3 service neutron] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:16.771540 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe6c9e1-dcc7-402f-afee-c44fbf3eb0e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:16.772746 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe6c9e1-dcc7-402f-afee-c44fbf3eb0e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:16.808407 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe6c9e1-dcc7-402f-afee-c44fbf3eb0e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:16.823320 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe6c9e1-dcc7-402f-afee-c44fbf3eb0e3 service neutron] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:16.863984 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 831/1646] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:20:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 621 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:20:18.876032 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811d4e2a-c6c4-4bc0-a4c6-835b7c4bca09 service neutron] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:18.892960 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-811d4e2a-c6c4-4bc0-a4c6-835b7c4bca09 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:18.971707 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811d4e2a-c6c4-4bc0-a4c6-835b7c4bca09 service neutron] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:19.012469 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4adbf1-044a-4138-bbdb-95f4c2be5c34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:19.014247 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4adbf1-044a-4138-bbdb-95f4c2be5c34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:19.023733 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4adbf1-044a-4138-bbdb-95f4c2be5c34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:19.024207 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4adbf1-044a-4138-bbdb-95f4c2be5c34 admin admin] PATH_INFO: `/v3/projects/8bfbcafcbbb146d5a4b79d249c45e756` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:19.033621 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4adbf1-044a-4138-bbdb-95f4c2be5c34 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8bfbcafcbbb146d5a4b79d249c45e756)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:19.035583 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: WARNING py.warnings [None req-ad4adbf1-044a-4138-bbdb-95f4c2be5c34 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 00:20:19.035583 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: warnings.warn(msg) Aug 31 00:20:19.035583 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: Aug 31 00:20:19.038030 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4adbf1-044a-4138-bbdb-95f4c2be5c34 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:19.206300 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe6c9e1-dcc7-402f-afee-c44fbf3eb0e3 service neutron] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:19.210398 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-0fe6c9e1-dcc7-402f-afee-c44fbf3eb0e3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:19.261690 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-ad4adbf1-044a-4138-bbdb-95f4c2be5c34 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8bfbcafcbbb146d5a4b79d249c45e756', 'request_id': 'req-ad4adbf1-044a-4138-bbdb-95f4c2be5c34'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:19.269792 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe6c9e1-dcc7-402f-afee-c44fbf3eb0e3 service neutron] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:19.297374 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-ad4adbf1-044a-4138-bbdb-95f4c2be5c34 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8bfbcafcbbb146d5a4b79d249c45e756', 'request_id': 'req-ad4adbf1-044a-4138-bbdb-95f4c2be5c34'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:19.315812 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-ad4adbf1-044a-4138-bbdb-95f4c2be5c34 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8bfbcafcbbb146d5a4b79d249c45e756', 'request_id': 'req-ad4adbf1-044a-4138-bbdb-95f4c2be5c34'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:19.362386 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-ad4adbf1-044a-4138-bbdb-95f4c2be5c34 admin admin] The token cache is being invalidate because project 8bfbcafcbbb146d5a4b79d249c45e756 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81523) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:20:19.363166 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-ad4adbf1-044a-4138-bbdb-95f4c2be5c34 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:19.367341 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-ad4adbf1-044a-4138-bbdb-95f4c2be5c34 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:19.371123 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 816/1647] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 31 00:20:18 2022] DELETE /identity/v3/projects/8bfbcafcbbb146d5a4b79d249c45e756 => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:20:19.376323 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4adbf1-044a-4138-bbdb-95f4c2be5c34 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:19.378404 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-ad4adbf1-044a-4138-bbdb-95f4c2be5c34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:19.404787 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:20:19.476304 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6d7aa4-1eba-47dc-87c8-d731c437c2fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:19.477404 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6d7aa4-1eba-47dc-87c8-d731c437c2fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:19.478011 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6d7aa4-1eba-47dc-87c8-d731c437c2fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:19.478675 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6d7aa4-1eba-47dc-87c8-d731c437c2fb admin admin] PATH_INFO: `/v3/projects/eef77c3c5d6646a0a72600ebee4ad7cc` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:19.480571 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6d7aa4-1eba-47dc-87c8-d731c437c2fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=eef77c3c5d6646a0a72600ebee4ad7cc)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:19.483526 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6d7aa4-1eba-47dc-87c8-d731c437c2fb admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:19.564982 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4adbf1-044a-4138-bbdb-95f4c2be5c34 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:19.571309 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-0a6d7aa4-1eba-47dc-87c8-d731c437c2fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eef77c3c5d6646a0a72600ebee4ad7cc', 'request_id': 'req-0a6d7aa4-1eba-47dc-87c8-d731c437c2fb'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:19.580362 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-0a6d7aa4-1eba-47dc-87c8-d731c437c2fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eef77c3c5d6646a0a72600ebee4ad7cc', 'request_id': 'req-0a6d7aa4-1eba-47dc-87c8-d731c437c2fb'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:19.590119 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-0a6d7aa4-1eba-47dc-87c8-d731c437c2fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eef77c3c5d6646a0a72600ebee4ad7cc', 'request_id': 'req-0a6d7aa4-1eba-47dc-87c8-d731c437c2fb'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:19.605272 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:20:19.612894 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-0a6d7aa4-1eba-47dc-87c8-d731c437c2fb admin admin] The token cache is being invalidate because project eef77c3c5d6646a0a72600ebee4ad7cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:20:19.613196 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-0a6d7aa4-1eba-47dc-87c8-d731c437c2fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:19.615788 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-0a6d7aa4-1eba-47dc-87c8-d731c437c2fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:19.620633 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 832/1648] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 31 00:20:19 2022] DELETE /identity/v3/projects/eef77c3c5d6646a0a72600ebee4ad7cc => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:20:19.624465 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d845bcc3-e84f-4d5a-87e5-3a7b25cadf71 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:19.624802 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d845bcc3-e84f-4d5a-87e5-3a7b25cadf71 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:19.625097 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d845bcc3-e84f-4d5a-87e5-3a7b25cadf71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:19.667316 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-d845bcc3-e84f-4d5a-87e5-3a7b25cadf71 None None] MFA Rules not processed for user `bc018a253e0a4b0bb96097ce4cc72c21`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:20:19.668652 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-d845bcc3-e84f-4d5a-87e5-3a7b25cadf71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:19.713321 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f042f1-2e0a-4075-9091-cb3b45b4b7e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:19.715611 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f042f1-2e0a-4075-9091-cb3b45b4b7e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:19.716626 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f042f1-2e0a-4075-9091-cb3b45b4b7e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:19.717295 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f042f1-2e0a-4075-9091-cb3b45b4b7e5 admin admin] PATH_INFO: `/v3/users/93b2c0f58c0548278e1c86c69e879db0` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:19.722075 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f042f1-2e0a-4075-9091-cb3b45b4b7e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=93b2c0f58c0548278e1c86c69e879db0)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:19.727633 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f042f1-2e0a-4075-9091-cb3b45b4b7e5 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:19.797135 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 833/1649] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:20:19 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:20:19.813946 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d845bcc3-e84f-4d5a-87e5-3a7b25cadf71 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:19.817088 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-d845bcc3-e84f-4d5a-87e5-3a7b25cadf71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:19.823269 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-18f042f1-2e0a-4075-9091-cb3b45b4b7e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '93b2c0f58c0548278e1c86c69e879db0'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:19.838614 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-18f042f1-2e0a-4075-9091-cb3b45b4b7e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '93b2c0f58c0548278e1c86c69e879db0'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:19.852174 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d845bcc3-e84f-4d5a-87e5-3a7b25cadf71 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:19.857119 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-18f042f1-2e0a-4075-9091-cb3b45b4b7e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '93b2c0f58c0548278e1c86c69e879db0'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:19.864001 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e9c57d-ed3f-471f-ac24-34d82ff54b97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:19.865361 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e9c57d-ed3f-471f-ac24-34d82ff54b97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:19.867705 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e9c57d-ed3f-471f-ac24-34d82ff54b97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:19.867911 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e9c57d-ed3f-471f-ac24-34d82ff54b97 admin admin] PATH_INFO: `/v3/users/93b1ce6d369f42f099205e50b06f0b95` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:19.871311 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e9c57d-ed3f-471f-ac24-34d82ff54b97 admin admin] RBAC: Authorizing `identity:delete_user(user_id=93b1ce6d369f42f099205e50b06f0b95)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:19.875653 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e9c57d-ed3f-471f-ac24-34d82ff54b97 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:19.887419 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-18f042f1-2e0a-4075-9091-cb3b45b4b7e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '93b2c0f58c0548278e1c86c69e879db0'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:19.889150 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-18f042f1-2e0a-4075-9091-cb3b45b4b7e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '93b2c0f58c0548278e1c86c69e879db0'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:19.902140 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 817/1650] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 31 00:20:19 2022] DELETE /identity/v3/users/93b2c0f58c0548278e1c86c69e879db0 => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:20:19.903930 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c499f6-750a-4b85-88ca-e968f623cc0c None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:19.921824 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c499f6-750a-4b85-88ca-e968f623cc0c None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:19.922508 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c499f6-750a-4b85-88ca-e968f623cc0c None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:19.926708 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 818/1651] 10.222.0.47 () {54 vars in 962 bytes} [Wed Aug 31 00:20:19 2022] GET /identity => generated 270 bytes in 23 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:20:19.936355 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209e1b3b-1a29-4c8e-a903-a24f9ee250dc None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:19.938465 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209e1b3b-1a29-4c8e-a903-a24f9ee250dc None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:19.941192 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209e1b3b-1a29-4c8e-a903-a24f9ee250dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:19.999832 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-17e9c57d-ed3f-471f-ac24-34d82ff54b97 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '93b1ce6d369f42f099205e50b06f0b95'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:20.011804 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-17e9c57d-ed3f-471f-ac24-34d82ff54b97 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '93b1ce6d369f42f099205e50b06f0b95'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:20.029287 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-17e9c57d-ed3f-471f-ac24-34d82ff54b97 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '93b1ce6d369f42f099205e50b06f0b95'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:20.030850 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-17e9c57d-ed3f-471f-ac24-34d82ff54b97 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '93b1ce6d369f42f099205e50b06f0b95'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:20.045553 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-209e1b3b-1a29-4c8e-a903-a24f9ee250dc None None] MFA Rules not processed for user `9ea002bf49c248dbae7147665fa10fd1`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:20:20.046907 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-209e1b3b-1a29-4c8e-a903-a24f9ee250dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:20.063350 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:20:20.074773 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-17e9c57d-ed3f-471f-ac24-34d82ff54b97 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '93b1ce6d369f42f099205e50b06f0b95'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:20.098030 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 834/1652] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 31 00:20:19 2022] DELETE /identity/v3/users/93b1ce6d369f42f099205e50b06f0b95 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:20:20.155728 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 819/1653] 10.222.0.47 () {58 vars in 1059 bytes} [Wed Aug 31 00:20:19 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:20:20.167180 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e9c57d-ed3f-471f-ac24-34d82ff54b97 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:20.323403 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:20:20.348200 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e9c57d-ed3f-471f-ac24-34d82ff54b97 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:20.360953 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a71813a-a92c-4643-8946-04af6dfd7e97 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea002bf49c248dbae7147665fa10fd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:20.362357 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a71813a-a92c-4643-8946-04af6dfd7e97 service nova] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:20.362857 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a71813a-a92c-4643-8946-04af6dfd7e97 service nova] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:20.363363 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a71813a-a92c-4643-8946-04af6dfd7e97 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:20.366130 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-9a71813a-a92c-4643-8946-04af6dfd7e97 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:20.472352 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a71813a-a92c-4643-8946-04af6dfd7e97 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:20.486226 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a71813a-a92c-4643-8946-04af6dfd7e97 service nova] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:20.517958 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 835/1654] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:20:20 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:20:20.859742 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209e1b3b-1a29-4c8e-a903-a24f9ee250dc None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:20.861592 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-209e1b3b-1a29-4c8e-a903-a24f9ee250dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:21.044110 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209e1b3b-1a29-4c8e-a903-a24f9ee250dc None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:21.137802 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a71813a-a92c-4643-8946-04af6dfd7e97 service nova] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:21.140429 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-9a71813a-a92c-4643-8946-04af6dfd7e97 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:21.212576 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae207751-1652-4b51-92d8-975bcf8339ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:21.213430 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae207751-1652-4b51-92d8-975bcf8339ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:21.213817 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae207751-1652-4b51-92d8-975bcf8339ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:21.214200 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae207751-1652-4b51-92d8-975bcf8339ef admin admin] PATH_INFO: `/v3/projects/31459d2156ed401aa1326bc6b6ce0162` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:21.229421 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae207751-1652-4b51-92d8-975bcf8339ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=31459d2156ed401aa1326bc6b6ce0162)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:21.233807 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae207751-1652-4b51-92d8-975bcf8339ef admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:21.365589 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-ae207751-1652-4b51-92d8-975bcf8339ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31459d2156ed401aa1326bc6b6ce0162', 'request_id': 'req-ae207751-1652-4b51-92d8-975bcf8339ef'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:21.387304 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-ae207751-1652-4b51-92d8-975bcf8339ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31459d2156ed401aa1326bc6b6ce0162', 'request_id': 'req-ae207751-1652-4b51-92d8-975bcf8339ef'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:21.409066 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:20:21.411199 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-ae207751-1652-4b51-92d8-975bcf8339ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31459d2156ed401aa1326bc6b6ce0162', 'request_id': 'req-ae207751-1652-4b51-92d8-975bcf8339ef'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:21.439608 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a71813a-a92c-4643-8946-04af6dfd7e97 service nova] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:21.440140 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-ae207751-1652-4b51-92d8-975bcf8339ef admin admin] The token cache is being invalidate because project 31459d2156ed401aa1326bc6b6ce0162 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81523) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:20:21.440558 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-ae207751-1652-4b51-92d8-975bcf8339ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:21.441702 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-ae207751-1652-4b51-92d8-975bcf8339ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:21.455228 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 820/1655] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 31 00:20:20 2022] DELETE /identity/v3/projects/31459d2156ed401aa1326bc6b6ce0162 => generated 0 bytes in 590 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:20:21.455228 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae207751-1652-4b51-92d8-975bcf8339ef admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:21.456881 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-ae207751-1652-4b51-92d8-975bcf8339ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:21.631230 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae207751-1652-4b51-92d8-975bcf8339ef admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:21.645402 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0afa74-f597-4706-8eaf-17791c04e720 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beecda6e9feb400288618745c784989f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:21.646714 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0afa74-f597-4706-8eaf-17791c04e720 service cinder] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:21.646714 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0afa74-f597-4706-8eaf-17791c04e720 service cinder] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:21.646714 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0afa74-f597-4706-8eaf-17791c04e720 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:21.649245 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-5d0afa74-f597-4706-8eaf-17791c04e720 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:21.786379 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c05c07b-4efd-4074-9ab6-becd95122a47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:21.788038 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c05c07b-4efd-4074-9ab6-becd95122a47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:21.790373 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c05c07b-4efd-4074-9ab6-becd95122a47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:21.795102 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c05c07b-4efd-4074-9ab6-becd95122a47 admin admin] PATH_INFO: `/v3/projects/814f03ef8b864f54b54b11cf60865ff9` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:21.807867 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c05c07b-4efd-4074-9ab6-becd95122a47 admin admin] RBAC: Authorizing `identity:delete_project(project_id=814f03ef8b864f54b54b11cf60865ff9)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:21.814745 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0afa74-f597-4706-8eaf-17791c04e720 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:21.816604 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0afa74-f597-4706-8eaf-17791c04e720 service cinder] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:21.818751 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c05c07b-4efd-4074-9ab6-becd95122a47 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:21.833972 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 821/1656] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:20:21 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:20:21.835933 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60b5d33-b5c3-431a-8f7b-12e515b34093 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:21.836248 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60b5d33-b5c3-431a-8f7b-12e515b34093 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:21.836605 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60b5d33-b5c3-431a-8f7b-12e515b34093 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:21.914476 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-c60b5d33-b5c3-431a-8f7b-12e515b34093 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:20:21.918873 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-c60b5d33-b5c3-431a-8f7b-12e515b34093 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:21.948334 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 822/1657] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:20:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:20:21.967134 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb6f0b0-7b75-432b-9cd6-76bbf7360ca5 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:21.967417 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb6f0b0-7b75-432b-9cd6-76bbf7360ca5 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:21.967607 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb6f0b0-7b75-432b-9cd6-76bbf7360ca5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:22.038830 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-acb6f0b0-7b75-432b-9cd6-76bbf7360ca5 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:20:22.047865 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-acb6f0b0-7b75-432b-9cd6-76bbf7360ca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:22.093119 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:20:22.094990 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-3c05c07b-4efd-4074-9ab6-becd95122a47 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '814f03ef8b864f54b54b11cf60865ff9', 'request_id': 'req-3c05c07b-4efd-4074-9ab6-becd95122a47'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:22.109012 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-3c05c07b-4efd-4074-9ab6-becd95122a47 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '814f03ef8b864f54b54b11cf60865ff9', 'request_id': 'req-3c05c07b-4efd-4074-9ab6-becd95122a47'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:22.129917 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-3c05c07b-4efd-4074-9ab6-becd95122a47 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '814f03ef8b864f54b54b11cf60865ff9', 'request_id': 'req-3c05c07b-4efd-4074-9ab6-becd95122a47'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:22.165011 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-3c05c07b-4efd-4074-9ab6-becd95122a47 admin admin] The token cache is being invalidate because project 814f03ef8b864f54b54b11cf60865ff9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:20:22.165531 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-3c05c07b-4efd-4074-9ab6-becd95122a47 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:22.167868 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-3c05c07b-4efd-4074-9ab6-becd95122a47 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:22.174933 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 836/1658] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 31 00:20:21 2022] DELETE /identity/v3/projects/814f03ef8b864f54b54b11cf60865ff9 => generated 0 bytes in 1033 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:20:22.176763 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abbc47c-33da-4ba0-91c9-966c7b9d137f None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:22.177054 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abbc47c-33da-4ba0-91c9-966c7b9d137f None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:22.177330 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abbc47c-33da-4ba0-91c9-966c7b9d137f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:22.231143 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-7abbc47c-33da-4ba0-91c9-966c7b9d137f None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:20:22.238009 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-7abbc47c-33da-4ba0-91c9-966c7b9d137f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:22.281067 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 823/1659] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:20:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:20:22.285859 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb6f0b0-7b75-432b-9cd6-76bbf7360ca5 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:22.333629 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb6f0b0-7b75-432b-9cd6-76bbf7360ca5 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:22.377631 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc388b3-d023-4fb6-a2fb-fbf700198b7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:22.386777 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc388b3-d023-4fb6-a2fb-fbf700198b7e admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:22.387242 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc388b3-d023-4fb6-a2fb-fbf700198b7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:22.387600 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc388b3-d023-4fb6-a2fb-fbf700198b7e admin admin] PATH_INFO: `/v3/domains` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:22.388736 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc388b3-d023-4fb6-a2fb-fbf700198b7e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:20:22.389495 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc388b3-d023-4fb6-a2fb-fbf700198b7e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:22.393013 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc388b3-d023-4fb6-a2fb-fbf700198b7e admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:22.432269 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 837/1660] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:20:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:20:22.438234 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21347656-c39a-473c-a751-2ed4b35e9ca6 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:22.438660 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21347656-c39a-473c-a751-2ed4b35e9ca6 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:22.438827 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21347656-c39a-473c-a751-2ed4b35e9ca6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:22.439438 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 824/1661] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 31 00:20:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:20:22.446795 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc388b3-d023-4fb6-a2fb-fbf700198b7e admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:22.482879 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-21347656-c39a-473c-a751-2ed4b35e9ca6 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:20:22.484066 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-21347656-c39a-473c-a751-2ed4b35e9ca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:22.503874 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc388b3-d023-4fb6-a2fb-fbf700198b7e admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:22.518475 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 838/1662] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:20:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:20:22.519850 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21347656-c39a-473c-a751-2ed4b35e9ca6 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:22.539188 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21347656-c39a-473c-a751-2ed4b35e9ca6 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:22.544520 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a5aa76-e7c9-460a-b471-5704f52405bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:22.547701 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a5aa76-e7c9-460a-b471-5704f52405bd admin admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:22.548840 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a5aa76-e7c9-460a-b471-5704f52405bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:22.549360 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a5aa76-e7c9-460a-b471-5704f52405bd admin admin] PATH_INFO: `/v3/projects` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:22.551558 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4b7692-95be-41e4-927e-9b1c1b051c70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:22.552230 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4b7692-95be-41e4-927e-9b1c1b051c70 admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:22.552512 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4b7692-95be-41e4-927e-9b1c1b051c70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:22.552791 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4b7692-95be-41e4-927e-9b1c1b051c70 admin admin] PATH_INFO: `/v3/domains` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:22.553935 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a5aa76-e7c9-460a-b471-5704f52405bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:22.558983 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4b7692-95be-41e4-927e-9b1c1b051c70 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:20:22.559459 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4b7692-95be-41e4-927e-9b1c1b051c70 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:22.563602 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a5aa76-e7c9-460a-b471-5704f52405bd admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:22.565721 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4b7692-95be-41e4-927e-9b1c1b051c70 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:22.621431 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 839/1663] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 31 00:20:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:20:22.623137 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4b7692-95be-41e4-927e-9b1c1b051c70 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:22.636771 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:DELETE=2,keystone:SELECT=96,keystone:INSERT=2 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:20:22.660144 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4b7692-95be-41e4-927e-9b1c1b051c70 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:22.671951 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acd4026-4f28-420c-bbae-e74508cc92a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:22.672613 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acd4026-4f28-420c-bbae-e74508cc92a2 admin admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:22.672891 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acd4026-4f28-420c-bbae-e74508cc92a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:22.673131 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 825/1664] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 31 00:20:22 2022] POST /identity/v3/projects => generated 393 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:20:22.673286 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acd4026-4f28-420c-bbae-e74508cc92a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:22.676719 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acd4026-4f28-420c-bbae-e74508cc92a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:22.681516 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a5aa76-e7c9-460a-b471-5704f52405bd admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:22.682039 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acd4026-4f28-420c-bbae-e74508cc92a2 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:22.789090 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 840/1665] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 31 00:20:22 2022] POST /identity/v3/projects => generated 387 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:20:22.796269 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acd4026-4f28-420c-bbae-e74508cc92a2 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:23.099695 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acd4026-4f28-420c-bbae-e74508cc92a2 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:23.136019 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10a1d10-75b6-4fdd-96fc-655bc2ef7382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:23.140943 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a5aa76-e7c9-460a-b471-5704f52405bd admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:23.142369 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10a1d10-75b6-4fdd-96fc-655bc2ef7382 admin admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:23.143199 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10a1d10-75b6-4fdd-96fc-655bc2ef7382 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:23.144052 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10a1d10-75b6-4fdd-96fc-655bc2ef7382 admin admin] PATH_INFO: `/v3/users` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:23.145368 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10a1d10-75b6-4fdd-96fc-655bc2ef7382 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:23.157343 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10a1d10-75b6-4fdd-96fc-655bc2ef7382 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:23.168678 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c8c4fd-c384-4014-b864-b67513ab9f8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:23.171074 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c8c4fd-c384-4014-b864-b67513ab9f8e admin admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:23.176870 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c8c4fd-c384-4014-b864-b67513ab9f8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:23.177637 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c8c4fd-c384-4014-b864-b67513ab9f8e admin admin] PATH_INFO: `/v3/users` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:23.179499 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c8c4fd-c384-4014-b864-b67513ab9f8e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:23.183335 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c8c4fd-c384-4014-b864-b67513ab9f8e admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:23.239510 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 841/1666] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 31 00:20:22 2022] POST /identity/v3/users => generated 294 bytes in 449 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:20:23.252435 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10a1d10-75b6-4fdd-96fc-655bc2ef7382 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:23.258135 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 826/1667] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 31 00:20:22 2022] POST /identity/v3/users => generated 297 bytes in 574 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:20:23.259348 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c8c4fd-c384-4014-b864-b67513ab9f8e admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:23.271191 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10a1d10-75b6-4fdd-96fc-655bc2ef7382 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:23.288096 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8601c2ad-a749-4fc0-b549-53b4b6671f96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:23.289125 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8601c2ad-a749-4fc0-b549-53b4b6671f96 admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:23.289504 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8601c2ad-a749-4fc0-b549-53b4b6671f96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:23.289893 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8601c2ad-a749-4fc0-b549-53b4b6671f96 admin admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:23.290659 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8601c2ad-a749-4fc0-b549-53b4b6671f96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:23.290817 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c8c4fd-c384-4014-b864-b67513ab9f8e admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:23.293922 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8601c2ad-a749-4fc0-b549-53b4b6671f96 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:23.304554 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f37f4c-cc38-44a7-972c-8502323509b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:23.308037 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f37f4c-cc38-44a7-972c-8502323509b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:23.308636 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f37f4c-cc38-44a7-972c-8502323509b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:23.309133 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f37f4c-cc38-44a7-972c-8502323509b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:23.313621 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f37f4c-cc38-44a7-972c-8502323509b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:23.315374 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f37f4c-cc38-44a7-972c-8502323509b9 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:23.346396 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 842/1668] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 00:20:23 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:20:23.354863 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8601c2ad-a749-4fc0-b549-53b4b6671f96 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:23.355110 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 827/1669] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 00:20:23 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:20:23.356084 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f37f4c-cc38-44a7-972c-8502323509b9 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:23.371743 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8601c2ad-a749-4fc0-b549-53b4b6671f96 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:23.372268 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f37f4c-cc38-44a7-972c-8502323509b9 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:23.377542 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b401306c-0bf2-4954-9638-1b913145a883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:23.378504 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b401306c-0bf2-4954-9638-1b913145a883 admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:23.378878 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b401306c-0bf2-4954-9638-1b913145a883 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:23.379252 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b401306c-0bf2-4954-9638-1b913145a883 admin admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:23.380017 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b401306c-0bf2-4954-9638-1b913145a883 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:23.382544 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b401306c-0bf2-4954-9638-1b913145a883 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:23.388564 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7309cffa-76a3-4e0c-9d42-1ee067446e73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:23.389466 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7309cffa-76a3-4e0c-9d42-1ee067446e73 admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:23.389752 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7309cffa-76a3-4e0c-9d42-1ee067446e73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:23.390023 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7309cffa-76a3-4e0c-9d42-1ee067446e73 admin admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:23.390685 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7309cffa-76a3-4e0c-9d42-1ee067446e73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:23.394566 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7309cffa-76a3-4e0c-9d42-1ee067446e73 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:23.403930 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 843/1670] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 00:20:23 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:20:23.405074 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b401306c-0bf2-4954-9638-1b913145a883 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:23.412476 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=92,keystone:DELETE=3,keystone:INSERT=5 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:20:23.421173 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b401306c-0bf2-4954-9638-1b913145a883 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:23.433442 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 828/1671] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 00:20:23 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 00:20:23.433687 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f243859-b23e-4436-b9e1-54ca63d8a883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:23.434500 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f243859-b23e-4436-b9e1-54ca63d8a883 admin admin] REQUEST_METHOD: `PUT` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:23.435041 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7309cffa-76a3-4e0c-9d42-1ee067446e73 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:23.435660 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f243859-b23e-4436-b9e1-54ca63d8a883 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:23.437787 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f243859-b23e-4436-b9e1-54ca63d8a883 admin admin] PATH_INFO: `/v3/projects/46114c0b35f54c1a94a43648f4069508/users/217461238b8a4a8eb98b5584667a5a60/roles/fdad79ffbcbb4fa380dc9cf7dd108618` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:23.452585 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7309cffa-76a3-4e0c-9d42-1ee067446e73 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:23.468001 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62b7583-ba6c-427b-9a5f-38a6ebf15af7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:23.470384 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62b7583-ba6c-427b-9a5f-38a6ebf15af7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:23.472562 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62b7583-ba6c-427b-9a5f-38a6ebf15af7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:23.472974 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62b7583-ba6c-427b-9a5f-38a6ebf15af7 admin admin] PATH_INFO: `/v3/projects/0a5cf104b4974638b08149fe30eedf1e/users/e4b9c7f39ca641d896c71466bf24352a/roles/fdad79ffbcbb4fa380dc9cf7dd108618` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:23.479553 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f243859-b23e-4436-b9e1-54ca63d8a883 admin admin] RBAC: Authorizing `identity:create_grant(project_id=46114c0b35f54c1a94a43648f4069508, user_id=217461238b8a4a8eb98b5584667a5a60, role_id=fdad79ffbcbb4fa380dc9cf7dd108618)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:23.483192 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f243859-b23e-4436-b9e1-54ca63d8a883 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:23.516127 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 844/1672] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 00:20:23 2022] PUT /identity/v3/projects/46114c0b35f54c1a94a43648f4069508/users/217461238b8a4a8eb98b5584667a5a60/roles/fdad79ffbcbb4fa380dc9cf7dd108618 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:20:23.519522 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62b7583-ba6c-427b-9a5f-38a6ebf15af7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a5cf104b4974638b08149fe30eedf1e, user_id=e4b9c7f39ca641d896c71466bf24352a, role_id=fdad79ffbcbb4fa380dc9cf7dd108618)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:23.524433 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62b7583-ba6c-427b-9a5f-38a6ebf15af7 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:23.532034 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76e8444-6e83-454e-822c-38f7adf4b8a9 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:23.532346 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76e8444-6e83-454e-822c-38f7adf4b8a9 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:23.532795 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76e8444-6e83-454e-822c-38f7adf4b8a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:23.551703 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 829/1673] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 00:20:23 2022] PUT /identity/v3/projects/0a5cf104b4974638b08149fe30eedf1e/users/e4b9c7f39ca641d896c71466bf24352a/roles/fdad79ffbcbb4fa380dc9cf7dd108618 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:20:23.572729 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933ca051-eaf0-444c-9e98-b76b17ee2030 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:23.573960 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933ca051-eaf0-444c-9e98-b76b17ee2030 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:23.574777 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933ca051-eaf0-444c-9e98-b76b17ee2030 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:23.601962 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-b76e8444-6e83-454e-822c-38f7adf4b8a9 None None] MFA Rules not processed for user `217461238b8a4a8eb98b5584667a5a60`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:20:23.603327 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-b76e8444-6e83-454e-822c-38f7adf4b8a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:23.780762 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-933ca051-eaf0-444c-9e98-b76b17ee2030 None None] MFA Rules not processed for user `e4b9c7f39ca641d896c71466bf24352a`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:20:23.784670 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-933ca051-eaf0-444c-9e98-b76b17ee2030 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:23.822991 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 845/1674] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:20:23 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:20:23.829813 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76e8444-6e83-454e-822c-38f7adf4b8a9 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:23.913837 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 830/1675] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:20:23 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 343 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:20:23.918209 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933ca051-eaf0-444c-9e98-b76b17ee2030 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:24.022373 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:20:24.076955 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76e8444-6e83-454e-822c-38f7adf4b8a9 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:24.096720 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce770adc-8865-4764-852f-0d7cdfe4d508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:24.097679 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce770adc-8865-4764-852f-0d7cdfe4d508 admin admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:24.098081 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce770adc-8865-4764-852f-0d7cdfe4d508 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:24.098473 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce770adc-8865-4764-852f-0d7cdfe4d508 admin admin] PATH_INFO: `/v3/projects` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:24.099469 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce770adc-8865-4764-852f-0d7cdfe4d508 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:24.102793 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce770adc-8865-4764-852f-0d7cdfe4d508 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:24.158008 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933ca051-eaf0-444c-9e98-b76b17ee2030 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:24.178537 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce31435-320a-4ccb-abbf-5171576ab2aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:24.179659 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce31435-320a-4ccb-abbf-5171576ab2aa admin admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:24.180003 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce31435-320a-4ccb-abbf-5171576ab2aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:24.180505 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce31435-320a-4ccb-abbf-5171576ab2aa admin admin] PATH_INFO: `/v3/projects` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:24.181611 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce31435-320a-4ccb-abbf-5171576ab2aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:24.185369 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce31435-320a-4ccb-abbf-5171576ab2aa admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:24.284352 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 846/1676] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 31 00:20:23 2022] POST /identity/v3/projects => generated 387 bytes in 455 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:20:24.286070 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce770adc-8865-4764-852f-0d7cdfe4d508 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:24.297250 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 831/1677] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 31 00:20:23 2022] POST /identity/v3/projects => generated 393 bytes in 379 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:20:24.303828 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce31435-320a-4ccb-abbf-5171576ab2aa admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:24.525955 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:20:24.566287 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce770adc-8865-4764-852f-0d7cdfe4d508 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:24.598848 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce31435-320a-4ccb-abbf-5171576ab2aa admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:24.619947 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d7be80-0b4c-4a3f-96d1-4e0c37838bea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:24.620511 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d7be80-0b4c-4a3f-96d1-4e0c37838bea admin admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:24.620798 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d7be80-0b4c-4a3f-96d1-4e0c37838bea admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:24.621077 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d7be80-0b4c-4a3f-96d1-4e0c37838bea admin admin] PATH_INFO: `/v3/users` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:24.621755 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d7be80-0b4c-4a3f-96d1-4e0c37838bea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:24.628414 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d7be80-0b4c-4a3f-96d1-4e0c37838bea admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:24.686869 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 832/1678] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 31 00:20:24 2022] POST /identity/v3/users => generated 303 bytes in 384 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:20:24.691658 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d7be80-0b4c-4a3f-96d1-4e0c37838bea admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:24.720033 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d7be80-0b4c-4a3f-96d1-4e0c37838bea admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:24.731967 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d148d0f-1fa9-4c3b-85c4-d6e90de5c266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:24.733430 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d148d0f-1fa9-4c3b-85c4-d6e90de5c266 admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:24.733714 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d148d0f-1fa9-4c3b-85c4-d6e90de5c266 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:24.733985 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d148d0f-1fa9-4c3b-85c4-d6e90de5c266 admin admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:24.734662 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d148d0f-1fa9-4c3b-85c4-d6e90de5c266 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:24.736675 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c5f131-5f1f-4819-b439-3d0ffdfc6f78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:24.737324 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c5f131-5f1f-4819-b439-3d0ffdfc6f78 admin admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:24.737654 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c5f131-5f1f-4819-b439-3d0ffdfc6f78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:24.737936 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c5f131-5f1f-4819-b439-3d0ffdfc6f78 admin admin] PATH_INFO: `/v3/users` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:24.752092 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d148d0f-1fa9-4c3b-85c4-d6e90de5c266 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:24.752418 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c5f131-5f1f-4819-b439-3d0ffdfc6f78 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:24.758764 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c5f131-5f1f-4819-b439-3d0ffdfc6f78 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:24.781102 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 833/1679] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 00:20:24 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 00:20:24.786247 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d148d0f-1fa9-4c3b-85c4-d6e90de5c266 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:24.814277 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 847/1680] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 31 00:20:24 2022] POST /identity/v3/users => generated 300 bytes in 529 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:20:24.814609 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d148d0f-1fa9-4c3b-85c4-d6e90de5c266 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:24.821995 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c5f131-5f1f-4819-b439-3d0ffdfc6f78 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:24.832868 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a772964c-b3c4-40c1-9d3b-789846ba6ac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:24.833578 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a772964c-b3c4-40c1-9d3b-789846ba6ac1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:24.833864 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a772964c-b3c4-40c1-9d3b-789846ba6ac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:24.834156 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a772964c-b3c4-40c1-9d3b-789846ba6ac1 admin admin] PATH_INFO: `/v3/projects/92158ead19764e13b0acea6970237a17/users/013acb36003140939f7435dfe40d51d0/roles/12f6817f9aaa4e2bb477095a6bed5d0f` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:24.843133 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c5f131-5f1f-4819-b439-3d0ffdfc6f78 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:24.861423 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d806a88-33a8-4b78-8e0e-e8fdbe6805ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:24.863968 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d806a88-33a8-4b78-8e0e-e8fdbe6805ac admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:24.863968 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d806a88-33a8-4b78-8e0e-e8fdbe6805ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:24.863968 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d806a88-33a8-4b78-8e0e-e8fdbe6805ac admin admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:24.866751 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d806a88-33a8-4b78-8e0e-e8fdbe6805ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:24.869604 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d806a88-33a8-4b78-8e0e-e8fdbe6805ac admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:24.876031 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a772964c-b3c4-40c1-9d3b-789846ba6ac1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=92158ead19764e13b0acea6970237a17, user_id=013acb36003140939f7435dfe40d51d0, role_id=12f6817f9aaa4e2bb477095a6bed5d0f)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:24.879247 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a772964c-b3c4-40c1-9d3b-789846ba6ac1 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:24.898712 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 848/1681] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 00:20:24 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:20:24.905690 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d806a88-33a8-4b78-8e0e-e8fdbe6805ac admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:24.919582 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 834/1682] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 00:20:24 2022] PUT /identity/v3/projects/92158ead19764e13b0acea6970237a17/users/013acb36003140939f7435dfe40d51d0/roles/12f6817f9aaa4e2bb477095a6bed5d0f => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:20:24.925553 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a772964c-b3c4-40c1-9d3b-789846ba6ac1 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:24.938503 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d806a88-33a8-4b78-8e0e-e8fdbe6805ac admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:25.085775 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a772964c-b3c4-40c1-9d3b-789846ba6ac1 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:25.093852 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a4d1a7-b148-4c9e-8217-475d98672694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:25.094496 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a4d1a7-b148-4c9e-8217-475d98672694 admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:25.095221 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a4d1a7-b148-4c9e-8217-475d98672694 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:25.095221 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a4d1a7-b148-4c9e-8217-475d98672694 admin admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:25.095810 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a4d1a7-b148-4c9e-8217-475d98672694 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:25.099328 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a4d1a7-b148-4c9e-8217-475d98672694 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:25.122716 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 835/1683] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 00:20:24 2022] GET /identity/v3/roles => generated 1420 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 00:20:25.123706 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a4d1a7-b148-4c9e-8217-475d98672694 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:25.133445 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:20:25.142188 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a4d1a7-b148-4c9e-8217-475d98672694 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:25.150585 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea5bc05-6bff-42d4-a4f7-097f51fa9d31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:25.153731 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5e0e20-2974-498c-9609-9e95cbd0c0d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:25.154436 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5e0e20-2974-498c-9609-9e95cbd0c0d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:25.154558 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea5bc05-6bff-42d4-a4f7-097f51fa9d31 admin admin] REQUEST_METHOD: `PUT` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:25.154791 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5e0e20-2974-498c-9609-9e95cbd0c0d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:25.155326 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5e0e20-2974-498c-9609-9e95cbd0c0d7 admin admin] PATH_INFO: `/v3/projects/92158ead19764e13b0acea6970237a17/users/013acb36003140939f7435dfe40d51d0/roles/12f6817f9aaa4e2bb477095a6bed5d0f` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:25.156675 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea5bc05-6bff-42d4-a4f7-097f51fa9d31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:25.157818 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea5bc05-6bff-42d4-a4f7-097f51fa9d31 admin admin] PATH_INFO: `/v3/projects/4d03daf82c6f457e883bb6e72c2d5d86/users/330678ec599749aaa07d98b11f7e2375/roles/12f6817f9aaa4e2bb477095a6bed5d0f` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:25.158492 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5e0e20-2974-498c-9609-9e95cbd0c0d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=92158ead19764e13b0acea6970237a17, user_id=013acb36003140939f7435dfe40d51d0, role_id=12f6817f9aaa4e2bb477095a6bed5d0f)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:25.163037 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5e0e20-2974-498c-9609-9e95cbd0c0d7 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:25.194500 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 836/1684] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 00:20:25 2022] PUT /identity/v3/projects/92158ead19764e13b0acea6970237a17/users/013acb36003140939f7435dfe40d51d0/roles/12f6817f9aaa4e2bb477095a6bed5d0f => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:20:25.196164 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07104e07-1cff-468a-9b6c-5b2693410929 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:25.196464 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07104e07-1cff-468a-9b6c-5b2693410929 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:25.196740 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07104e07-1cff-468a-9b6c-5b2693410929 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:25.226425 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea5bc05-6bff-42d4-a4f7-097f51fa9d31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d03daf82c6f457e883bb6e72c2d5d86, user_id=330678ec599749aaa07d98b11f7e2375, role_id=12f6817f9aaa4e2bb477095a6bed5d0f)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:25.240995 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea5bc05-6bff-42d4-a4f7-097f51fa9d31 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:25.241496 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-07104e07-1cff-468a-9b6c-5b2693410929 None None] MFA Rules not processed for user `013acb36003140939f7435dfe40d51d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:20:25.243274 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-07104e07-1cff-468a-9b6c-5b2693410929 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:25.278188 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 849/1685] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 00:20:24 2022] PUT /identity/v3/projects/4d03daf82c6f457e883bb6e72c2d5d86/users/330678ec599749aaa07d98b11f7e2375/roles/12f6817f9aaa4e2bb477095a6bed5d0f => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:20:25.283615 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea5bc05-6bff-42d4-a4f7-097f51fa9d31 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:25.391494 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 837/1686] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:20:25 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:20:25.419060 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07104e07-1cff-468a-9b6c-5b2693410929 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:25.420789 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-07104e07-1cff-468a-9b6c-5b2693410929 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:25.504136 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea5bc05-6bff-42d4-a4f7-097f51fa9d31 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:25.523826 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ad714e-b3d0-420f-9697-5d56f9621b44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:25.528519 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ad714e-b3d0-420f-9697-5d56f9621b44 admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:25.531380 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ad714e-b3d0-420f-9697-5d56f9621b44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:25.531736 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ad714e-b3d0-420f-9697-5d56f9621b44 admin admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:25.532549 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ad714e-b3d0-420f-9697-5d56f9621b44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:25.541218 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ad714e-b3d0-420f-9697-5d56f9621b44 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:25.552927 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:20:25.583010 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 850/1687] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 00:20:25 2022] GET /identity/v3/roles => generated 1420 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:20:25.587913 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ad714e-b3d0-420f-9697-5d56f9621b44 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:25.589577 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07104e07-1cff-468a-9b6c-5b2693410929 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:25.611715 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ad714e-b3d0-420f-9697-5d56f9621b44 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:25.628517 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f547860a-62dd-4e32-88cb-efdbc8e4ac27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:25.635067 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f547860a-62dd-4e32-88cb-efdbc8e4ac27 admin admin] REQUEST_METHOD: `PUT` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:25.635906 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f547860a-62dd-4e32-88cb-efdbc8e4ac27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:25.636319 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f547860a-62dd-4e32-88cb-efdbc8e4ac27 admin admin] PATH_INFO: `/v3/projects/4d03daf82c6f457e883bb6e72c2d5d86/users/330678ec599749aaa07d98b11f7e2375/roles/12f6817f9aaa4e2bb477095a6bed5d0f` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:25.642266 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f547860a-62dd-4e32-88cb-efdbc8e4ac27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d03daf82c6f457e883bb6e72c2d5d86, user_id=330678ec599749aaa07d98b11f7e2375, role_id=12f6817f9aaa4e2bb477095a6bed5d0f)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:25.650288 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f547860a-62dd-4e32-88cb-efdbc8e4ac27 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:25.687653 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 851/1688] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 00:20:25 2022] PUT /identity/v3/projects/4d03daf82c6f457e883bb6e72c2d5d86/users/330678ec599749aaa07d98b11f7e2375/roles/12f6817f9aaa4e2bb477095a6bed5d0f => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:20:25.705248 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc33fe9-5aab-4a34-ab36-52d192f93a50 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:25.705856 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc33fe9-5aab-4a34-ab36-52d192f93a50 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:25.706149 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc33fe9-5aab-4a34-ab36-52d192f93a50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:25.791142 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebf7224-de79-4922-b0e3-8619eafface4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beecda6e9feb400288618745c784989f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:25.792226 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebf7224-de79-4922-b0e3-8619eafface4 service cinder] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:25.792737 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebf7224-de79-4922-b0e3-8619eafface4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:25.793770 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebf7224-de79-4922-b0e3-8619eafface4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:25.852367 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-0bc33fe9-5aab-4a34-ab36-52d192f93a50 None None] MFA Rules not processed for user `330678ec599749aaa07d98b11f7e2375`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:20:25.858359 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-0bc33fe9-5aab-4a34-ab36-52d192f93a50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:25.980392 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:20:26.057589 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebf7224-de79-4922-b0e3-8619eafface4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:26.059140 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebf7224-de79-4922-b0e3-8619eafface4 service cinder] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:26.090712 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 838/1689] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:20:25 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 672 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 00:20:26.097085 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 852/1690] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:20:25 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 393 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:20:26.118048 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebf7224-de79-4922-b0e3-8619eafface4 service cinder] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:26.119522 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-0ebf7224-de79-4922-b0e3-8619eafface4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:26.136388 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebf7224-de79-4922-b0e3-8619eafface4 service cinder] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:26.255337 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc33fe9-5aab-4a34-ab36-52d192f93a50 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:26.284015 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5730043-9c6d-4228-93c1-35b0fbf58809 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beecda6e9feb400288618745c784989f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:26.284910 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5730043-9c6d-4228-93c1-35b0fbf58809 service cinder] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:26.285482 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5730043-9c6d-4228-93c1-35b0fbf58809 service cinder] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:26.285864 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5730043-9c6d-4228-93c1-35b0fbf58809 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:26.311498 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5730043-9c6d-4228-93c1-35b0fbf58809 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:26.317592 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5730043-9c6d-4228-93c1-35b0fbf58809 service cinder] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:26.353765 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 839/1691] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:20:26 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:20:26.445936 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc33fe9-5aab-4a34-ab36-52d192f93a50 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:26.462174 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841dd01b-aa4a-48fa-baf5-eaac4fd408d8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beecda6e9feb400288618745c784989f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:26.462866 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841dd01b-aa4a-48fa-baf5-eaac4fd408d8 service cinder] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:26.463317 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841dd01b-aa4a-48fa-baf5-eaac4fd408d8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:26.463756 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841dd01b-aa4a-48fa-baf5-eaac4fd408d8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:26.593981 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841dd01b-aa4a-48fa-baf5-eaac4fd408d8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:26.595476 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841dd01b-aa4a-48fa-baf5-eaac4fd408d8 service cinder] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:26.616570 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5730043-9c6d-4228-93c1-35b0fbf58809 service cinder] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:26.626639 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 853/1692] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:20:26 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:20:26.977157 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5730043-9c6d-4228-93c1-35b0fbf58809 service cinder] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:27.007529 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b597f760-e032-435f-aaca-03c1f9c1dce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:27.008742 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b597f760-e032-435f-aaca-03c1f9c1dce5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:27.009239 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b597f760-e032-435f-aaca-03c1f9c1dce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:27.009598 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b597f760-e032-435f-aaca-03c1f9c1dce5 admin admin] PATH_INFO: `/v3/users/217461238b8a4a8eb98b5584667a5a60` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:27.019580 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b597f760-e032-435f-aaca-03c1f9c1dce5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=217461238b8a4a8eb98b5584667a5a60)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:27.022582 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b597f760-e032-435f-aaca-03c1f9c1dce5 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:27.204743 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-b597f760-e032-435f-aaca-03c1f9c1dce5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '217461238b8a4a8eb98b5584667a5a60'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:27.232588 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-b597f760-e032-435f-aaca-03c1f9c1dce5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '217461238b8a4a8eb98b5584667a5a60'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:27.253055 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-b597f760-e032-435f-aaca-03c1f9c1dce5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '217461238b8a4a8eb98b5584667a5a60'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:27.300455 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-b597f760-e032-435f-aaca-03c1f9c1dce5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '217461238b8a4a8eb98b5584667a5a60'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:27.301465 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-b597f760-e032-435f-aaca-03c1f9c1dce5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '217461238b8a4a8eb98b5584667a5a60'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:27.362571 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 840/1693] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 31 00:20:26 2022] DELETE /identity/v3/users/217461238b8a4a8eb98b5584667a5a60 => generated 0 bytes in 748 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:20:27.371067 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16e62eb-06ea-436f-a4f1-3468a7d4930c None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:27.371646 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16e62eb-06ea-436f-a4f1-3468a7d4930c None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:27.372306 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16e62eb-06ea-436f-a4f1-3468a7d4930c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:27.434898 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-f16e62eb-06ea-436f-a4f1-3468a7d4930c None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:20:27.437763 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-f16e62eb-06ea-436f-a4f1-3468a7d4930c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:27.525635 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:20:27.761398 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 854/1694] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:20:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 392 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:20:27.932350 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b597f760-e032-435f-aaca-03c1f9c1dce5 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:27.939215 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-b597f760-e032-435f-aaca-03c1f9c1dce5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:28.012673 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:20:28.168429 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b597f760-e032-435f-aaca-03c1f9c1dce5 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:28.185342 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e029afb1-d054-4809-af4f-94ae7025c63c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'daae792cd11d4c4ca7aae0558998aced', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:28.186311 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e029afb1-d054-4809-af4f-94ae7025c63c service neutron] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:28.186598 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e029afb1-d054-4809-af4f-94ae7025c63c service neutron] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:28.187271 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e029afb1-d054-4809-af4f-94ae7025c63c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:28.236021 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e029afb1-d054-4809-af4f-94ae7025c63c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:28.250352 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e029afb1-d054-4809-af4f-94ae7025c63c service neutron] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:28.291938 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 841/1695] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:20:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:20:29.755571 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f143061c-a9c8-4b72-82cb-86ca497c4fe5 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:29.757733 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f143061c-a9c8-4b72-82cb-86ca497c4fe5 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:29.758819 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f143061c-a9c8-4b72-82cb-86ca497c4fe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:29.872447 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961b231a-474d-4f69-8062-8d0f43a54baf None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:29.878209 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961b231a-474d-4f69-8062-8d0f43a54baf None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:29.878938 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961b231a-474d-4f69-8062-8d0f43a54baf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:29.944183 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-f143061c-a9c8-4b72-82cb-86ca497c4fe5 None None] MFA Rules not processed for user `08fa033114244fc89c82939202f911e7`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:20:29.948362 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-f143061c-a9c8-4b72-82cb-86ca497c4fe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:30.012180 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-961b231a-474d-4f69-8062-8d0f43a54baf None None] MFA Rules not processed for user `bc018a253e0a4b0bb96097ce4cc72c21`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:20:30.017199 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-961b231a-474d-4f69-8062-8d0f43a54baf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:30.255278 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 842/1696] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:20:29 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 386 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:20:30.297649 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 855/1697] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:20:29 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 544 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:20:30.317318 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961b231a-474d-4f69-8062-8d0f43a54baf None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:30.319437 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-961b231a-474d-4f69-8062-8d0f43a54baf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:30.557199 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961b231a-474d-4f69-8062-8d0f43a54baf None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:30.590530 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e4469a-d418-412d-b8b1-7366726a56ef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea002bf49c248dbae7147665fa10fd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:30.591829 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e4469a-d418-412d-b8b1-7366726a56ef service nova] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:30.592122 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e4469a-d418-412d-b8b1-7366726a56ef service nova] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:30.592902 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e4469a-d418-412d-b8b1-7366726a56ef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:30.628192 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e4469a-d418-412d-b8b1-7366726a56ef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:30.631627 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e4469a-d418-412d-b8b1-7366726a56ef service nova] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:30.664212 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 843/1698] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:20:30 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:20:31.090763 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b53a6a1-0dcb-4010-a4fa-1c3ecca53d66 None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:31.091302 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b53a6a1-0dcb-4010-a4fa-1c3ecca53d66 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:31.091441 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b53a6a1-0dcb-4010-a4fa-1c3ecca53d66 None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:31.093072 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 856/1699] 10.222.0.47 () {54 vars in 962 bytes} [Wed Aug 31 00:20:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:20:31.105552 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c150d90-a9ab-4bc8-b158-423c7d637c0b None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:31.106602 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c150d90-a9ab-4bc8-b158-423c7d637c0b None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:31.107514 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c150d90-a9ab-4bc8-b158-423c7d637c0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:31.153310 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-8c150d90-a9ab-4bc8-b158-423c7d637c0b None None] MFA Rules not processed for user `9ea002bf49c248dbae7147665fa10fd1`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:20:31.157797 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-8c150d90-a9ab-4bc8-b158-423c7d637c0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:31.189577 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 844/1700] 10.222.0.47 () {58 vars in 1059 bytes} [Wed Aug 31 00:20:31 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:20:31.198232 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fddb37-a1af-4873-9457-e298eb86abc7 None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:31.199038 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fddb37-a1af-4873-9457-e298eb86abc7 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:31.199821 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fddb37-a1af-4873-9457-e298eb86abc7 None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:31.201987 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 857/1701] 10.222.0.47 () {54 vars in 912 bytes} [Wed Aug 31 00:20:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 00:20:31.210720 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d65aba3-14a8-4f65-88af-f6ce789e2609 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:31.211382 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d65aba3-14a8-4f65-88af-f6ce789e2609 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:31.212015 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d65aba3-14a8-4f65-88af-f6ce789e2609 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:31.235508 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fddb37-a1af-4873-9457-e298eb86abc7 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:31.239987 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-07fddb37-a1af-4873-9457-e298eb86abc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:31.344449 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fddb37-a1af-4873-9457-e298eb86abc7 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:31.348492 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-6d65aba3-14a8-4f65-88af-f6ce789e2609 None None] MFA Rules not processed for user `9ea002bf49c248dbae7147665fa10fd1`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:20:31.350187 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-6d65aba3-14a8-4f65-88af-f6ce789e2609 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:31.360955 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19a108c-6675-4e8e-8fee-30cb199cb657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:31.366663 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19a108c-6675-4e8e-8fee-30cb199cb657 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:31.367384 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19a108c-6675-4e8e-8fee-30cb199cb657 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:31.368573 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19a108c-6675-4e8e-8fee-30cb199cb657 admin admin] PATH_INFO: `/v3/projects/46114c0b35f54c1a94a43648f4069508` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:31.371224 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19a108c-6675-4e8e-8fee-30cb199cb657 admin admin] RBAC: Authorizing `identity:delete_project(project_id=46114c0b35f54c1a94a43648f4069508)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:31.377946 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19a108c-6675-4e8e-8fee-30cb199cb657 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:31.401426 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 845/1702] 10.222.0.47 () {58 vars in 1009 bytes} [Wed Aug 31 00:20:31 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:20:31.433154 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d65aba3-14a8-4f65-88af-f6ce789e2609 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:31.434885 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-6d65aba3-14a8-4f65-88af-f6ce789e2609 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:31.529660 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:20:31.576940 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-f19a108c-6675-4e8e-8fee-30cb199cb657 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46114c0b35f54c1a94a43648f4069508', 'request_id': 'req-f19a108c-6675-4e8e-8fee-30cb199cb657'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:31.609374 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-f19a108c-6675-4e8e-8fee-30cb199cb657 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46114c0b35f54c1a94a43648f4069508', 'request_id': 'req-f19a108c-6675-4e8e-8fee-30cb199cb657'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:31.630333 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-f19a108c-6675-4e8e-8fee-30cb199cb657 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46114c0b35f54c1a94a43648f4069508', 'request_id': 'req-f19a108c-6675-4e8e-8fee-30cb199cb657'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:31.656764 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d65aba3-14a8-4f65-88af-f6ce789e2609 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:31.668547 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-f19a108c-6675-4e8e-8fee-30cb199cb657 admin admin] The token cache is being invalidate because project 46114c0b35f54c1a94a43648f4069508 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:20:31.668999 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-f19a108c-6675-4e8e-8fee-30cb199cb657 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:31.672144 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-f19a108c-6675-4e8e-8fee-30cb199cb657 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:31.674489 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 858/1703] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 31 00:20:31 2022] DELETE /identity/v3/projects/46114c0b35f54c1a94a43648f4069508 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:20:31.680672 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19a108c-6675-4e8e-8fee-30cb199cb657 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:31.682707 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-f19a108c-6675-4e8e-8fee-30cb199cb657 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:31.793747 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:20:31.826800 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f83149-9ec3-4f80-9020-a9f8ad346da3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc025521e1dc4c91ab50a8718a87754f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:31.827786 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f83149-9ec3-4f80-9020-a9f8ad346da3 service glance] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:31.828543 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f83149-9ec3-4f80-9020-a9f8ad346da3 service glance] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:31.829234 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f83149-9ec3-4f80-9020-a9f8ad346da3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:31.845608 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-d9f83149-9ec3-4f80-9020-a9f8ad346da3 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:31.871100 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19a108c-6675-4e8e-8fee-30cb199cb657 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:31.893845 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040addce-cc67-4506-abfa-4fd0a68ad1ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:31.895306 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040addce-cc67-4506-abfa-4fd0a68ad1ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:31.895698 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040addce-cc67-4506-abfa-4fd0a68ad1ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:31.896190 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040addce-cc67-4506-abfa-4fd0a68ad1ed admin admin] PATH_INFO: `/v3/users/330678ec599749aaa07d98b11f7e2375` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:31.899800 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040addce-cc67-4506-abfa-4fd0a68ad1ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=330678ec599749aaa07d98b11f7e2375)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:31.902649 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040addce-cc67-4506-abfa-4fd0a68ad1ed admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:32.070107 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-040addce-cc67-4506-abfa-4fd0a68ad1ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '330678ec599749aaa07d98b11f7e2375'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:32.091735 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-040addce-cc67-4506-abfa-4fd0a68ad1ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '330678ec599749aaa07d98b11f7e2375'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:32.125482 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-040addce-cc67-4506-abfa-4fd0a68ad1ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '330678ec599749aaa07d98b11f7e2375'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:32.126316 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-040addce-cc67-4506-abfa-4fd0a68ad1ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '330678ec599749aaa07d98b11f7e2375'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:32.153601 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f83149-9ec3-4f80-9020-a9f8ad346da3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:32.156577 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f83149-9ec3-4f80-9020-a9f8ad346da3 service glance] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:32.157653 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-040addce-cc67-4506-abfa-4fd0a68ad1ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '330678ec599749aaa07d98b11f7e2375'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:32.180981 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 859/1704] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 31 00:20:31 2022] DELETE /identity/v3/users/330678ec599749aaa07d98b11f7e2375 => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:20:32.231070 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 846/1705] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:20:31 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 784 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 00:20:33.604948 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040addce-cc67-4506-abfa-4fd0a68ad1ed admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:33.606548 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-040addce-cc67-4506-abfa-4fd0a68ad1ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:33.813489 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040addce-cc67-4506-abfa-4fd0a68ad1ed admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:33.854249 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf35ee3d-97a6-4db4-9097-515988391947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:33.855557 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf35ee3d-97a6-4db4-9097-515988391947 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:33.857581 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf35ee3d-97a6-4db4-9097-515988391947 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:33.861833 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf35ee3d-97a6-4db4-9097-515988391947 admin admin] PATH_INFO: `/v3/users/e4b9c7f39ca641d896c71466bf24352a` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:33.867572 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf35ee3d-97a6-4db4-9097-515988391947 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4b9c7f39ca641d896c71466bf24352a)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:33.875766 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf35ee3d-97a6-4db4-9097-515988391947 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:34.119634 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-bf35ee3d-97a6-4db4-9097-515988391947 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4b9c7f39ca641d896c71466bf24352a'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:34.148185 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-bf35ee3d-97a6-4db4-9097-515988391947 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4b9c7f39ca641d896c71466bf24352a'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:34.154206 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:20:34.171227 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-bf35ee3d-97a6-4db4-9097-515988391947 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4b9c7f39ca641d896c71466bf24352a'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:34.172407 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-bf35ee3d-97a6-4db4-9097-515988391947 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4b9c7f39ca641d896c71466bf24352a'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:34.261359 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-bf35ee3d-97a6-4db4-9097-515988391947 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4b9c7f39ca641d896c71466bf24352a'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:34.303240 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 860/1706] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 31 00:20:33 2022] DELETE /identity/v3/users/e4b9c7f39ca641d896c71466bf24352a => generated 0 bytes in 693 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:20:34.305642 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cb21bf-5e73-4040-8047-6c8bc5a56b09 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:34.306779 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cb21bf-5e73-4040-8047-6c8bc5a56b09 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:34.307367 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cb21bf-5e73-4040-8047-6c8bc5a56b09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:34.406023 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-a5cb21bf-5e73-4040-8047-6c8bc5a56b09 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:20:34.418677 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-a5cb21bf-5e73-4040-8047-6c8bc5a56b09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:34.676040 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d93b3b-b796-4c5c-a36c-6102194e2600 None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:34.677822 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d93b3b-b796-4c5c-a36c-6102194e2600 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:34.685727 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d93b3b-b796-4c5c-a36c-6102194e2600 None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:34.692760 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 861/1707] 10.222.0.47 () {54 vars in 912 bytes} [Wed Aug 31 00:20:34 2022] GET /identity => generated 270 bytes in 19 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 00:20:34.701957 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cde256-de26-46aa-9122-96fb8ac832e8 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:34.702435 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cde256-de26-46aa-9122-96fb8ac832e8 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:34.703175 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cde256-de26-46aa-9122-96fb8ac832e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:34.758782 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 847/1708] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:20:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 456 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:20:34.881499 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-99cde256-de26-46aa-9122-96fb8ac832e8 None None] MFA Rules not processed for user `daae792cd11d4c4ca7aae0558998aced`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:20:34.884486 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-99cde256-de26-46aa-9122-96fb8ac832e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:35.108872 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 862/1709] 10.222.0.47 () {58 vars in 1009 bytes} [Wed Aug 31 00:20:34 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 408 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:20:35.155584 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cb21bf-5e73-4040-8047-6c8bc5a56b09 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:35.159686 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-a5cb21bf-5e73-4040-8047-6c8bc5a56b09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:35.180689 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:20:35.194849 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cb21bf-5e73-4040-8047-6c8bc5a56b09 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:35.208927 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c175f6bc-22aa-484e-96f3-c4088757120d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'daae792cd11d4c4ca7aae0558998aced', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:35.209649 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cde256-de26-46aa-9122-96fb8ac832e8 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:35.211968 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c175f6bc-22aa-484e-96f3-c4088757120d service neutron] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:35.212338 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c175f6bc-22aa-484e-96f3-c4088757120d service neutron] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:35.212621 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c175f6bc-22aa-484e-96f3-c4088757120d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:35.213413 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-99cde256-de26-46aa-9122-96fb8ac832e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:35.235458 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c175f6bc-22aa-484e-96f3-c4088757120d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:35.236896 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c175f6bc-22aa-484e-96f3-c4088757120d service neutron] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:35.256635 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 848/1710] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:20:35 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:20:35.273105 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cde256-de26-46aa-9122-96fb8ac832e8 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:35.290057 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd5bcc3-34ec-4cd4-97f3-ae437b1ecd39 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'daae792cd11d4c4ca7aae0558998aced', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:35.294076 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd5bcc3-34ec-4cd4-97f3-ae437b1ecd39 service neutron] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:35.294853 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd5bcc3-34ec-4cd4-97f3-ae437b1ecd39 service neutron] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:35.301315 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd5bcc3-34ec-4cd4-97f3-ae437b1ecd39 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:35.336905 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd5bcc3-34ec-4cd4-97f3-ae437b1ecd39 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:35.342533 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd5bcc3-34ec-4cd4-97f3-ae437b1ecd39 service neutron] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:35.399524 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 863/1711] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:20:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:20:36.618664 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c175f6bc-22aa-484e-96f3-c4088757120d service neutron] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:36.629253 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-c175f6bc-22aa-484e-96f3-c4088757120d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:36.734096 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45854b4c-dabe-4548-b162-372f2978217d None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:36.735012 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45854b4c-dabe-4548-b162-372f2978217d None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:36.735496 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45854b4c-dabe-4548-b162-372f2978217d None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:36.737360 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 864/1712] 10.222.0.47 () {54 vars in 912 bytes} [Wed Aug 31 00:20:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 00:20:36.756528 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2383b5bf-c394-496a-b23c-d3a750eace03 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:36.757052 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2383b5bf-c394-496a-b23c-d3a750eace03 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:36.757472 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2383b5bf-c394-496a-b23c-d3a750eace03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:36.784714 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c175f6bc-22aa-484e-96f3-c4088757120d service neutron] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:36.795323 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b27816-aa14-4ad3-b995-eafc80f1e1fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:36.799828 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b27816-aa14-4ad3-b995-eafc80f1e1fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:36.803978 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b27816-aa14-4ad3-b995-eafc80f1e1fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:36.805710 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b27816-aa14-4ad3-b995-eafc80f1e1fa admin admin] PATH_INFO: `/v3/projects/4d03daf82c6f457e883bb6e72c2d5d86` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:36.810731 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-2383b5bf-c394-496a-b23c-d3a750eace03 None None] MFA Rules not processed for user `9ea002bf49c248dbae7147665fa10fd1`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:20:36.812005 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-2383b5bf-c394-496a-b23c-d3a750eace03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:36.812710 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b27816-aa14-4ad3-b995-eafc80f1e1fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d03daf82c6f457e883bb6e72c2d5d86)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:36.818198 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b27816-aa14-4ad3-b995-eafc80f1e1fa admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:37.104618 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 865/1713] 10.222.0.47 () {58 vars in 1009 bytes} [Wed Aug 31 00:20:36 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 349 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:20:37.106416 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacd56de-958d-4283-943d-c072030ee4c0 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:37.106824 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacd56de-958d-4283-943d-c072030ee4c0 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:37.107205 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacd56de-958d-4283-943d-c072030ee4c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:37.127209 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-d0b27816-aa14-4ad3-b995-eafc80f1e1fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d03daf82c6f457e883bb6e72c2d5d86', 'request_id': 'req-d0b27816-aa14-4ad3-b995-eafc80f1e1fa'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:37.161012 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-d0b27816-aa14-4ad3-b995-eafc80f1e1fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d03daf82c6f457e883bb6e72c2d5d86', 'request_id': 'req-d0b27816-aa14-4ad3-b995-eafc80f1e1fa'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:37.188508 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-d0b27816-aa14-4ad3-b995-eafc80f1e1fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d03daf82c6f457e883bb6e72c2d5d86', 'request_id': 'req-d0b27816-aa14-4ad3-b995-eafc80f1e1fa'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:37.195558 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-bacd56de-958d-4283-943d-c072030ee4c0 None None] MFA Rules not processed for user `08fa033114244fc89c82939202f911e7`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:20:37.197340 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-bacd56de-958d-4283-943d-c072030ee4c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:37.279710 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-d0b27816-aa14-4ad3-b995-eafc80f1e1fa admin admin] The token cache is being invalidate because project 4d03daf82c6f457e883bb6e72c2d5d86 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81523) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:20:37.281460 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-d0b27816-aa14-4ad3-b995-eafc80f1e1fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:37.285035 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-d0b27816-aa14-4ad3-b995-eafc80f1e1fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:37.299033 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 849/1714] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 31 00:20:36 2022] DELETE /identity/v3/projects/4d03daf82c6f457e883bb6e72c2d5d86 => generated 0 bytes in 686 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:20:37.303839 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b27816-aa14-4ad3-b995-eafc80f1e1fa admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:37.315485 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-d0b27816-aa14-4ad3-b995-eafc80f1e1fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:37.373853 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:DELETE=3,keystone:SELECT=97 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:20:37.408971 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 866/1715] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:20:37 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:20:37.429845 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacd56de-958d-4283-943d-c072030ee4c0 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:37.442525 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-bacd56de-958d-4283-943d-c072030ee4c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:37.647985 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacd56de-958d-4283-943d-c072030ee4c0 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:37.660733 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d08807-e421-4042-8f3b-7e57ce8782de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'daae792cd11d4c4ca7aae0558998aced', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:37.661382 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d08807-e421-4042-8f3b-7e57ce8782de service neutron] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:37.664543 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d08807-e421-4042-8f3b-7e57ce8782de service neutron] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:37.664875 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d08807-e421-4042-8f3b-7e57ce8782de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:37.668963 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-a3d08807-e421-4042-8f3b-7e57ce8782de service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:37.728501 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b27816-aa14-4ad3-b995-eafc80f1e1fa admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:37.752379 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee075f4d-06ba-47e3-8b60-ac4819b92e34 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f76e01e32264ff7a6a7740ffa0a207d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:37.754958 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee075f4d-06ba-47e3-8b60-ac4819b92e34 service placement] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:37.755650 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee075f4d-06ba-47e3-8b60-ac4819b92e34 service placement] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:37.759531 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee075f4d-06ba-47e3-8b60-ac4819b92e34 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:37.764969 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-ee075f4d-06ba-47e3-8b60-ac4819b92e34 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:37.817555 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee075f4d-06ba-47e3-8b60-ac4819b92e34 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:37.821880 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee075f4d-06ba-47e3-8b60-ac4819b92e34 service placement] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:37.834948 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d08807-e421-4042-8f3b-7e57ce8782de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:37.848289 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d08807-e421-4042-8f3b-7e57ce8782de service neutron] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:37.854208 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 850/1716] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:20:37 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 554 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:20:37.857489 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a70875-eb1b-4a61-8390-e266522e3737 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:37.857970 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a70875-eb1b-4a61-8390-e266522e3737 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:37.858441 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a70875-eb1b-4a61-8390-e266522e3737 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:37.919002 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 867/1717] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:20:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 493 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:20:37.928363 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-b4a70875-eb1b-4a61-8390-e266522e3737 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:20:37.929959 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-b4a70875-eb1b-4a61-8390-e266522e3737 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:38.113177 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 851/1718] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:20:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:20:38.121567 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536a6adb-fff4-4865-8d60-2e63e4646bb8 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:38.121818 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536a6adb-fff4-4865-8d60-2e63e4646bb8 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:38.122073 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5d0a20-4823-4ba4-bf34-d2c3830ffbf9 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:38.122241 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536a6adb-fff4-4865-8d60-2e63e4646bb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:38.122558 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5d0a20-4823-4ba4-bf34-d2c3830ffbf9 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:38.123332 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5d0a20-4823-4ba4-bf34-d2c3830ffbf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:38.140917 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:20:38.176667 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-536a6adb-fff4-4865-8d60-2e63e4646bb8 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:20:38.178779 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-536a6adb-fff4-4865-8d60-2e63e4646bb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:38.184081 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-5a5d0a20-4823-4ba4-bf34-d2c3830ffbf9 None None] MFA Rules not processed for user `2ae7c3709577481b8661ccd80369bd4a`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:20:38.187879 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-5a5d0a20-4823-4ba4-bf34-d2c3830ffbf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:38.196440 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 868/1719] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:20:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:20:38.203281 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536a6adb-fff4-4865-8d60-2e63e4646bb8 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:38.229603 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536a6adb-fff4-4865-8d60-2e63e4646bb8 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:38.245650 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3d6058-84dc-4b29-b570-1c2ea059dcd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:38.246156 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3d6058-84dc-4b29-b570-1c2ea059dcd8 admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:38.246435 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3d6058-84dc-4b29-b570-1c2ea059dcd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:38.246705 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3d6058-84dc-4b29-b570-1c2ea059dcd8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:38.247374 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3d6058-84dc-4b29-b570-1c2ea059dcd8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:20:38.247821 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3d6058-84dc-4b29-b570-1c2ea059dcd8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:38.251815 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3d6058-84dc-4b29-b570-1c2ea059dcd8 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:38.284176 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 869/1720] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 31 00:20:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:20:38.289821 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3d6058-84dc-4b29-b570-1c2ea059dcd8 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:38.345556 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3d6058-84dc-4b29-b570-1c2ea059dcd8 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:38.401717 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d336b5-c514-4bd5-a642-ab18cf454bd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:38.402785 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d336b5-c514-4bd5-a642-ab18cf454bd1 admin admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:38.403672 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d336b5-c514-4bd5-a642-ab18cf454bd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:38.403803 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d336b5-c514-4bd5-a642-ab18cf454bd1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:38.405013 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d336b5-c514-4bd5-a642-ab18cf454bd1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:38.417441 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d336b5-c514-4bd5-a642-ab18cf454bd1 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:38.481033 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 852/1721] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:20:38 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 355 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:20:38.485327 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 870/1722] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 31 00:20:38 2022] POST /identity/v3/projects => generated 367 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:20:38.487674 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236d9671-3897-472c-9af4-ca0558fb8e7e None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:38.488613 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236d9671-3897-472c-9af4-ca0558fb8e7e None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:38.489328 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236d9671-3897-472c-9af4-ca0558fb8e7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:38.491099 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d336b5-c514-4bd5-a642-ab18cf454bd1 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:38.571854 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-236d9671-3897-472c-9af4-ca0558fb8e7e None None] MFA Rules not processed for user `2ae7c3709577481b8661ccd80369bd4a`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:20:38.573141 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-236d9671-3897-472c-9af4-ca0558fb8e7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:38.736398 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:20:38.748593 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d336b5-c514-4bd5-a642-ab18cf454bd1 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:38.757541 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72799447-8d31-4d0a-9243-6736d4d3cacc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:38.760540 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72799447-8d31-4d0a-9243-6736d4d3cacc admin admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:38.760921 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72799447-8d31-4d0a-9243-6736d4d3cacc admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:38.761092 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72799447-8d31-4d0a-9243-6736d4d3cacc admin admin] PATH_INFO: `/v3/users` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:38.761767 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72799447-8d31-4d0a-9243-6736d4d3cacc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:38.765737 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72799447-8d31-4d0a-9243-6736d4d3cacc admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:38.816054 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 871/1723] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 31 00:20:38 2022] POST /identity/v3/users => generated 284 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:20:38.817489 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72799447-8d31-4d0a-9243-6736d4d3cacc admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:38.820049 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-72799447-8d31-4d0a-9243-6736d4d3cacc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:38.853130 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72799447-8d31-4d0a-9243-6736d4d3cacc admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:38.873204 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16270fd-ea81-4935-b177-3a7971051adc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:38.874285 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 853/1724] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:20:38 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 389 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:20:38.875519 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16270fd-ea81-4935-b177-3a7971051adc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:38.876641 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16270fd-ea81-4935-b177-3a7971051adc admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:38.877198 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236d9671-3897-472c-9af4-ca0558fb8e7e None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:38.877497 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16270fd-ea81-4935-b177-3a7971051adc admin admin] PATH_INFO: `/v3/projects/0a5cf104b4974638b08149fe30eedf1e` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:38.882192 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16270fd-ea81-4935-b177-3a7971051adc admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a5cf104b4974638b08149fe30eedf1e)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:38.889166 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16270fd-ea81-4935-b177-3a7971051adc admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:38.931595 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236d9671-3897-472c-9af4-ca0558fb8e7e None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:38.953611 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aebd854-749d-4149-af58-6110adad4949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:38.954572 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aebd854-749d-4149-af58-6110adad4949 admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:38.961390 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aebd854-749d-4149-af58-6110adad4949 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:38.962648 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aebd854-749d-4149-af58-6110adad4949 admin admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:38.964195 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aebd854-749d-4149-af58-6110adad4949 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:38.968356 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aebd854-749d-4149-af58-6110adad4949 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:39.048758 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 854/1725] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 00:20:38 2022] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:20:39.048758 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aebd854-749d-4149-af58-6110adad4949 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:39.058623 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-2aebd854-749d-4149-af58-6110adad4949 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:39.092696 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-c16270fd-ea81-4935-b177-3a7971051adc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a5cf104b4974638b08149fe30eedf1e', 'request_id': 'req-c16270fd-ea81-4935-b177-3a7971051adc'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:39.118247 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-c16270fd-ea81-4935-b177-3a7971051adc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a5cf104b4974638b08149fe30eedf1e', 'request_id': 'req-c16270fd-ea81-4935-b177-3a7971051adc'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:39.142997 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-c16270fd-ea81-4935-b177-3a7971051adc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a5cf104b4974638b08149fe30eedf1e', 'request_id': 'req-c16270fd-ea81-4935-b177-3a7971051adc'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:39.181697 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-c16270fd-ea81-4935-b177-3a7971051adc admin admin] The token cache is being invalidate because project 0a5cf104b4974638b08149fe30eedf1e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:20:39.182005 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-c16270fd-ea81-4935-b177-3a7971051adc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:39.189459 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-c16270fd-ea81-4935-b177-3a7971051adc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:39.192854 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 872/1726] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 31 00:20:38 2022] DELETE /identity/v3/projects/0a5cf104b4974638b08149fe30eedf1e => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:20:39.198914 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16270fd-ea81-4935-b177-3a7971051adc admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:39.201922 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-c16270fd-ea81-4935-b177-3a7971051adc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:39.454857 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16270fd-ea81-4935-b177-3a7971051adc admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:39.493909 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e1dc55-ad95-410c-bc07-3a7aa35a8a8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:39.497682 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e1dc55-ad95-410c-bc07-3a7aa35a8a8c admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:39.497979 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e1dc55-ad95-410c-bc07-3a7aa35a8a8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:39.498254 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e1dc55-ad95-410c-bc07-3a7aa35a8a8c admin admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:39.498965 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e1dc55-ad95-410c-bc07-3a7aa35a8a8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:39.514511 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e1dc55-ad95-410c-bc07-3a7aa35a8a8c admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:39.579378 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 873/1727] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 00:20:39 2022] GET /identity/v3/roles => generated 1420 bytes in 386 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:20:39.583709 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e1dc55-ad95-410c-bc07-3a7aa35a8a8c admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:39.593951 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-f4e1dc55-ad95-410c-bc07-3a7aa35a8a8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:39.597605 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aebd854-749d-4149-af58-6110adad4949 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:39.653547 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e1dc55-ad95-410c-bc07-3a7aa35a8a8c admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:39.670614 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:20:39.676017 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70aea8fe-b9ee-4e4e-89d7-6f1080442c1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:39.676724 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70aea8fe-b9ee-4e4e-89d7-6f1080442c1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:39.676999 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70aea8fe-b9ee-4e4e-89d7-6f1080442c1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:39.679112 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70aea8fe-b9ee-4e4e-89d7-6f1080442c1a admin admin] PATH_INFO: `/v3/users/013acb36003140939f7435dfe40d51d0` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:39.697572 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70aea8fe-b9ee-4e4e-89d7-6f1080442c1a admin admin] RBAC: Authorizing `identity:delete_user(user_id=013acb36003140939f7435dfe40d51d0)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:39.702887 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70aea8fe-b9ee-4e4e-89d7-6f1080442c1a admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:39.793748 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51fbcd3-ca14-452e-82a1-ba5627d732d4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea002bf49c248dbae7147665fa10fd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:39.795038 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51fbcd3-ca14-452e-82a1-ba5627d732d4 service nova] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:39.796567 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51fbcd3-ca14-452e-82a1-ba5627d732d4 service nova] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:39.801974 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51fbcd3-ca14-452e-82a1-ba5627d732d4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:39.813080 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-a51fbcd3-ca14-452e-82a1-ba5627d732d4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:39.937137 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-70aea8fe-b9ee-4e4e-89d7-6f1080442c1a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '013acb36003140939f7435dfe40d51d0'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:39.995647 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-70aea8fe-b9ee-4e4e-89d7-6f1080442c1a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '013acb36003140939f7435dfe40d51d0'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:40.011442 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=81,keystone:INSERT=5,keystone:DELETE=14 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:20:40.027759 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-70aea8fe-b9ee-4e4e-89d7-6f1080442c1a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '013acb36003140939f7435dfe40d51d0'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:40.030042 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-70aea8fe-b9ee-4e4e-89d7-6f1080442c1a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '013acb36003140939f7435dfe40d51d0'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:40.069379 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-70aea8fe-b9ee-4e4e-89d7-6f1080442c1a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '013acb36003140939f7435dfe40d51d0'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:40.084772 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 874/1728] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 31 00:20:39 2022] DELETE /identity/v3/users/013acb36003140939f7435dfe40d51d0 => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:20:40.091214 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70aea8fe-b9ee-4e4e-89d7-6f1080442c1a admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:40.095886 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-70aea8fe-b9ee-4e4e-89d7-6f1080442c1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:40.174696 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51fbcd3-ca14-452e-82a1-ba5627d732d4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:40.177506 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51fbcd3-ca14-452e-82a1-ba5627d732d4 service nova] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:40.228398 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 855/1729] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:20:39 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 1182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:20:40.232315 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4114144a-943c-4fe4-acf1-3899ad6c49b3 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:40.233118 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4114144a-943c-4fe4-acf1-3899ad6c49b3 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:40.234776 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4114144a-943c-4fe4-acf1-3899ad6c49b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:40.333385 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70aea8fe-b9ee-4e4e-89d7-6f1080442c1a admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:40.344633 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd09e036-fc75-4f1a-9aa8-02b669ec6b7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:40.345925 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd09e036-fc75-4f1a-9aa8-02b669ec6b7b admin admin] REQUEST_METHOD: `PUT` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:40.346360 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd09e036-fc75-4f1a-9aa8-02b669ec6b7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:40.346827 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd09e036-fc75-4f1a-9aa8-02b669ec6b7b admin admin] PATH_INFO: `/v3/projects/6d4e9d35dbf54e908de7560f0cd78b2d/users/6a6293d52f6c4bd5a51fe9d952d38c97/roles/fdad79ffbcbb4fa380dc9cf7dd108618` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:40.366539 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-4114144a-943c-4fe4-acf1-3899ad6c49b3 None None] MFA Rules not processed for user `f8ffd2d3c0c141118a7a9a5696c383e1`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:20:40.368633 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-4114144a-943c-4fe4-acf1-3899ad6c49b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:40.426352 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd09e036-fc75-4f1a-9aa8-02b669ec6b7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d4e9d35dbf54e908de7560f0cd78b2d, user_id=6a6293d52f6c4bd5a51fe9d952d38c97, role_id=fdad79ffbcbb4fa380dc9cf7dd108618)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:40.430734 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd09e036-fc75-4f1a-9aa8-02b669ec6b7b admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:40.480187 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 875/1730] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 00:20:40 2022] PUT /identity/v3/projects/6d4e9d35dbf54e908de7560f0cd78b2d/users/6a6293d52f6c4bd5a51fe9d952d38c97/roles/fdad79ffbcbb4fa380dc9cf7dd108618 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:20:40.482574 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c24878-eeb2-428f-9e95-f7be0ca243f0 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:40.484821 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c24878-eeb2-428f-9e95-f7be0ca243f0 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:40.485431 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c24878-eeb2-428f-9e95-f7be0ca243f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:40.638312 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-a0c24878-eeb2-428f-9e95-f7be0ca243f0 None None] MFA Rules not processed for user `b3da9d7af0fd4c1d99973e6b277b16d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:20:40.641543 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-a0c24878-eeb2-428f-9e95-f7be0ca243f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:40.678246 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 856/1731] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:20:40 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 449 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:20:40.682966 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17aaf5d2-d114-496f-90c1-fa20b4029b5f None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:40.683485 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17aaf5d2-d114-496f-90c1-fa20b4029b5f None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:40.683902 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17aaf5d2-d114-496f-90c1-fa20b4029b5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:40.810265 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-17aaf5d2-d114-496f-90c1-fa20b4029b5f None None] MFA Rules not processed for user `6a6293d52f6c4bd5a51fe9d952d38c97`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:20:40.814862 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-17aaf5d2-d114-496f-90c1-fa20b4029b5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:40.854805 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 876/1732] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:20:40 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 374 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:20:40.864296 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6593dba-51b3-4e08-a7ed-657daee90b2b None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:40.864927 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6593dba-51b3-4e08-a7ed-657daee90b2b None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:40.866605 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6593dba-51b3-4e08-a7ed-657daee90b2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:40.978203 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:20:40.991526 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-d6593dba-51b3-4e08-a7ed-657daee90b2b None None] MFA Rules not processed for user `f8ffd2d3c0c141118a7a9a5696c383e1`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:20:40.993865 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-d6593dba-51b3-4e08-a7ed-657daee90b2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:41.045516 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 857/1733] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:20:40 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 363 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:20:41.051581 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17aaf5d2-d114-496f-90c1-fa20b4029b5f None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:41.161006 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:DELETE=3,keystone:SELECT=96,keystone:INSERT=1 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:20:41.171646 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17aaf5d2-d114-496f-90c1-fa20b4029b5f None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:41.189121 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6f4b8d-a295-441f-93e4-5558b0be459b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:41.189850 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6f4b8d-a295-441f-93e4-5558b0be459b admin admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:41.190048 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6f4b8d-a295-441f-93e4-5558b0be459b admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:41.190352 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6f4b8d-a295-441f-93e4-5558b0be459b admin admin] PATH_INFO: `/v3/projects` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:41.191058 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6f4b8d-a295-441f-93e4-5558b0be459b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:41.194934 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6f4b8d-a295-441f-93e4-5558b0be459b admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:41.211943 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 877/1734] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:20:40 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 356 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:20:41.289741 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6593dba-51b3-4e08-a7ed-657daee90b2b None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:41.291321 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-d6593dba-51b3-4e08-a7ed-657daee90b2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:41.328952 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6593dba-51b3-4e08-a7ed-657daee90b2b None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:41.329857 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 858/1735] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 31 00:20:41 2022] POST /identity/v3/projects => generated 367 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:20:41.331020 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6f4b8d-a295-441f-93e4-5558b0be459b admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:41.552574 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6f4b8d-a295-441f-93e4-5558b0be459b admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:41.571508 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2aeaed-2c79-49fe-adb3-781496fee732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:41.572704 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2aeaed-2c79-49fe-adb3-781496fee732 admin admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:41.573195 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2aeaed-2c79-49fe-adb3-781496fee732 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:41.573677 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2aeaed-2c79-49fe-adb3-781496fee732 admin admin] PATH_INFO: `/v3/users` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:41.575043 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2aeaed-2c79-49fe-adb3-781496fee732 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:41.577277 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2aeaed-2c79-49fe-adb3-781496fee732 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:41.637595 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1526397e-eeee-4ecf-bc6f-842ba91b808c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:41.638340 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1526397e-eeee-4ecf-bc6f-842ba91b808c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:41.638887 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1526397e-eeee-4ecf-bc6f-842ba91b808c admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:41.639305 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1526397e-eeee-4ecf-bc6f-842ba91b808c admin admin] PATH_INFO: `/v3/projects/92158ead19764e13b0acea6970237a17` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:41.648654 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 859/1736] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 31 00:20:41 2022] POST /identity/v3/users => generated 290 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:20:41.652897 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1526397e-eeee-4ecf-bc6f-842ba91b808c admin admin] RBAC: Authorizing `identity:delete_project(project_id=92158ead19764e13b0acea6970237a17)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:41.654543 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2aeaed-2c79-49fe-adb3-781496fee732 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:41.669586 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1526397e-eeee-4ecf-bc6f-842ba91b808c admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:41.682742 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2aeaed-2c79-49fe-adb3-781496fee732 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:41.731377 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b94b2e-c1fc-4545-a263-cf716bc4ad25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:41.736689 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b94b2e-c1fc-4545-a263-cf716bc4ad25 admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:41.744726 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b94b2e-c1fc-4545-a263-cf716bc4ad25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:41.745362 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b94b2e-c1fc-4545-a263-cf716bc4ad25 admin admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:41.752932 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b94b2e-c1fc-4545-a263-cf716bc4ad25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:41.771869 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b94b2e-c1fc-4545-a263-cf716bc4ad25 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:41.846515 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 860/1737] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 00:20:41 2022] GET /identity/v3/roles => generated 1420 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:20:41.852337 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b94b2e-c1fc-4545-a263-cf716bc4ad25 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:41.917495 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b94b2e-c1fc-4545-a263-cf716bc4ad25 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:42.022469 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-1526397e-eeee-4ecf-bc6f-842ba91b808c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92158ead19764e13b0acea6970237a17', 'request_id': 'req-1526397e-eeee-4ecf-bc6f-842ba91b808c'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:42.038146 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-1526397e-eeee-4ecf-bc6f-842ba91b808c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92158ead19764e13b0acea6970237a17', 'request_id': 'req-1526397e-eeee-4ecf-bc6f-842ba91b808c'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:42.055331 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-1526397e-eeee-4ecf-bc6f-842ba91b808c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92158ead19764e13b0acea6970237a17', 'request_id': 'req-1526397e-eeee-4ecf-bc6f-842ba91b808c'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:42.083322 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-1526397e-eeee-4ecf-bc6f-842ba91b808c admin admin] The token cache is being invalidate because project 92158ead19764e13b0acea6970237a17 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:20:42.083973 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-1526397e-eeee-4ecf-bc6f-842ba91b808c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:42.104659 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-1526397e-eeee-4ecf-bc6f-842ba91b808c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:42.106873 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 878/1738] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 31 00:20:41 2022] DELETE /identity/v3/projects/92158ead19764e13b0acea6970237a17 => generated 0 bytes in 818 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:20:42.108252 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85212c9a-6261-4b28-ab85-85e97eb5dfbd None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:42.108706 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85212c9a-6261-4b28-ab85-85e97eb5dfbd None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:42.109113 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85212c9a-6261-4b28-ab85-85e97eb5dfbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:42.155389 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-85212c9a-6261-4b28-ab85-85e97eb5dfbd None None] MFA Rules not processed for user `daae792cd11d4c4ca7aae0558998aced`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:20:42.157022 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-85212c9a-6261-4b28-ab85-85e97eb5dfbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:42.200973 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:20:42.247134 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb1ce86-94fe-47d2-b5e5-81804cec5199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:42.247963 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb1ce86-94fe-47d2-b5e5-81804cec5199 admin admin] REQUEST_METHOD: `PUT` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:42.248450 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb1ce86-94fe-47d2-b5e5-81804cec5199 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:42.249775 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb1ce86-94fe-47d2-b5e5-81804cec5199 admin admin] PATH_INFO: `/v3/projects/47572fc2b5ab42db8456f8ef94829a07/users/49578d26dec64657be9804e69633112e/roles/12f6817f9aaa4e2bb477095a6bed5d0f` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:42.292408 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb1ce86-94fe-47d2-b5e5-81804cec5199 admin admin] RBAC: Authorizing `identity:create_grant(project_id=47572fc2b5ab42db8456f8ef94829a07, user_id=49578d26dec64657be9804e69633112e, role_id=12f6817f9aaa4e2bb477095a6bed5d0f)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:42.295649 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb1ce86-94fe-47d2-b5e5-81804cec5199 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:42.329306 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 861/1739] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 00:20:41 2022] PUT /identity/v3/projects/47572fc2b5ab42db8456f8ef94829a07/users/49578d26dec64657be9804e69633112e/roles/12f6817f9aaa4e2bb477095a6bed5d0f => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:20:42.331184 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b9b6ab-fb63-4baf-8b03-9dc23facfd74 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:42.331573 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b9b6ab-fb63-4baf-8b03-9dc23facfd74 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:42.332172 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b9b6ab-fb63-4baf-8b03-9dc23facfd74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:42.332584 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 879/1740] 10.222.0.47 () {58 vars in 1009 bytes} [Wed Aug 31 00:20:42 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:20:42.335226 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85212c9a-6261-4b28-ab85-85e97eb5dfbd None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:42.340755 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-85212c9a-6261-4b28-ab85-85e97eb5dfbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:42.366144 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-43b9b6ab-fb63-4baf-8b03-9dc23facfd74 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:20:42.367857 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-43b9b6ab-fb63-4baf-8b03-9dc23facfd74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:42.509962 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:20:42.532365 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 862/1741] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:20:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:20:42.533965 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b9b6ab-fb63-4baf-8b03-9dc23facfd74 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:42.540186 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-43b9b6ab-fb63-4baf-8b03-9dc23facfd74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:42.613126 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b9b6ab-fb63-4baf-8b03-9dc23facfd74 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:42.620273 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bb2c03-902b-46d8-9e70-3a06c43b5a4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:42.621151 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bb2c03-902b-46d8-9e70-3a06c43b5a4e admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:42.621606 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bb2c03-902b-46d8-9e70-3a06c43b5a4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:42.622071 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bb2c03-902b-46d8-9e70-3a06c43b5a4e admin admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:42.623021 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bb2c03-902b-46d8-9e70-3a06c43b5a4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:42.626596 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bb2c03-902b-46d8-9e70-3a06c43b5a4e admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:42.651772 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85212c9a-6261-4b28-ab85-85e97eb5dfbd None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:42.663482 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 863/1742] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 00:20:42 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:20:42.664862 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bb2c03-902b-46d8-9e70-3a06c43b5a4e admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:42.668738 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-e2bb2c03-902b-46d8-9e70-3a06c43b5a4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:42.784176 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bb2c03-902b-46d8-9e70-3a06c43b5a4e admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:42.815382 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bdc1c2-9d3c-452b-959b-bcb4f48673ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'daae792cd11d4c4ca7aae0558998aced', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:42.816261 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bdc1c2-9d3c-452b-959b-bcb4f48673ab service neutron] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:42.817046 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bdc1c2-9d3c-452b-959b-bcb4f48673ab service neutron] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:42.817320 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bdc1c2-9d3c-452b-959b-bcb4f48673ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:42.821351 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3480b3-1967-46cc-8ced-5bf8496fc218 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea002bf49c248dbae7147665fa10fd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:42.822275 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3480b3-1967-46cc-8ced-5bf8496fc218 service nova] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:42.822652 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3480b3-1967-46cc-8ced-5bf8496fc218 service nova] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:42.822900 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3480b3-1967-46cc-8ced-5bf8496fc218 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:42.826051 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-6d3480b3-1967-46cc-8ced-5bf8496fc218 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:42.839220 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bdc1c2-9d3c-452b-959b-bcb4f48673ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:42.841073 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bdc1c2-9d3c-452b-959b-bcb4f48673ab service neutron] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:42.881345 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 864/1743] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:20:42 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:20:42.889637 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e589f74-a31a-4e9b-a20a-34734021f74b None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:42.890130 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e589f74-a31a-4e9b-a20a-34734021f74b None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:42.890628 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e589f74-a31a-4e9b-a20a-34734021f74b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:42.976827 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3480b3-1967-46cc-8ced-5bf8496fc218 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:42.978497 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3480b3-1967-46cc-8ced-5bf8496fc218 service nova] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:42.992687 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 880/1744] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:20:42 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 660 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:20:42.993793 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3480b3-1967-46cc-8ced-5bf8496fc218 service nova] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:43.003753 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-0e589f74-a31a-4e9b-a20a-34734021f74b None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:20:43.005126 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-0e589f74-a31a-4e9b-a20a-34734021f74b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:43.008271 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3480b3-1967-46cc-8ced-5bf8496fc218 service nova] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:43.014774 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d27fc41-4e13-4cea-b5f2-78ad67c40325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:43.015703 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d27fc41-4e13-4cea-b5f2-78ad67c40325 admin admin] REQUEST_METHOD: `PUT` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:43.016139 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d27fc41-4e13-4cea-b5f2-78ad67c40325 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:43.016613 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d27fc41-4e13-4cea-b5f2-78ad67c40325 admin admin] PATH_INFO: `/v3/projects/47572fc2b5ab42db8456f8ef94829a07/users/49578d26dec64657be9804e69633112e/roles/12f6817f9aaa4e2bb477095a6bed5d0f` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:43.019052 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d27fc41-4e13-4cea-b5f2-78ad67c40325 admin admin] RBAC: Authorizing `identity:create_grant(project_id=47572fc2b5ab42db8456f8ef94829a07, user_id=49578d26dec64657be9804e69633112e, role_id=12f6817f9aaa4e2bb477095a6bed5d0f)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:43.023240 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d27fc41-4e13-4cea-b5f2-78ad67c40325 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:43.038293 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 881/1745] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 00:20:42 2022] PUT /identity/v3/projects/47572fc2b5ab42db8456f8ef94829a07/users/49578d26dec64657be9804e69633112e/roles/12f6817f9aaa4e2bb477095a6bed5d0f => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:20:43.047586 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 865/1746] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:20:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:20:43.047708 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e589f74-a31a-4e9b-a20a-34734021f74b None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:43.049582 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe75336-4233-4ef5-8913-f4ab4d15b443 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:43.050067 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe75336-4233-4ef5-8913-f4ab4d15b443 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:43.050501 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe75336-4233-4ef5-8913-f4ab4d15b443 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:43.072246 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e589f74-a31a-4e9b-a20a-34734021f74b None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:43.088957 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-5fe75336-4233-4ef5-8913-f4ab4d15b443 None None] MFA Rules not processed for user `49578d26dec64657be9804e69633112e`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:20:43.091383 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-5fe75336-4233-4ef5-8913-f4ab4d15b443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:43.154410 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:20:43.191889 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 882/1747] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:20:43 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:20:43.204655 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe75336-4233-4ef5-8913-f4ab4d15b443 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:43.208346 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:20:43.212091 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-5fe75336-4233-4ef5-8913-f4ab4d15b443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:43.244809 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fba831-c621-4975-91ad-2dec56eec2a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:43.245656 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fba831-c621-4975-91ad-2dec56eec2a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:43.247455 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fba831-c621-4975-91ad-2dec56eec2a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:43.247455 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fba831-c621-4975-91ad-2dec56eec2a7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:43.248689 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fba831-c621-4975-91ad-2dec56eec2a7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:20:43.249008 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fba831-c621-4975-91ad-2dec56eec2a7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:43.250770 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fba831-c621-4975-91ad-2dec56eec2a7 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:43.285681 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 866/1748] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 31 00:20:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:20:43.286696 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fba831-c621-4975-91ad-2dec56eec2a7 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:43.328355 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fba831-c621-4975-91ad-2dec56eec2a7 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:43.347689 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0912d76b-7657-46ab-aefa-1234e93d9695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:43.348354 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0912d76b-7657-46ab-aefa-1234e93d9695 admin admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:43.348641 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0912d76b-7657-46ab-aefa-1234e93d9695 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:43.349037 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0912d76b-7657-46ab-aefa-1234e93d9695 admin admin] PATH_INFO: `/v3/projects` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:43.351809 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0912d76b-7657-46ab-aefa-1234e93d9695 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:43.354142 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0912d76b-7657-46ab-aefa-1234e93d9695 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:43.412948 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe75336-4233-4ef5-8913-f4ab4d15b443 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:43.432778 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f2e7e0-928f-431b-b329-895944e81b04 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beecda6e9feb400288618745c784989f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:43.433822 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f2e7e0-928f-431b-b329-895944e81b04 service cinder] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:43.434290 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f2e7e0-928f-431b-b329-895944e81b04 service cinder] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:43.434787 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f2e7e0-928f-431b-b329-895944e81b04 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:43.438362 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 867/1749] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 31 00:20:43 2022] POST /identity/v3/projects => generated 379 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:20:43.439377 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0912d76b-7657-46ab-aefa-1234e93d9695 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:43.465162 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f2e7e0-928f-431b-b329-895944e81b04 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:43.470087 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f2e7e0-928f-431b-b329-895944e81b04 service cinder] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:43.505994 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 883/1750] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:20:43 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:20:43.509848 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f2e7e0-928f-431b-b329-895944e81b04 service cinder] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:43.582525 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f2e7e0-928f-431b-b329-895944e81b04 service cinder] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:43.636691 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0912d76b-7657-46ab-aefa-1234e93d9695 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:43.653866 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa188eca-bfde-4944-9efc-2c971c230fc4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea002bf49c248dbae7147665fa10fd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:43.654759 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa188eca-bfde-4944-9efc-2c971c230fc4 service nova] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:43.655037 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa188eca-bfde-4944-9efc-2c971c230fc4 service nova] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:43.655308 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa188eca-bfde-4944-9efc-2c971c230fc4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:43.659437 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-aa188eca-bfde-4944-9efc-2c971c230fc4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:43.861168 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbe4c02-2080-4461-9744-c36f913dee07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:43.862143 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbe4c02-2080-4461-9744-c36f913dee07 admin admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:43.862423 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbe4c02-2080-4461-9744-c36f913dee07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:43.862700 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbe4c02-2080-4461-9744-c36f913dee07 admin admin] PATH_INFO: `/v3/users` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:43.863811 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbe4c02-2080-4461-9744-c36f913dee07 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:43.866016 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbe4c02-2080-4461-9744-c36f913dee07 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:43.867494 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa188eca-bfde-4944-9efc-2c971c230fc4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:43.869304 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa188eca-bfde-4944-9efc-2c971c230fc4 service nova] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:43.909488 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 868/1751] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:20:43 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 470 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:20:43.912615 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa188eca-bfde-4944-9efc-2c971c230fc4 service nova] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:43.973007 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 884/1752] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 31 00:20:43 2022] POST /identity/v3/users => generated 290 bytes in 466 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:20:43.978701 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbe4c02-2080-4461-9744-c36f913dee07 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:44.032071 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbe4c02-2080-4461-9744-c36f913dee07 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:44.053879 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1297ef27-5316-4e3e-a44e-74a2e505bc65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:44.054827 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1297ef27-5316-4e3e-a44e-74a2e505bc65 admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:44.055148 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1297ef27-5316-4e3e-a44e-74a2e505bc65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:44.056080 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1297ef27-5316-4e3e-a44e-74a2e505bc65 admin admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:44.057945 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1297ef27-5316-4e3e-a44e-74a2e505bc65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:44.059611 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1297ef27-5316-4e3e-a44e-74a2e505bc65 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:44.105551 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 885/1753] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 00:20:43 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:20:44.112124 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1297ef27-5316-4e3e-a44e-74a2e505bc65 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:44.145878 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1297ef27-5316-4e3e-a44e-74a2e505bc65 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:44.169689 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8f3bad-3e1c-45c1-8235-a09f9397b779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:44.170329 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8f3bad-3e1c-45c1-8235-a09f9397b779 admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:44.170627 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8f3bad-3e1c-45c1-8235-a09f9397b779 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:44.170876 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8f3bad-3e1c-45c1-8235-a09f9397b779 admin admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:44.179013 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8f3bad-3e1c-45c1-8235-a09f9397b779 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:44.180601 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8f3bad-3e1c-45c1-8235-a09f9397b779 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:44.182656 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa188eca-bfde-4944-9efc-2c971c230fc4 service nova] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:44.202417 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7516bd-810a-4678-a679-5de5affba9ea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beecda6e9feb400288618745c784989f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:44.203419 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7516bd-810a-4678-a679-5de5affba9ea service cinder] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:44.203679 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7516bd-810a-4678-a679-5de5affba9ea service cinder] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:44.203955 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7516bd-810a-4678-a679-5de5affba9ea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:44.223768 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-af7516bd-810a-4678-a679-5de5affba9ea service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:44.232698 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 886/1754] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 00:20:44 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:20:44.233736 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8f3bad-3e1c-45c1-8235-a09f9397b779 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:44.257976 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8f3bad-3e1c-45c1-8235-a09f9397b779 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:44.274932 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3022cc3d-af9d-489e-a498-8c27aea0d8a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:44.275895 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3022cc3d-af9d-489e-a498-8c27aea0d8a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:44.276190 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3022cc3d-af9d-489e-a498-8c27aea0d8a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:44.276465 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3022cc3d-af9d-489e-a498-8c27aea0d8a0 admin admin] PATH_INFO: `/v3/projects/466c3360697341f192f1922e358f69aa/users/f5bba275d7bb47b9b2a53d4759d9da51/roles/fdad79ffbcbb4fa380dc9cf7dd108618` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:44.320563 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3022cc3d-af9d-489e-a498-8c27aea0d8a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=466c3360697341f192f1922e358f69aa, user_id=f5bba275d7bb47b9b2a53d4759d9da51, role_id=fdad79ffbcbb4fa380dc9cf7dd108618)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:44.327220 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3022cc3d-af9d-489e-a498-8c27aea0d8a0 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:44.354474 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:20:44.378456 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 887/1755] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 00:20:44 2022] PUT /identity/v3/projects/466c3360697341f192f1922e358f69aa/users/f5bba275d7bb47b9b2a53d4759d9da51/roles/fdad79ffbcbb4fa380dc9cf7dd108618 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:20:44.380040 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e7b865-1ace-40f3-9c40-fc9d0b818b2c None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:44.380411 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e7b865-1ace-40f3-9c40-fc9d0b818b2c None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:44.381230 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e7b865-1ace-40f3-9c40-fc9d0b818b2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:44.481306 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-51e7b865-1ace-40f3-9c40-fc9d0b818b2c None None] MFA Rules not processed for user `f5bba275d7bb47b9b2a53d4759d9da51`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:20:44.482588 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-51e7b865-1ace-40f3-9c40-fc9d0b818b2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:44.538391 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:20:44.554385 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7516bd-810a-4678-a679-5de5affba9ea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:44.562282 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7516bd-810a-4678-a679-5de5affba9ea service cinder] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:44.585710 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 869/1756] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:20:43 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 676 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:20:44.832253 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 888/1757] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:20:44 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 450 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:20:44.834324 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7516bd-810a-4678-a679-5de5affba9ea service cinder] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:44.868366 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7516bd-810a-4678-a679-5de5affba9ea service cinder] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:45.106800 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be2c9c7-9ed7-4d83-8a0d-3d7983f35e6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:45.112873 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be2c9c7-9ed7-4d83-8a0d-3d7983f35e6d admin admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:45.114803 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be2c9c7-9ed7-4d83-8a0d-3d7983f35e6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:45.116095 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be2c9c7-9ed7-4d83-8a0d-3d7983f35e6d admin admin] PATH_INFO: `/v3/projects` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:45.118017 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be2c9c7-9ed7-4d83-8a0d-3d7983f35e6d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:45.127147 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be2c9c7-9ed7-4d83-8a0d-3d7983f35e6d admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:45.231119 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 870/1758] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 31 00:20:44 2022] POST /identity/v3/projects => generated 381 bytes in 398 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:20:45.232463 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e7b865-1ace-40f3-9c40-fc9d0b818b2c None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:45.333473 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e7b865-1ace-40f3-9c40-fc9d0b818b2c None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:45.657758 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2679c740-67d0-4734-8afa-ca5d2ec01c67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:45.658613 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2679c740-67d0-4734-8afa-ca5d2ec01c67 admin admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:45.658747 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2679c740-67d0-4734-8afa-ca5d2ec01c67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:45.662602 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2679c740-67d0-4734-8afa-ca5d2ec01c67 admin admin] PATH_INFO: `/v3/users` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:45.663525 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2679c740-67d0-4734-8afa-ca5d2ec01c67 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:45.668926 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2679c740-67d0-4734-8afa-ca5d2ec01c67 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:45.765123 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be2c9c7-9ed7-4d83-8a0d-3d7983f35e6d admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:45.796337 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be2c9c7-9ed7-4d83-8a0d-3d7983f35e6d admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:45.797069 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 889/1759] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 31 00:20:45 2022] POST /identity/v3/users => generated 297 bytes in 564 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:20:45.825099 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a062dec-92d9-41be-91f3-cc449f2654b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:45.825750 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a062dec-92d9-41be-91f3-cc449f2654b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:45.826027 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a062dec-92d9-41be-91f3-cc449f2654b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:45.826354 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a062dec-92d9-41be-91f3-cc449f2654b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:45.827254 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a062dec-92d9-41be-91f3-cc449f2654b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:45.832283 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a062dec-92d9-41be-91f3-cc449f2654b8 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:45.894868 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2679c740-67d0-4734-8afa-ca5d2ec01c67 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:45.903185 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 871/1760] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 00:20:45 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:20:45.916947 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2679c740-67d0-4734-8afa-ca5d2ec01c67 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:45.926970 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01499aee-3a38-4017-b461-afa22f2875b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:45.927758 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01499aee-3a38-4017-b461-afa22f2875b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:45.928210 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01499aee-3a38-4017-b461-afa22f2875b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:45.928697 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01499aee-3a38-4017-b461-afa22f2875b8 admin admin] PATH_INFO: `/v3/projects/818287dc990147748fb60acbc13302d7/users/387b781c263549d9b57e2172531e9a0f/roles/12f6817f9aaa4e2bb477095a6bed5d0f` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:45.953230 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01499aee-3a38-4017-b461-afa22f2875b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=818287dc990147748fb60acbc13302d7, user_id=387b781c263549d9b57e2172531e9a0f, role_id=12f6817f9aaa4e2bb477095a6bed5d0f)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:45.956708 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01499aee-3a38-4017-b461-afa22f2875b8 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:45.990716 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a062dec-92d9-41be-91f3-cc449f2654b8 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:45.991230 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 890/1761] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 00:20:45 2022] PUT /identity/v3/projects/818287dc990147748fb60acbc13302d7/users/387b781c263549d9b57e2172531e9a0f/roles/12f6817f9aaa4e2bb477095a6bed5d0f => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:20:46.020899 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a062dec-92d9-41be-91f3-cc449f2654b8 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:46.199758 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac40aed8-34b8-4e73-b7a4-dedfd353a9ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:46.200859 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac40aed8-34b8-4e73-b7a4-dedfd353a9ef admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:46.201297 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac40aed8-34b8-4e73-b7a4-dedfd353a9ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:46.201793 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac40aed8-34b8-4e73-b7a4-dedfd353a9ef admin admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:46.203418 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac40aed8-34b8-4e73-b7a4-dedfd353a9ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:46.206790 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac40aed8-34b8-4e73-b7a4-dedfd353a9ef admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:46.250862 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01499aee-3a38-4017-b461-afa22f2875b8 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:46.253824 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 872/1762] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 00:20:45 2022] GET /identity/v3/roles => generated 1420 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:20:46.272928 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01499aee-3a38-4017-b461-afa22f2875b8 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:46.282890 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0881344-9643-404c-98c3-0ee72094019a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:46.283754 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0881344-9643-404c-98c3-0ee72094019a admin admin] REQUEST_METHOD: `PUT` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:46.284136 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0881344-9643-404c-98c3-0ee72094019a admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:46.284542 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0881344-9643-404c-98c3-0ee72094019a admin admin] PATH_INFO: `/v3/projects/818287dc990147748fb60acbc13302d7/users/387b781c263549d9b57e2172531e9a0f/roles/12f6817f9aaa4e2bb477095a6bed5d0f` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:46.294726 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0881344-9643-404c-98c3-0ee72094019a admin admin] RBAC: Authorizing `identity:create_grant(project_id=818287dc990147748fb60acbc13302d7, user_id=387b781c263549d9b57e2172531e9a0f, role_id=12f6817f9aaa4e2bb477095a6bed5d0f)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:46.297280 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0881344-9643-404c-98c3-0ee72094019a admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:46.348218 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 891/1763] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 00:20:46 2022] PUT /identity/v3/projects/818287dc990147748fb60acbc13302d7/users/387b781c263549d9b57e2172531e9a0f/roles/12f6817f9aaa4e2bb477095a6bed5d0f => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:20:46.362618 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c6456d-a93c-48d2-9b00-c4420af304e7 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:46.362823 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c6456d-a93c-48d2-9b00-c4420af304e7 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:46.363809 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c6456d-a93c-48d2-9b00-c4420af304e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:46.412431 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-68c6456d-a93c-48d2-9b00-c4420af304e7 None None] MFA Rules not processed for user `387b781c263549d9b57e2172531e9a0f`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:20:46.414232 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-68c6456d-a93c-48d2-9b00-c4420af304e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:46.435634 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:20:46.620850 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0881344-9643-404c-98c3-0ee72094019a admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:46.622065 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 873/1764] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:20:46 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:20:46.822794 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbc11ab-7f95-4a0e-b40d-9a0b2dbff32a None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:46.823351 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbc11ab-7f95-4a0e-b40d-9a0b2dbff32a None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:46.823802 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbc11ab-7f95-4a0e-b40d-9a0b2dbff32a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:46.953115 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-ebbc11ab-7f95-4a0e-b40d-9a0b2dbff32a None None] MFA Rules not processed for user `601aa9e547aa4d42bef6753b26f48eaa`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:20:46.955290 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-ebbc11ab-7f95-4a0e-b40d-9a0b2dbff32a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:47.054826 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0881344-9643-404c-98c3-0ee72094019a admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:47.090519 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7498ca6-f229-42fd-9eea-374c176f7dc6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beecda6e9feb400288618745c784989f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:47.092043 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7498ca6-f229-42fd-9eea-374c176f7dc6 service cinder] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:47.092816 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7498ca6-f229-42fd-9eea-374c176f7dc6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:47.093553 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7498ca6-f229-42fd-9eea-374c176f7dc6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:47.154660 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7498ca6-f229-42fd-9eea-374c176f7dc6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:47.163976 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 874/1765] 10.222.0.47 () {58 vars in 1009 bytes} [Wed Aug 31 00:20:46 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 342 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:20:47.168841 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7498ca6-f229-42fd-9eea-374c176f7dc6 service cinder] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:47.233579 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 892/1766] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:20:46 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 614 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:20:47.569392 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010b3251-542c-4aea-b5ef-8962db2effa6 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:47.570139 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010b3251-542c-4aea-b5ef-8962db2effa6 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:47.570544 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010b3251-542c-4aea-b5ef-8962db2effa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:47.572416 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7498ca6-f229-42fd-9eea-374c176f7dc6 service cinder] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:47.582077 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-f7498ca6-f229-42fd-9eea-374c176f7dc6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:47.640744 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:20:47.652847 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-010b3251-542c-4aea-b5ef-8962db2effa6 None None] MFA Rules not processed for user `f8ffd2d3c0c141118a7a9a5696c383e1`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:20:47.671889 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-010b3251-542c-4aea-b5ef-8962db2effa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:48.153732 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 875/1767] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:20:47 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 587 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:20:48.158454 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010b3251-542c-4aea-b5ef-8962db2effa6 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:48.162315 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-010b3251-542c-4aea-b5ef-8962db2effa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:48.202994 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010b3251-542c-4aea-b5ef-8962db2effa6 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:48.224695 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dacd5f3-6140-437f-8707-b15cbd62aec5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beecda6e9feb400288618745c784989f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:48.225468 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dacd5f3-6140-437f-8707-b15cbd62aec5 service cinder] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:48.229753 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dacd5f3-6140-437f-8707-b15cbd62aec5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:48.229995 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dacd5f3-6140-437f-8707-b15cbd62aec5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:48.291340 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7498ca6-f229-42fd-9eea-374c176f7dc6 service cinder] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:48.325813 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89666768-6905-4848-853c-a4a7d62f83fe service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffbfbf19509645f49dbf9566e447c8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:48.326480 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89666768-6905-4848-853c-a4a7d62f83fe service swift] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:48.326752 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89666768-6905-4848-853c-a4a7d62f83fe service swift] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:48.327195 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89666768-6905-4848-853c-a4a7d62f83fe service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:48.359013 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89666768-6905-4848-853c-a4a7d62f83fe service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:48.367707 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:20:48.370908 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89666768-6905-4848-853c-a4a7d62f83fe service swift] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:48.409600 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 893/1768] 10.222.0.47 () {60 vars in 1384 bytes} [Wed Aug 31 00:20:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 838 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 31 00:20:48.552277 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dacd5f3-6140-437f-8707-b15cbd62aec5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:48.556441 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dacd5f3-6140-437f-8707-b15cbd62aec5 service cinder] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:48.609623 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 876/1769] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:20:48 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:20:50.185283 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0414c2-022e-4ec9-a89c-e51abb36c106 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:50.185283 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0414c2-022e-4ec9-a89c-e51abb36c106 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:50.185283 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0414c2-022e-4ec9-a89c-e51abb36c106 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:50.313602 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-ae0414c2-022e-4ec9-a89c-e51abb36c106 None None] MFA Rules not processed for user `b3da9d7af0fd4c1d99973e6b277b16d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:20:50.322168 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-ae0414c2-022e-4ec9-a89c-e51abb36c106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:50.609484 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 894/1770] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:20:50 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 428 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:20:51.910985 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87552c64-5a49-4a7f-bdc0-41c6730a1009 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:51.911719 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87552c64-5a49-4a7f-bdc0-41c6730a1009 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:51.912698 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87552c64-5a49-4a7f-bdc0-41c6730a1009 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:52.104207 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-87552c64-5a49-4a7f-bdc0-41c6730a1009 None None] MFA Rules not processed for user `daae792cd11d4c4ca7aae0558998aced`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:20:52.112218 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-87552c64-5a49-4a7f-bdc0-41c6730a1009 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:52.572397 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 877/1771] 10.222.0.70 () {58 vars in 1015 bytes} [Wed Aug 31 00:20:51 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 665 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:20:52.611694 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0414c2-022e-4ec9-a89c-e51abb36c106 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:52.614128 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-ae0414c2-022e-4ec9-a89c-e51abb36c106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:52.680184 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0414c2-022e-4ec9-a89c-e51abb36c106 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:52.704301 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e26c25-42d1-480d-8d84-9316e0c65fae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'daae792cd11d4c4ca7aae0558998aced', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:52.706529 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e26c25-42d1-480d-8d84-9316e0c65fae service neutron] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:52.707183 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e26c25-42d1-480d-8d84-9316e0c65fae service neutron] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:52.707690 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e26c25-42d1-480d-8d84-9316e0c65fae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:52.736978 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e26c25-42d1-480d-8d84-9316e0c65fae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:52.743789 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e26c25-42d1-480d-8d84-9316e0c65fae service neutron] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:52.776470 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 895/1772] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:20:52 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:20:52.922559 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87552c64-5a49-4a7f-bdc0-41c6730a1009 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:52.926916 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-87552c64-5a49-4a7f-bdc0-41c6730a1009 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:53.147805 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87552c64-5a49-4a7f-bdc0-41c6730a1009 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:53.184053 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458d83bb-3935-4acb-966f-c9365e47c8ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:53.186938 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458d83bb-3935-4acb-966f-c9365e47c8ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:53.187771 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458d83bb-3935-4acb-966f-c9365e47c8ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:53.189346 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458d83bb-3935-4acb-966f-c9365e47c8ff admin admin] PATH_INFO: `/v3/users/14a25c9de67c4274b2a83ee0e1a5dbe4` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:53.192984 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458d83bb-3935-4acb-966f-c9365e47c8ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=14a25c9de67c4274b2a83ee0e1a5dbe4)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:53.199627 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458d83bb-3935-4acb-966f-c9365e47c8ff admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:53.300815 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e26c25-42d1-480d-8d84-9316e0c65fae service neutron] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:53.366954 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-458d83bb-3935-4acb-966f-c9365e47c8ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14a25c9de67c4274b2a83ee0e1a5dbe4'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:53.384512 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-458d83bb-3935-4acb-966f-c9365e47c8ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14a25c9de67c4274b2a83ee0e1a5dbe4'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:53.399552 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e26c25-42d1-480d-8d84-9316e0c65fae service neutron] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:53.408682 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-458d83bb-3935-4acb-966f-c9365e47c8ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14a25c9de67c4274b2a83ee0e1a5dbe4'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:53.449735 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:20:53.454181 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8259567-1333-4062-8d42-b69babf18c37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:53.456668 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8259567-1333-4062-8d42-b69babf18c37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:53.456866 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-458d83bb-3935-4acb-966f-c9365e47c8ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14a25c9de67c4274b2a83ee0e1a5dbe4'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:53.458019 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8259567-1333-4062-8d42-b69babf18c37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:53.458209 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-458d83bb-3935-4acb-966f-c9365e47c8ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14a25c9de67c4274b2a83ee0e1a5dbe4'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:53.461842 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8259567-1333-4062-8d42-b69babf18c37 admin admin] PATH_INFO: `/v3/users/f5bba275d7bb47b9b2a53d4759d9da51` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:53.472889 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8259567-1333-4062-8d42-b69babf18c37 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5bba275d7bb47b9b2a53d4759d9da51)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:53.481772 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 878/1773] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 31 00:20:52 2022] DELETE /identity/v3/users/14a25c9de67c4274b2a83ee0e1a5dbe4 => generated 0 bytes in 561 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:20:53.490641 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f18466-97ea-49f3-a6d3-c486e20a48fc None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:53.491608 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f18466-97ea-49f3-a6d3-c486e20a48fc None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:53.492502 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f18466-97ea-49f3-a6d3-c486e20a48fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:53.504533 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8259567-1333-4062-8d42-b69babf18c37 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:53.550060 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-d4f18466-97ea-49f3-a6d3-c486e20a48fc None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:20:53.551538 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-d4f18466-97ea-49f3-a6d3-c486e20a48fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:53.802042 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-d8259567-1333-4062-8d42-b69babf18c37 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5bba275d7bb47b9b2a53d4759d9da51'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:53.871096 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 879/1774] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:20:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 384 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:20:53.871958 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-d8259567-1333-4062-8d42-b69babf18c37 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5bba275d7bb47b9b2a53d4759d9da51'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:53.924740 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-d8259567-1333-4062-8d42-b69babf18c37 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5bba275d7bb47b9b2a53d4759d9da51'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:53.928873 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-d8259567-1333-4062-8d42-b69babf18c37 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5bba275d7bb47b9b2a53d4759d9da51'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:53.945896 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f18466-97ea-49f3-a6d3-c486e20a48fc None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:53.948321 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-d4f18466-97ea-49f3-a6d3-c486e20a48fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:53.963655 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:20:54.045514 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-d8259567-1333-4062-8d42-b69babf18c37 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5bba275d7bb47b9b2a53d4759d9da51'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:54.065336 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 896/1775] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 31 00:20:53 2022] DELETE /identity/v3/users/f5bba275d7bb47b9b2a53d4759d9da51 => generated 0 bytes in 761 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:20:54.068824 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e244dae3-0e24-4378-bac4-55dfc1b4a453 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:54.069684 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e244dae3-0e24-4378-bac4-55dfc1b4a453 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:54.070378 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e244dae3-0e24-4378-bac4-55dfc1b4a453 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:54.147269 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-e244dae3-0e24-4378-bac4-55dfc1b4a453 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:20:54.156499 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-e244dae3-0e24-4378-bac4-55dfc1b4a453 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:54.230464 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f18466-97ea-49f3-a6d3-c486e20a48fc None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:54.413271 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160d078b-27b7-4016-a978-dffa1375125c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'daae792cd11d4c4ca7aae0558998aced', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:54.414247 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160d078b-27b7-4016-a978-dffa1375125c service neutron] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:54.424485 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160d078b-27b7-4016-a978-dffa1375125c service neutron] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:54.425182 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160d078b-27b7-4016-a978-dffa1375125c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:54.446785 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-160d078b-27b7-4016-a978-dffa1375125c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:54.581101 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 897/1776] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:20:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 511 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:20:54.632103 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e244dae3-0e24-4378-bac4-55dfc1b4a453 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:54.633860 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-e244dae3-0e24-4378-bac4-55dfc1b4a453 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:54.664970 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e244dae3-0e24-4378-bac4-55dfc1b4a453 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:54.673322 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cd0469-4031-4a21-b913-6abcc31cb114 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'daae792cd11d4c4ca7aae0558998aced', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:54.674797 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cd0469-4031-4a21-b913-6abcc31cb114 service neutron] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:54.675516 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cd0469-4031-4a21-b913-6abcc31cb114 service neutron] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:54.676242 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cd0469-4031-4a21-b913-6abcc31cb114 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:54.727200 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cd0469-4031-4a21-b913-6abcc31cb114 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:54.732128 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cd0469-4031-4a21-b913-6abcc31cb114 service neutron] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:54.753131 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160d078b-27b7-4016-a978-dffa1375125c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:54.754935 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160d078b-27b7-4016-a978-dffa1375125c service neutron] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:54.783014 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 898/1777] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:20:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:20:54.785376 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 880/1778] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:20:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 840 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:20:56.433968 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cd0469-4031-4a21-b913-6abcc31cb114 service neutron] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:56.442526 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-d5cd0469-4031-4a21-b913-6abcc31cb114 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:56.506964 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cd0469-4031-4a21-b913-6abcc31cb114 service neutron] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:56.564703 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf4ed6f-9b6a-4f12-9761-bc864557acbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:56.570668 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf4ed6f-9b6a-4f12-9761-bc864557acbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:56.572502 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf4ed6f-9b6a-4f12-9761-bc864557acbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:56.574411 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf4ed6f-9b6a-4f12-9761-bc864557acbe admin admin] PATH_INFO: `/v3/users/6a6293d52f6c4bd5a51fe9d952d38c97` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:56.580662 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf4ed6f-9b6a-4f12-9761-bc864557acbe admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a6293d52f6c4bd5a51fe9d952d38c97)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:56.587147 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf4ed6f-9b6a-4f12-9761-bc864557acbe admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:56.800518 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-7bf4ed6f-9b6a-4f12-9761-bc864557acbe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a6293d52f6c4bd5a51fe9d952d38c97'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:56.861512 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-7bf4ed6f-9b6a-4f12-9761-bc864557acbe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a6293d52f6c4bd5a51fe9d952d38c97'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:56.885110 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-7bf4ed6f-9b6a-4f12-9761-bc864557acbe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a6293d52f6c4bd5a51fe9d952d38c97'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:56.890964 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-7bf4ed6f-9b6a-4f12-9761-bc864557acbe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a6293d52f6c4bd5a51fe9d952d38c97'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:56.966192 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-7bf4ed6f-9b6a-4f12-9761-bc864557acbe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a6293d52f6c4bd5a51fe9d952d38c97'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:56.997436 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 899/1779] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 31 00:20:56 2022] DELETE /identity/v3/users/6a6293d52f6c4bd5a51fe9d952d38c97 => generated 0 bytes in 561 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:20:57.001093 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ca5d0d-39f1-4b74-93cf-169fe62e7610 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:57.001825 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ca5d0d-39f1-4b74-93cf-169fe62e7610 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:57.002040 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ca5d0d-39f1-4b74-93cf-169fe62e7610 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:57.028349 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:20:57.074577 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-90ca5d0d-39f1-4b74-93cf-169fe62e7610 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:20:57.081153 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-90ca5d0d-39f1-4b74-93cf-169fe62e7610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:57.268654 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 881/1780] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:20:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:20:57.303092 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf4ed6f-9b6a-4f12-9761-bc864557acbe admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:57.305669 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-7bf4ed6f-9b6a-4f12-9761-bc864557acbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:57.415814 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:20:57.445875 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf4ed6f-9b6a-4f12-9761-bc864557acbe admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:57.455693 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7437624e-9f0b-4537-b5da-88dee10d4de7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'daae792cd11d4c4ca7aae0558998aced', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:57.456391 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7437624e-9f0b-4537-b5da-88dee10d4de7 service neutron] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:57.456675 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7437624e-9f0b-4537-b5da-88dee10d4de7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:57.456955 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7437624e-9f0b-4537-b5da-88dee10d4de7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:57.482451 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7437624e-9f0b-4537-b5da-88dee10d4de7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:57.484633 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7437624e-9f0b-4537-b5da-88dee10d4de7 service neutron] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:57.507205 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 900/1781] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:20:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:20:57.972353 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ca5d0d-39f1-4b74-93cf-169fe62e7610 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:57.974968 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-90ca5d0d-39f1-4b74-93cf-169fe62e7610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:58.024539 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ca5d0d-39f1-4b74-93cf-169fe62e7610 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:58.046422 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f58f97-fb84-453b-8486-57587028cba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:58.051102 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f58f97-fb84-453b-8486-57587028cba7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:58.051985 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f58f97-fb84-453b-8486-57587028cba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:58.054307 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f58f97-fb84-453b-8486-57587028cba7 admin admin] PATH_INFO: `/v3/projects/04549bf2ddd64141b2783feb6e7acb66` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:58.060491 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f58f97-fb84-453b-8486-57587028cba7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=04549bf2ddd64141b2783feb6e7acb66)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:58.071583 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f58f97-fb84-453b-8486-57587028cba7 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:58.281671 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-e7f58f97-fb84-453b-8486-57587028cba7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04549bf2ddd64141b2783feb6e7acb66', 'request_id': 'req-e7f58f97-fb84-453b-8486-57587028cba7'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:58.301209 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-e7f58f97-fb84-453b-8486-57587028cba7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04549bf2ddd64141b2783feb6e7acb66', 'request_id': 'req-e7f58f97-fb84-453b-8486-57587028cba7'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:58.319686 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-e7f58f97-fb84-453b-8486-57587028cba7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04549bf2ddd64141b2783feb6e7acb66', 'request_id': 'req-e7f58f97-fb84-453b-8486-57587028cba7'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:58.379868 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-e7f58f97-fb84-453b-8486-57587028cba7 admin admin] The token cache is being invalidate because project 04549bf2ddd64141b2783feb6e7acb66 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81523) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:20:58.379868 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-e7f58f97-fb84-453b-8486-57587028cba7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:58.402023 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-e7f58f97-fb84-453b-8486-57587028cba7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:58.419014 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 882/1782] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 31 00:20:57 2022] DELETE /identity/v3/projects/04549bf2ddd64141b2783feb6e7acb66 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:20:58.423184 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7437624e-9f0b-4537-b5da-88dee10d4de7 service neutron] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:58.449022 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c8313a-9e4d-4724-9395-be4380bbfe58 None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:58.449508 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c8313a-9e4d-4724-9395-be4380bbfe58 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:58.450029 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c8313a-9e4d-4724-9395-be4380bbfe58 None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:58.453118 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 883/1783] 10.222.0.47 () {54 vars in 921 bytes} [Wed Aug 31 00:20:58 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:20:58.475676 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7437624e-9f0b-4537-b5da-88dee10d4de7 service neutron] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:58.669717 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d5cc20-4858-4a45-9283-67515e9319a1 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:58.670087 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d5cc20-4858-4a45-9283-67515e9319a1 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:58.670298 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d5cc20-4858-4a45-9283-67515e9319a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:58.725209 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-a0d5cc20-4858-4a45-9283-67515e9319a1 None None] MFA Rules not processed for user `9ea002bf49c248dbae7147665fa10fd1`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:20:58.726342 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-a0d5cc20-4858-4a45-9283-67515e9319a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:58.827408 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2565fbdb-c2f9-443c-86b9-19641b6c05ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:58.829357 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2565fbdb-c2f9-443c-86b9-19641b6c05ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:58.830146 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2565fbdb-c2f9-443c-86b9-19641b6c05ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:58.830851 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2565fbdb-c2f9-443c-86b9-19641b6c05ae admin admin] PATH_INFO: `/v3/users/5a08dd8a491c414ab4763fe3d2bfd1c2` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:58.835476 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2565fbdb-c2f9-443c-86b9-19641b6c05ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a08dd8a491c414ab4763fe3d2bfd1c2)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:58.853785 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2565fbdb-c2f9-443c-86b9-19641b6c05ae admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:20:58.917620 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 884/1784] 10.222.0.47 () {58 vars in 1018 bytes} [Wed Aug 31 00:20:58 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:20:59.039324 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-2565fbdb-c2f9-443c-86b9-19641b6c05ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a08dd8a491c414ab4763fe3d2bfd1c2'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:59.051343 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-2565fbdb-c2f9-443c-86b9-19641b6c05ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a08dd8a491c414ab4763fe3d2bfd1c2'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:59.074343 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-2565fbdb-c2f9-443c-86b9-19641b6c05ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a08dd8a491c414ab4763fe3d2bfd1c2'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:59.075369 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-2565fbdb-c2f9-443c-86b9-19641b6c05ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a08dd8a491c414ab4763fe3d2bfd1c2'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:59.106775 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-2565fbdb-c2f9-443c-86b9-19641b6c05ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a08dd8a491c414ab4763fe3d2bfd1c2'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:20:59.128494 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 901/1785] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 31 00:20:58 2022] DELETE /identity/v3/users/5a08dd8a491c414ab4763fe3d2bfd1c2 => generated 0 bytes in 706 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:20:59.392322 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d5cc20-4858-4a45-9283-67515e9319a1 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:20:59.398932 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-a0d5cc20-4858-4a45-9283-67515e9319a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:20:59.538638 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d5cc20-4858-4a45-9283-67515e9319a1 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:20:59.628800 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:20:59.959708 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a3d98a-cf15-4b66-b399-ffebe6443e39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:20:59.961550 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a3d98a-cf15-4b66-b399-ffebe6443e39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:20:59.962148 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a3d98a-cf15-4b66-b399-ffebe6443e39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:20:59.963676 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a3d98a-cf15-4b66-b399-ffebe6443e39 admin admin] PATH_INFO: `/v3/projects/466c3360697341f192f1922e358f69aa` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:20:59.966822 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a3d98a-cf15-4b66-b399-ffebe6443e39 admin admin] RBAC: Authorizing `identity:delete_project(project_id=466c3360697341f192f1922e358f69aa)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:20:59.977486 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a3d98a-cf15-4b66-b399-ffebe6443e39 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:00.129943 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-13a3d98a-cf15-4b66-b399-ffebe6443e39 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '466c3360697341f192f1922e358f69aa', 'request_id': 'req-13a3d98a-cf15-4b66-b399-ffebe6443e39'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:00.152269 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-13a3d98a-cf15-4b66-b399-ffebe6443e39 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '466c3360697341f192f1922e358f69aa', 'request_id': 'req-13a3d98a-cf15-4b66-b399-ffebe6443e39'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:00.170864 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-13a3d98a-cf15-4b66-b399-ffebe6443e39 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '466c3360697341f192f1922e358f69aa', 'request_id': 'req-13a3d98a-cf15-4b66-b399-ffebe6443e39'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:00.207356 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-13a3d98a-cf15-4b66-b399-ffebe6443e39 admin admin] The token cache is being invalidate because project 466c3360697341f192f1922e358f69aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81523) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:21:00.207987 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-13a3d98a-cf15-4b66-b399-ffebe6443e39 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:00.211605 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-13a3d98a-cf15-4b66-b399-ffebe6443e39 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:00.213564 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 885/1786] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 31 00:20:59 2022] DELETE /identity/v3/projects/466c3360697341f192f1922e358f69aa => generated 0 bytes in 823 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:21:00.219425 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2565fbdb-c2f9-443c-86b9-19641b6c05ae admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:00.221114 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-2565fbdb-c2f9-443c-86b9-19641b6c05ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:00.251448 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2565fbdb-c2f9-443c-86b9-19641b6c05ae admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:00.279697 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a3d98a-cf15-4b66-b399-ffebe6443e39 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:00.281588 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-13a3d98a-cf15-4b66-b399-ffebe6443e39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:00.451220 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8481ff-7836-4c7b-8330-0bb1ba7b9de7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:00.454114 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8481ff-7836-4c7b-8330-0bb1ba7b9de7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:00.459312 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8481ff-7836-4c7b-8330-0bb1ba7b9de7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:00.459904 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8481ff-7836-4c7b-8330-0bb1ba7b9de7 admin admin] PATH_INFO: `/v3/users/387b781c263549d9b57e2172531e9a0f` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:00.461745 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8481ff-7836-4c7b-8330-0bb1ba7b9de7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=387b781c263549d9b57e2172531e9a0f)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:00.469456 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8481ff-7836-4c7b-8330-0bb1ba7b9de7 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:00.527111 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:00.745247 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a3d98a-cf15-4b66-b399-ffebe6443e39 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:00.803238 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b93c40c-24b2-4830-a375-7855209bd1ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:00.806309 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b93c40c-24b2-4830-a375-7855209bd1ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:00.807094 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b93c40c-24b2-4830-a375-7855209bd1ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:00.811803 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b93c40c-24b2-4830-a375-7855209bd1ba admin admin] PATH_INFO: `/v3/projects/6d4e9d35dbf54e908de7560f0cd78b2d` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:00.816998 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b93c40c-24b2-4830-a375-7855209bd1ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d4e9d35dbf54e908de7560f0cd78b2d)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:00.840858 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b93c40c-24b2-4830-a375-7855209bd1ba admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:00.878500 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-0d8481ff-7836-4c7b-8330-0bb1ba7b9de7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '387b781c263549d9b57e2172531e9a0f'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:00.913986 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-0d8481ff-7836-4c7b-8330-0bb1ba7b9de7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '387b781c263549d9b57e2172531e9a0f'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:00.933514 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-0d8481ff-7836-4c7b-8330-0bb1ba7b9de7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '387b781c263549d9b57e2172531e9a0f'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:00.939286 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-0d8481ff-7836-4c7b-8330-0bb1ba7b9de7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '387b781c263549d9b57e2172531e9a0f'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:00.989235 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-0d8481ff-7836-4c7b-8330-0bb1ba7b9de7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '387b781c263549d9b57e2172531e9a0f'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:01.011202 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 902/1787] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 31 00:21:00 2022] DELETE /identity/v3/users/387b781c263549d9b57e2172531e9a0f => generated 0 bytes in 792 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:21:01.029475 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-9b93c40c-24b2-4830-a375-7855209bd1ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d4e9d35dbf54e908de7560f0cd78b2d', 'request_id': 'req-9b93c40c-24b2-4830-a375-7855209bd1ba'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:01.033750 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:01.061366 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-9b93c40c-24b2-4830-a375-7855209bd1ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d4e9d35dbf54e908de7560f0cd78b2d', 'request_id': 'req-9b93c40c-24b2-4830-a375-7855209bd1ba'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:01.075756 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-9b93c40c-24b2-4830-a375-7855209bd1ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d4e9d35dbf54e908de7560f0cd78b2d', 'request_id': 'req-9b93c40c-24b2-4830-a375-7855209bd1ba'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:01.114270 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-9b93c40c-24b2-4830-a375-7855209bd1ba admin admin] The token cache is being invalidate because project 6d4e9d35dbf54e908de7560f0cd78b2d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81523) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:21:01.118673 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-9b93c40c-24b2-4830-a375-7855209bd1ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:01.123892 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-9b93c40c-24b2-4830-a375-7855209bd1ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:01.133386 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 886/1788] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 31 00:21:00 2022] DELETE /identity/v3/projects/6d4e9d35dbf54e908de7560f0cd78b2d => generated 0 bytes in 850 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:21:01.134890 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8481ff-7836-4c7b-8330-0bb1ba7b9de7 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:01.136912 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-0d8481ff-7836-4c7b-8330-0bb1ba7b9de7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:01.289306 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8481ff-7836-4c7b-8330-0bb1ba7b9de7 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:01.298709 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6457fc98-8e68-4d12-a602-631d7ba62598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:01.300222 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6457fc98-8e68-4d12-a602-631d7ba62598 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:01.300784 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6457fc98-8e68-4d12-a602-631d7ba62598 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:01.301574 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6457fc98-8e68-4d12-a602-631d7ba62598 admin admin] PATH_INFO: `/v3/users/49578d26dec64657be9804e69633112e` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:01.305129 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6457fc98-8e68-4d12-a602-631d7ba62598 admin admin] RBAC: Authorizing `identity:delete_user(user_id=49578d26dec64657be9804e69633112e)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:01.308726 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6457fc98-8e68-4d12-a602-631d7ba62598 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:01.465324 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-6457fc98-8e68-4d12-a602-631d7ba62598 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '49578d26dec64657be9804e69633112e'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:01.515704 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-6457fc98-8e68-4d12-a602-631d7ba62598 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '49578d26dec64657be9804e69633112e'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:01.541860 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-6457fc98-8e68-4d12-a602-631d7ba62598 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '49578d26dec64657be9804e69633112e'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:01.542764 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-6457fc98-8e68-4d12-a602-631d7ba62598 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '49578d26dec64657be9804e69633112e'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:01.626396 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-6457fc98-8e68-4d12-a602-631d7ba62598 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '49578d26dec64657be9804e69633112e'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:01.641762 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 903/1789] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 31 00:21:01 2022] DELETE /identity/v3/users/49578d26dec64657be9804e69633112e => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:21:02.339088 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b93c40c-24b2-4830-a375-7855209bd1ba admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:02.343168 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-9b93c40c-24b2-4830-a375-7855209bd1ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:02.558456 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b93c40c-24b2-4830-a375-7855209bd1ba admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:02.813409 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6457fc98-8e68-4d12-a602-631d7ba62598 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:02.816518 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54122038-d495-4854-9edf-48d8c400cf91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:02.817134 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-6457fc98-8e68-4d12-a602-631d7ba62598 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:02.817342 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54122038-d495-4854-9edf-48d8c400cf91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:02.822888 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54122038-d495-4854-9edf-48d8c400cf91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:02.822888 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54122038-d495-4854-9edf-48d8c400cf91 admin admin] PATH_INFO: `/v3/projects/d77c09bb9c6d4635acffe542e7e9bbf5` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:02.823749 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54122038-d495-4854-9edf-48d8c400cf91 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d77c09bb9c6d4635acffe542e7e9bbf5)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:02.826142 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54122038-d495-4854-9edf-48d8c400cf91 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:02.890287 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:02.918840 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6457fc98-8e68-4d12-a602-631d7ba62598 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:02.925514 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bd591d-616a-4ae2-86b9-ab2eadf398b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:02.926185 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bd591d-616a-4ae2-86b9-ab2eadf398b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:02.927729 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bd591d-616a-4ae2-86b9-ab2eadf398b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:02.928328 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bd591d-616a-4ae2-86b9-ab2eadf398b0 admin admin] PATH_INFO: `/v3/projects/818287dc990147748fb60acbc13302d7` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:02.931398 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bd591d-616a-4ae2-86b9-ab2eadf398b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=818287dc990147748fb60acbc13302d7)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:02.941428 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bd591d-616a-4ae2-86b9-ab2eadf398b0 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:03.089394 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-54122038-d495-4854-9edf-48d8c400cf91 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd77c09bb9c6d4635acffe542e7e9bbf5', 'request_id': 'req-54122038-d495-4854-9edf-48d8c400cf91'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:03.101932 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-54122038-d495-4854-9edf-48d8c400cf91 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd77c09bb9c6d4635acffe542e7e9bbf5', 'request_id': 'req-54122038-d495-4854-9edf-48d8c400cf91'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:03.133241 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-54122038-d495-4854-9edf-48d8c400cf91 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd77c09bb9c6d4635acffe542e7e9bbf5', 'request_id': 'req-54122038-d495-4854-9edf-48d8c400cf91'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:03.164913 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-54122038-d495-4854-9edf-48d8c400cf91 admin admin] The token cache is being invalidate because project d77c09bb9c6d4635acffe542e7e9bbf5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81523) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:21:03.166001 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-54122038-d495-4854-9edf-48d8c400cf91 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:03.167448 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-54122038-d495-4854-9edf-48d8c400cf91 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:03.188045 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 887/1790] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 31 00:21:02 2022] DELETE /identity/v3/projects/d77c09bb9c6d4635acffe542e7e9bbf5 => generated 0 bytes in 833 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:21:03.191573 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36f4855-afcc-466f-9a0c-02ae1fea06c1 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:03.193925 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36f4855-afcc-466f-9a0c-02ae1fea06c1 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:03.195354 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36f4855-afcc-466f-9a0c-02ae1fea06c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:03.233765 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-b7bd591d-616a-4ae2-86b9-ab2eadf398b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '818287dc990147748fb60acbc13302d7', 'request_id': 'req-b7bd591d-616a-4ae2-86b9-ab2eadf398b0'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:03.254510 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-e36f4855-afcc-466f-9a0c-02ae1fea06c1 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:21:03.256300 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-e36f4855-afcc-466f-9a0c-02ae1fea06c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:03.260638 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-b7bd591d-616a-4ae2-86b9-ab2eadf398b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '818287dc990147748fb60acbc13302d7', 'request_id': 'req-b7bd591d-616a-4ae2-86b9-ab2eadf398b0'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:03.276636 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-b7bd591d-616a-4ae2-86b9-ab2eadf398b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '818287dc990147748fb60acbc13302d7', 'request_id': 'req-b7bd591d-616a-4ae2-86b9-ab2eadf398b0'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:03.290589 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:03.341671 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-b7bd591d-616a-4ae2-86b9-ab2eadf398b0 admin admin] The token cache is being invalidate because project 818287dc990147748fb60acbc13302d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:21:03.342083 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-b7bd591d-616a-4ae2-86b9-ab2eadf398b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:03.349487 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-b7bd591d-616a-4ae2-86b9-ab2eadf398b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:03.356042 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 904/1791] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 31 00:21:02 2022] DELETE /identity/v3/projects/818287dc990147748fb60acbc13302d7 => generated 0 bytes in 548 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:21:03.360113 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0dfb73-cae6-43ac-a639-514d183c5b10 None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:03.362029 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0dfb73-cae6-43ac-a639-514d183c5b10 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:03.362756 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0dfb73-cae6-43ac-a639-514d183c5b10 None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:03.369883 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 905/1792] 10.222.0.47 () {54 vars in 921 bytes} [Wed Aug 31 00:21:03 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:21:03.376905 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0788a7-ed66-4c1c-8618-9a44a251a2f8 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:03.377481 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0788a7-ed66-4c1c-8618-9a44a251a2f8 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:03.377985 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0788a7-ed66-4c1c-8618-9a44a251a2f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:03.424347 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 888/1793] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:21:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:21:03.429273 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3bdded-3124-4787-a410-f6efc46248ed None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:03.429567 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3bdded-3124-4787-a410-f6efc46248ed None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:03.430079 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3bdded-3124-4787-a410-f6efc46248ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:03.455126 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-7f0788a7-ed66-4c1c-8618-9a44a251a2f8 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:21:03.459349 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-7f0788a7-ed66-4c1c-8618-9a44a251a2f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:03.507082 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-5f3bdded-3124-4787-a410-f6efc46248ed None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:21:03.509370 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-5f3bdded-3124-4787-a410-f6efc46248ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:03.521826 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 906/1794] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:21:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:21:03.530485 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc6dc2a-3e11-4ed3-bbbf-c13ae7175186 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:03.533622 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc6dc2a-3e11-4ed3-bbbf-c13ae7175186 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:03.537875 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc6dc2a-3e11-4ed3-bbbf-c13ae7175186 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:03.543778 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 889/1795] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:21:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:21:03.549295 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3bdded-3124-4787-a410-f6efc46248ed None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:03.582641 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3bdded-3124-4787-a410-f6efc46248ed None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:03.602230 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691fbe28-9894-49d5-9658-e82c890add0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:03.603231 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691fbe28-9894-49d5-9658-e82c890add0a admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:03.603661 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691fbe28-9894-49d5-9658-e82c890add0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:03.604197 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691fbe28-9894-49d5-9658-e82c890add0a admin admin] PATH_INFO: `/v3/domains` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:03.605446 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691fbe28-9894-49d5-9658-e82c890add0a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:21:03.605952 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691fbe28-9894-49d5-9658-e82c890add0a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:03.617577 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691fbe28-9894-49d5-9658-e82c890add0a admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:03.643592 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-dfc6dc2a-3e11-4ed3-bbbf-c13ae7175186 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:21:03.646915 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-dfc6dc2a-3e11-4ed3-bbbf-c13ae7175186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:03.667163 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 890/1796] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 31 00:21:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:21:03.669450 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691fbe28-9894-49d5-9658-e82c890add0a admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:03.690200 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691fbe28-9894-49d5-9658-e82c890add0a admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:03.699634 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d2c6a1-fad0-44a6-9aa4-858bfad14b05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:03.700810 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d2c6a1-fad0-44a6-9aa4-858bfad14b05 admin admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:03.701414 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d2c6a1-fad0-44a6-9aa4-858bfad14b05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:03.701729 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d2c6a1-fad0-44a6-9aa4-858bfad14b05 admin admin] PATH_INFO: `/v3/projects` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:03.702907 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d2c6a1-fad0-44a6-9aa4-858bfad14b05 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:03.704266 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 907/1797] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:21:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:21:03.712731 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d2c6a1-fad0-44a6-9aa4-858bfad14b05 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:03.713932 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc6dc2a-3e11-4ed3-bbbf-c13ae7175186 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:03.753261 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc6dc2a-3e11-4ed3-bbbf-c13ae7175186 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:03.769394 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b27e12b-1380-4ab7-8f46-c44772545ee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:03.771927 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b27e12b-1380-4ab7-8f46-c44772545ee8 admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:03.773326 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b27e12b-1380-4ab7-8f46-c44772545ee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:03.776410 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b27e12b-1380-4ab7-8f46-c44772545ee8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:03.778306 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b27e12b-1380-4ab7-8f46-c44772545ee8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:21:03.780263 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b27e12b-1380-4ab7-8f46-c44772545ee8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:03.784718 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b27e12b-1380-4ab7-8f46-c44772545ee8 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:03.832363 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 908/1798] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 31 00:21:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:21:03.838625 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b27e12b-1380-4ab7-8f46-c44772545ee8 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:03.840694 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 891/1799] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 31 00:21:03 2022] POST /identity/v3/projects => generated 371 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:21:03.847685 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d2c6a1-fad0-44a6-9aa4-858bfad14b05 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:03.862100 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b27e12b-1380-4ab7-8f46-c44772545ee8 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:04.095981 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d2c6a1-fad0-44a6-9aa4-858bfad14b05 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:04.107977 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe5c1d7-d967-4847-966c-666f83b0a6b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:04.109079 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe5c1d7-d967-4847-966c-666f83b0a6b2 admin admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:04.109668 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe5c1d7-d967-4847-966c-666f83b0a6b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:04.110080 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe5c1d7-d967-4847-966c-666f83b0a6b2 admin admin] PATH_INFO: `/v3/users` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:04.111455 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe5c1d7-d967-4847-966c-666f83b0a6b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:04.115424 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe5c1d7-d967-4847-966c-666f83b0a6b2 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:04.161262 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50aa9ef-a702-4626-bd0b-5b3a7f7ddc9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:04.162369 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50aa9ef-a702-4626-bd0b-5b3a7f7ddc9c admin admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:04.162869 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50aa9ef-a702-4626-bd0b-5b3a7f7ddc9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:04.163359 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50aa9ef-a702-4626-bd0b-5b3a7f7ddc9c admin admin] PATH_INFO: `/v3/projects` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:04.164708 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50aa9ef-a702-4626-bd0b-5b3a7f7ddc9c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:04.182384 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50aa9ef-a702-4626-bd0b-5b3a7f7ddc9c admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:04.236983 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 892/1800] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 31 00:21:03 2022] POST /identity/v3/users => generated 286 bytes in 389 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:21:04.239212 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe5c1d7-d967-4847-966c-666f83b0a6b2 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:04.248624 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-1fe5c1d7-d967-4847-966c-666f83b0a6b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:04.255908 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 909/1801] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 31 00:21:03 2022] POST /identity/v3/projects => generated 389 bytes in 417 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:21:04.258192 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140398c5-6476-438f-853d-2a54b55d8d73 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:04.258737 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140398c5-6476-438f-853d-2a54b55d8d73 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:04.259464 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140398c5-6476-438f-853d-2a54b55d8d73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:04.286441 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe5c1d7-d967-4847-966c-666f83b0a6b2 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:04.314858 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-140398c5-6476-438f-853d-2a54b55d8d73 None None] MFA Rules not processed for user `9ea002bf49c248dbae7147665fa10fd1`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:21:04.319937 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-140398c5-6476-438f-853d-2a54b55d8d73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:04.473549 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:04.488222 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded8becd-1666-4a1f-95a7-29e00965b4b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:04.489080 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded8becd-1666-4a1f-95a7-29e00965b4b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:04.490329 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded8becd-1666-4a1f-95a7-29e00965b4b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:04.490629 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded8becd-1666-4a1f-95a7-29e00965b4b0 admin admin] PATH_INFO: `/v3/projects/47572fc2b5ab42db8456f8ef94829a07` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:04.493278 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded8becd-1666-4a1f-95a7-29e00965b4b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=47572fc2b5ab42db8456f8ef94829a07)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:04.508603 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded8becd-1666-4a1f-95a7-29e00965b4b0 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:04.531930 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:04.587182 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 910/1802] 10.222.0.47 () {58 vars in 1018 bytes} [Wed Aug 31 00:21:04 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 331 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:21:04.601772 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140398c5-6476-438f-853d-2a54b55d8d73 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:04.614106 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-ded8becd-1666-4a1f-95a7-29e00965b4b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47572fc2b5ab42db8456f8ef94829a07', 'request_id': 'req-ded8becd-1666-4a1f-95a7-29e00965b4b0'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:04.630936 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140398c5-6476-438f-853d-2a54b55d8d73 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:04.634584 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-ded8becd-1666-4a1f-95a7-29e00965b4b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47572fc2b5ab42db8456f8ef94829a07', 'request_id': 'req-ded8becd-1666-4a1f-95a7-29e00965b4b0'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:04.643240 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-ded8becd-1666-4a1f-95a7-29e00965b4b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47572fc2b5ab42db8456f8ef94829a07', 'request_id': 'req-ded8becd-1666-4a1f-95a7-29e00965b4b0'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:04.670818 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-ded8becd-1666-4a1f-95a7-29e00965b4b0 admin admin] The token cache is being invalidate because project 47572fc2b5ab42db8456f8ef94829a07 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81523) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:21:04.671292 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-ded8becd-1666-4a1f-95a7-29e00965b4b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:04.674733 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-ded8becd-1666-4a1f-95a7-29e00965b4b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:04.679669 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 893/1803] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 31 00:21:04 2022] DELETE /identity/v3/projects/47572fc2b5ab42db8456f8ef94829a07 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:21:04.710063 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded8becd-1666-4a1f-95a7-29e00965b4b0 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:04.714979 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-ded8becd-1666-4a1f-95a7-29e00965b4b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:04.782381 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab73307-005b-4d71-b22f-343c376eecfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:04.783941 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab73307-005b-4d71-b22f-343c376eecfb admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:04.784647 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab73307-005b-4d71-b22f-343c376eecfb admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:04.785246 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab73307-005b-4d71-b22f-343c376eecfb admin admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:04.787935 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab73307-005b-4d71-b22f-343c376eecfb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:04.803012 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab73307-005b-4d71-b22f-343c376eecfb admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:04.810652 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded8becd-1666-4a1f-95a7-29e00965b4b0 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:04.822950 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17933f9-7fde-4659-b077-eb25cb940bc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:04.826700 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17933f9-7fde-4659-b077-eb25cb940bc5 admin admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:04.827390 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17933f9-7fde-4659-b077-eb25cb940bc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:04.828041 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17933f9-7fde-4659-b077-eb25cb940bc5 admin admin] PATH_INFO: `/v3/users` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:04.829194 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 911/1804] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 00:21:04 2022] GET /identity/v3/roles => generated 1420 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:21:04.829783 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17933f9-7fde-4659-b077-eb25cb940bc5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:04.830573 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab73307-005b-4d71-b22f-343c376eecfb admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:04.833442 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-8ab73307-005b-4d71-b22f-343c376eecfb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:04.835649 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17933f9-7fde-4659-b077-eb25cb940bc5 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:04.913467 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 894/1805] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 31 00:21:04 2022] POST /identity/v3/users => generated 295 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:21:04.913467 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a87ecc3-faaa-434f-827b-da350af8a33c None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:04.914438 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a87ecc3-faaa-434f-827b-da350af8a33c None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:04.915125 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a87ecc3-faaa-434f-827b-da350af8a33c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:04.972206 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-6a87ecc3-faaa-434f-827b-da350af8a33c None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:21:04.977591 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-6a87ecc3-faaa-434f-827b-da350af8a33c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:05.014148 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 895/1806] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:21:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:21:05.015468 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a87ecc3-faaa-434f-827b-da350af8a33c None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:05.017385 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-6a87ecc3-faaa-434f-827b-da350af8a33c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:05.037273 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a87ecc3-faaa-434f-827b-da350af8a33c None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:05.046686 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d0a90e-8f24-47ab-b50e-76d18ad740bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:05.047795 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d0a90e-8f24-47ab-b50e-76d18ad740bd admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:05.048274 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d0a90e-8f24-47ab-b50e-76d18ad740bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:05.049202 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d0a90e-8f24-47ab-b50e-76d18ad740bd admin admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:05.050462 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d0a90e-8f24-47ab-b50e-76d18ad740bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:05.055851 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d0a90e-8f24-47ab-b50e-76d18ad740bd admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:05.096964 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 896/1807] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 00:21:05 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:21:05.098980 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d0a90e-8f24-47ab-b50e-76d18ad740bd admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:05.105792 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab73307-005b-4d71-b22f-343c376eecfb admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:05.113978 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a32392-3ee2-4a73-9d13-e8f704e51384 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea002bf49c248dbae7147665fa10fd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:05.116514 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a32392-3ee2-4a73-9d13-e8f704e51384 service nova] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:05.120287 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d0a90e-8f24-47ab-b50e-76d18ad740bd admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:05.121955 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a32392-3ee2-4a73-9d13-e8f704e51384 service nova] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:05.122386 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a32392-3ee2-4a73-9d13-e8f704e51384 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:05.125868 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8a925c-9f0c-4dbc-a7ba-7a488bc0c182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:05.126647 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8a925c-9f0c-4dbc-a7ba-7a488bc0c182 admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:05.126959 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8a925c-9f0c-4dbc-a7ba-7a488bc0c182 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:05.127220 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8a925c-9f0c-4dbc-a7ba-7a488bc0c182 admin admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:05.127887 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8a925c-9f0c-4dbc-a7ba-7a488bc0c182 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:05.129602 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8a925c-9f0c-4dbc-a7ba-7a488bc0c182 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:05.133878 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-84a32392-3ee2-4a73-9d13-e8f704e51384 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:05.143490 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 897/1808] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 00:21:05 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:21:05.145081 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fec5420-daff-426d-971b-ef01f2137d38 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:05.145383 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fec5420-daff-426d-971b-ef01f2137d38 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:05.145658 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fec5420-daff-426d-971b-ef01f2137d38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:05.168758 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a32392-3ee2-4a73-9d13-e8f704e51384 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:05.172366 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a32392-3ee2-4a73-9d13-e8f704e51384 service nova] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:05.184494 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-8fec5420-daff-426d-971b-ef01f2137d38 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:21:05.186571 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-8fec5420-daff-426d-971b-ef01f2137d38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:05.195871 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 912/1809] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:21:04 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:21:05.197410 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a32392-3ee2-4a73-9d13-e8f704e51384 service nova] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:05.198253 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 898/1810] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:21:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:21:05.199307 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fec5420-daff-426d-971b-ef01f2137d38 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:05.213421 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fec5420-daff-426d-971b-ef01f2137d38 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:05.219874 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac7e3cb-81ec-4272-b029-33b1ebda0b8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:05.220574 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac7e3cb-81ec-4272-b029-33b1ebda0b8d admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:05.220851 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac7e3cb-81ec-4272-b029-33b1ebda0b8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:05.220963 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a32392-3ee2-4a73-9d13-e8f704e51384 service nova] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:05.221131 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac7e3cb-81ec-4272-b029-33b1ebda0b8d admin admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:05.221784 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac7e3cb-81ec-4272-b029-33b1ebda0b8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:05.223447 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac7e3cb-81ec-4272-b029-33b1ebda0b8d admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:05.236140 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72feef66-f6ea-46a5-8f39-34b4e62e2d17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:05.237555 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72feef66-f6ea-46a5-8f39-34b4e62e2d17 admin admin] REQUEST_METHOD: `PUT` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:05.237847 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72feef66-f6ea-46a5-8f39-34b4e62e2d17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:05.238166 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72feef66-f6ea-46a5-8f39-34b4e62e2d17 admin admin] PATH_INFO: `/v3/projects/151f333a22b440568ca316d8bc5c1507/users/1c36ea5848ee4edfaf8b11fa245086a4/roles/fdad79ffbcbb4fa380dc9cf7dd108618` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:05.249140 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 899/1811] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 00:21:05 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:21:05.249140 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac7e3cb-81ec-4272-b029-33b1ebda0b8d admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:05.262046 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac7e3cb-81ec-4272-b029-33b1ebda0b8d admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:05.269472 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264f1d88-6ffe-488f-a340-76116df3ab40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:05.270519 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264f1d88-6ffe-488f-a340-76116df3ab40 admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:05.271531 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264f1d88-6ffe-488f-a340-76116df3ab40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:05.272047 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264f1d88-6ffe-488f-a340-76116df3ab40 admin admin] PATH_INFO: `/v3/domains` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:05.272942 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264f1d88-6ffe-488f-a340-76116df3ab40 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:21:05.273244 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264f1d88-6ffe-488f-a340-76116df3ab40 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:05.275328 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264f1d88-6ffe-488f-a340-76116df3ab40 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:05.281961 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72feef66-f6ea-46a5-8f39-34b4e62e2d17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=151f333a22b440568ca316d8bc5c1507, user_id=1c36ea5848ee4edfaf8b11fa245086a4, role_id=fdad79ffbcbb4fa380dc9cf7dd108618)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:05.291976 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72feef66-f6ea-46a5-8f39-34b4e62e2d17 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:05.296709 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 900/1812] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 31 00:21:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:21:05.302399 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264f1d88-6ffe-488f-a340-76116df3ab40 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:05.320966 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264f1d88-6ffe-488f-a340-76116df3ab40 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:05.324142 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 913/1813] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 00:21:05 2022] PUT /identity/v3/projects/151f333a22b440568ca316d8bc5c1507/users/1c36ea5848ee4edfaf8b11fa245086a4/roles/fdad79ffbcbb4fa380dc9cf7dd108618 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:21:05.325056 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72feef66-f6ea-46a5-8f39-34b4e62e2d17 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:05.427141 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:05.501852 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72feef66-f6ea-46a5-8f39-34b4e62e2d17 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:05.530168 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af32f16-9e85-4ab4-8227-58f1d4c5cb13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:05.532274 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af32f16-9e85-4ab4-8227-58f1d4c5cb13 admin admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:05.533507 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af32f16-9e85-4ab4-8227-58f1d4c5cb13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:05.537704 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af32f16-9e85-4ab4-8227-58f1d4c5cb13 admin admin] PATH_INFO: `/v3/projects` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:05.539008 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af32f16-9e85-4ab4-8227-58f1d4c5cb13 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:05.546376 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af32f16-9e85-4ab4-8227-58f1d4c5cb13 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:05.557382 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57804096-83fb-418d-8c4c-4e6add2e075d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:05.559273 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57804096-83fb-418d-8c4c-4e6add2e075d admin admin] REQUEST_METHOD: `PUT` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:05.559737 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57804096-83fb-418d-8c4c-4e6add2e075d admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:05.560197 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57804096-83fb-418d-8c4c-4e6add2e075d admin admin] PATH_INFO: `/v3/projects/4e6e6df09cc54b4287635a02ba767f13/users/286c75953a7c4fe5824df380215b3f7c/roles/fdad79ffbcbb4fa380dc9cf7dd108618` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:05.586183 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57804096-83fb-418d-8c4c-4e6add2e075d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e6e6df09cc54b4287635a02ba767f13, user_id=286c75953a7c4fe5824df380215b3f7c, role_id=fdad79ffbcbb4fa380dc9cf7dd108618)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:05.590945 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57804096-83fb-418d-8c4c-4e6add2e075d admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:05.620673 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:05.637106 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 914/1814] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 31 00:21:05 2022] POST /identity/v3/projects => generated 377 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:21:05.637106 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b217dfef-b57c-4819-a13b-8d2f3d7c4eae None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:05.637106 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b217dfef-b57c-4819-a13b-8d2f3d7c4eae None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:05.637106 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b217dfef-b57c-4819-a13b-8d2f3d7c4eae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:05.641745 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 901/1815] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 00:21:05 2022] PUT /identity/v3/projects/4e6e6df09cc54b4287635a02ba767f13/users/286c75953a7c4fe5824df380215b3f7c/roles/fdad79ffbcbb4fa380dc9cf7dd108618 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:21:05.643092 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57804096-83fb-418d-8c4c-4e6add2e075d admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:05.699304 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-b217dfef-b57c-4819-a13b-8d2f3d7c4eae None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:21:05.702679 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-b217dfef-b57c-4819-a13b-8d2f3d7c4eae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:05.808110 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57804096-83fb-418d-8c4c-4e6add2e075d admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:05.930722 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 915/1816] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:21:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:21:05.936009 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e821db-0760-46ec-873a-a3366207b758 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:05.937638 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e821db-0760-46ec-873a-a3366207b758 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:05.938156 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e821db-0760-46ec-873a-a3366207b758 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:05.949750 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077fd71c-e115-42bc-af8c-c196f220a9ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:05.950943 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077fd71c-e115-42bc-af8c-c196f220a9ec admin admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:05.951643 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077fd71c-e115-42bc-af8c-c196f220a9ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:05.952406 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077fd71c-e115-42bc-af8c-c196f220a9ec admin admin] PATH_INFO: `/v3/users` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:05.953756 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077fd71c-e115-42bc-af8c-c196f220a9ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:05.972711 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077fd71c-e115-42bc-af8c-c196f220a9ec admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:05.996804 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-66e821db-0760-46ec-873a-a3366207b758 None None] MFA Rules not processed for user `286c75953a7c4fe5824df380215b3f7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:21:05.998788 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-66e821db-0760-46ec-873a-a3366207b758 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:06.086360 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 902/1817] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 31 00:21:05 2022] POST /identity/v3/users => generated 289 bytes in 444 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:21:06.089582 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077fd71c-e115-42bc-af8c-c196f220a9ec admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:06.095200 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-077fd71c-e115-42bc-af8c-c196f220a9ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:06.174481 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 916/1818] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:21:05 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:21:06.174481 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e821db-0760-46ec-873a-a3366207b758 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:06.174481 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-66e821db-0760-46ec-873a-a3366207b758 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:06.285440 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e821db-0760-46ec-873a-a3366207b758 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:06.289868 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a1a3ac-7195-4a89-ab04-d0e52ac46685 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'daae792cd11d4c4ca7aae0558998aced', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:06.290513 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a1a3ac-7195-4a89-ab04-d0e52ac46685 service neutron] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:06.290796 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a1a3ac-7195-4a89-ab04-d0e52ac46685 service neutron] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:06.291102 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a1a3ac-7195-4a89-ab04-d0e52ac46685 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:06.298575 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:06.309299 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a1a3ac-7195-4a89-ab04-d0e52ac46685 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:06.310790 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a1a3ac-7195-4a89-ab04-d0e52ac46685 service neutron] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:06.324472 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077fd71c-e115-42bc-af8c-c196f220a9ec admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:06.329354 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 917/1819] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:21:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:21:06.330609 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a1a3ac-7195-4a89-ab04-d0e52ac46685 service neutron] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:06.331172 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53474837-0b8a-4d32-b55a-4c390bc48a78 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea002bf49c248dbae7147665fa10fd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:06.332777 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53474837-0b8a-4d32-b55a-4c390bc48a78 service nova] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:06.332777 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53474837-0b8a-4d32-b55a-4c390bc48a78 service nova] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:06.332777 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53474837-0b8a-4d32-b55a-4c390bc48a78 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:06.334982 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-53474837-0b8a-4d32-b55a-4c390bc48a78 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:06.344371 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a1a3ac-7195-4a89-ab04-d0e52ac46685 service neutron] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:06.351030 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1035d604-4930-4a2a-8737-e09bbc5dc6fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:06.352611 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1035d604-4930-4a2a-8737-e09bbc5dc6fe admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:06.353284 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1035d604-4930-4a2a-8737-e09bbc5dc6fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:06.353576 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1035d604-4930-4a2a-8737-e09bbc5dc6fe admin admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:06.355475 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1035d604-4930-4a2a-8737-e09bbc5dc6fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:06.355976 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1035d604-4930-4a2a-8737-e09bbc5dc6fe admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:06.359987 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53474837-0b8a-4d32-b55a-4c390bc48a78 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:06.361732 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53474837-0b8a-4d32-b55a-4c390bc48a78 service nova] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:06.375912 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 903/1820] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:21:06 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:21:06.376407 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53474837-0b8a-4d32-b55a-4c390bc48a78 service nova] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:06.390240 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53474837-0b8a-4d32-b55a-4c390bc48a78 service nova] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:06.394205 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 918/1821] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 00:21:06 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:21:06.399880 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1035d604-4930-4a2a-8737-e09bbc5dc6fe admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:06.401170 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d271ca6c-747b-46a4-9804-90b95ac9dff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:06.401914 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d271ca6c-747b-46a4-9804-90b95ac9dff5 admin admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:06.402205 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d271ca6c-747b-46a4-9804-90b95ac9dff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:06.402494 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d271ca6c-747b-46a4-9804-90b95ac9dff5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:06.403802 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d271ca6c-747b-46a4-9804-90b95ac9dff5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:06.405930 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d271ca6c-747b-46a4-9804-90b95ac9dff5 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:06.431919 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1035d604-4930-4a2a-8737-e09bbc5dc6fe admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:06.457765 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd8f192-dca1-4e11-99e5-e5c962573637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:06.459711 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd8f192-dca1-4e11-99e5-e5c962573637 admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:06.460501 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd8f192-dca1-4e11-99e5-e5c962573637 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:06.460747 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd8f192-dca1-4e11-99e5-e5c962573637 admin admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:06.462174 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd8f192-dca1-4e11-99e5-e5c962573637 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:06.465640 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd8f192-dca1-4e11-99e5-e5c962573637 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:06.470741 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:06.491592 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 904/1822] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 31 00:21:06 2022] POST /identity/v3/projects => generated 387 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:21:06.498751 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 919/1823] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 00:21:06 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:21:06.499549 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d271ca6c-747b-46a4-9804-90b95ac9dff5 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:06.504368 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd8f192-dca1-4e11-99e5-e5c962573637 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:06.548125 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd8f192-dca1-4e11-99e5-e5c962573637 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:06.662010 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda8835a-d991-42f8-b3e5-deea86e9a118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:06.664271 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda8835a-d991-42f8-b3e5-deea86e9a118 admin admin] REQUEST_METHOD: `PUT` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:06.664271 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda8835a-d991-42f8-b3e5-deea86e9a118 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:06.664271 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda8835a-d991-42f8-b3e5-deea86e9a118 admin admin] PATH_INFO: `/v3/projects/88136abe2a6a46e698d222c8eb7ee661/users/25bad6a65d4a4fe487cb74fd360b6160/roles/fdad79ffbcbb4fa380dc9cf7dd108618` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:06.674763 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d271ca6c-747b-46a4-9804-90b95ac9dff5 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:06.683449 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b51dfcd-c228-455f-8eb3-b8209eceeec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:06.684804 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b51dfcd-c228-455f-8eb3-b8209eceeec0 admin admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:06.685297 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b51dfcd-c228-455f-8eb3-b8209eceeec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:06.685919 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b51dfcd-c228-455f-8eb3-b8209eceeec0 admin admin] PATH_INFO: `/v3/users` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:06.687120 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b51dfcd-c228-455f-8eb3-b8209eceeec0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:06.691877 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b51dfcd-c228-455f-8eb3-b8209eceeec0 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:06.697211 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda8835a-d991-42f8-b3e5-deea86e9a118 admin admin] RBAC: Authorizing `identity:create_grant(project_id=88136abe2a6a46e698d222c8eb7ee661, user_id=25bad6a65d4a4fe487cb74fd360b6160, role_id=fdad79ffbcbb4fa380dc9cf7dd108618)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:06.706050 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda8835a-d991-42f8-b3e5-deea86e9a118 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:06.736704 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 905/1824] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 31 00:21:06 2022] POST /identity/v3/users => generated 300 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:21:06.746627 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 920/1825] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 00:21:06 2022] PUT /identity/v3/projects/88136abe2a6a46e698d222c8eb7ee661/users/25bad6a65d4a4fe487cb74fd360b6160/roles/fdad79ffbcbb4fa380dc9cf7dd108618 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:21:06.746877 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b51dfcd-c228-455f-8eb3-b8209eceeec0 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:06.749415 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a562c7-7358-41c8-b6ab-04cfa0f47a3f None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:06.749580 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b51dfcd-c228-455f-8eb3-b8209eceeec0 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:06.750380 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a562c7-7358-41c8-b6ab-04cfa0f47a3f None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:06.750588 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a562c7-7358-41c8-b6ab-04cfa0f47a3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:06.807672 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-07a562c7-7358-41c8-b6ab-04cfa0f47a3f None None] MFA Rules not processed for user `25bad6a65d4a4fe487cb74fd360b6160`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:21:06.809367 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-07a562c7-7358-41c8-b6ab-04cfa0f47a3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:06.850513 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d277e3ff-6579-47fe-9417-f651df7baff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:06.851497 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d277e3ff-6579-47fe-9417-f651df7baff5 admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:06.851989 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d277e3ff-6579-47fe-9417-f651df7baff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:06.852469 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d277e3ff-6579-47fe-9417-f651df7baff5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:06.853141 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d277e3ff-6579-47fe-9417-f651df7baff5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:06.855092 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d277e3ff-6579-47fe-9417-f651df7baff5 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:06.872411 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 906/1826] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 00:21:06 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:21:06.873589 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d277e3ff-6579-47fe-9417-f651df7baff5 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:06.899275 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d277e3ff-6579-47fe-9417-f651df7baff5 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:06.921029 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01764bb1-ab1f-4db1-a549-26c05b82dc5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:06.921782 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01764bb1-ab1f-4db1-a549-26c05b82dc5e admin admin] REQUEST_METHOD: `PUT` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:06.922070 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01764bb1-ab1f-4db1-a549-26c05b82dc5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:06.924231 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01764bb1-ab1f-4db1-a549-26c05b82dc5e admin admin] PATH_INFO: `/v3/projects/240d514650df4bbbb4326a209fc3b8b0/users/61d245cadc87435db997858a07f9f5e3/roles/12f6817f9aaa4e2bb477095a6bed5d0f` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:06.950977 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01764bb1-ab1f-4db1-a549-26c05b82dc5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=240d514650df4bbbb4326a209fc3b8b0, user_id=61d245cadc87435db997858a07f9f5e3, role_id=12f6817f9aaa4e2bb477095a6bed5d0f)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:06.951363 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 921/1827] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:21:06 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:21:06.951964 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01764bb1-ab1f-4db1-a549-26c05b82dc5e admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:06.960349 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a562c7-7358-41c8-b6ab-04cfa0f47a3f None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:06.961811 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-07a562c7-7358-41c8-b6ab-04cfa0f47a3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:06.976128 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 907/1828] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 00:21:06 2022] PUT /identity/v3/projects/240d514650df4bbbb4326a209fc3b8b0/users/61d245cadc87435db997858a07f9f5e3/roles/12f6817f9aaa4e2bb477095a6bed5d0f => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:21:06.977656 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01764bb1-ab1f-4db1-a549-26c05b82dc5e admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:07.078567 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:07.094577 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a562c7-7358-41c8-b6ab-04cfa0f47a3f None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:07.134604 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01764bb1-ab1f-4db1-a549-26c05b82dc5e admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:07.166119 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7965c518-fccd-4958-b5fc-12ec4bc31f86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:07.166845 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7965c518-fccd-4958-b5fc-12ec4bc31f86 admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:07.167111 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7965c518-fccd-4958-b5fc-12ec4bc31f86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:07.167387 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7965c518-fccd-4958-b5fc-12ec4bc31f86 admin admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:07.168047 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7965c518-fccd-4958-b5fc-12ec4bc31f86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:07.169751 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7965c518-fccd-4958-b5fc-12ec4bc31f86 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:07.198617 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:07.218132 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 908/1829] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 00:21:06 2022] GET /identity/v3/roles => generated 1420 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:21:07.219278 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7965c518-fccd-4958-b5fc-12ec4bc31f86 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:07.228778 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c75ca6b-1c39-4a02-b0e3-5547fce23778 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc025521e1dc4c91ab50a8718a87754f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:07.229668 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c75ca6b-1c39-4a02-b0e3-5547fce23778 service glance] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:07.230015 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c75ca6b-1c39-4a02-b0e3-5547fce23778 service glance] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:07.230355 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c75ca6b-1c39-4a02-b0e3-5547fce23778 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:07.236332 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7965c518-fccd-4958-b5fc-12ec4bc31f86 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:07.247980 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c92f23-9a61-43c6-b37c-0565bccf1cc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:07.249002 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c92f23-9a61-43c6-b37c-0565bccf1cc8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:07.249340 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c92f23-9a61-43c6-b37c-0565bccf1cc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:07.249691 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c92f23-9a61-43c6-b37c-0565bccf1cc8 admin admin] PATH_INFO: `/v3/projects/240d514650df4bbbb4326a209fc3b8b0/users/61d245cadc87435db997858a07f9f5e3/roles/12f6817f9aaa4e2bb477095a6bed5d0f` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:07.252129 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c92f23-9a61-43c6-b37c-0565bccf1cc8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=240d514650df4bbbb4326a209fc3b8b0, user_id=61d245cadc87435db997858a07f9f5e3, role_id=12f6817f9aaa4e2bb477095a6bed5d0f)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:07.255666 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c92f23-9a61-43c6-b37c-0565bccf1cc8 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:07.269457 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 909/1830] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 00:21:07 2022] PUT /identity/v3/projects/240d514650df4bbbb4326a209fc3b8b0/users/61d245cadc87435db997858a07f9f5e3/roles/12f6817f9aaa4e2bb477095a6bed5d0f => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:21:07.283711 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4f04a7-3b5f-41d0-839d-676a2b13a075 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:07.284007 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4f04a7-3b5f-41d0-839d-676a2b13a075 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:07.284319 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4f04a7-3b5f-41d0-839d-676a2b13a075 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:07.332074 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-4f4f04a7-3b5f-41d0-839d-676a2b13a075 None None] MFA Rules not processed for user `61d245cadc87435db997858a07f9f5e3`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:21:07.335556 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-4f4f04a7-3b5f-41d0-839d-676a2b13a075 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:07.349572 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c75ca6b-1c39-4a02-b0e3-5547fce23778 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:07.354164 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c75ca6b-1c39-4a02-b0e3-5547fce23778 service glance] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:07.380518 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 922/1831] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:21:06 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 00:21:07.527652 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 910/1832] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:21:07 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:21:07.544191 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c75ca6b-1c39-4a02-b0e3-5547fce23778 service glance] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:07.544191 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-0c75ca6b-1c39-4a02-b0e3-5547fce23778 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:07.655775 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c75ca6b-1c39-4a02-b0e3-5547fce23778 service glance] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:07.744864 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35506e47-a951-4a32-8817-1cc7cb787677 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beecda6e9feb400288618745c784989f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:07.746184 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35506e47-a951-4a32-8817-1cc7cb787677 service cinder] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:07.747003 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35506e47-a951-4a32-8817-1cc7cb787677 service cinder] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:07.747811 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35506e47-a951-4a32-8817-1cc7cb787677 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:07.769779 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35506e47-a951-4a32-8817-1cc7cb787677 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:07.774754 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35506e47-a951-4a32-8817-1cc7cb787677 service cinder] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:07.797649 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 923/1833] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:21:07 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:21:08.078116 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4f04a7-3b5f-41d0-839d-676a2b13a075 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:08.274585 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4f04a7-3b5f-41d0-839d-676a2b13a075 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:08.296856 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154bfd8e-c9fb-4058-b940-53f13b0e0197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:08.302234 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154bfd8e-c9fb-4058-b940-53f13b0e0197 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:08.304236 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154bfd8e-c9fb-4058-b940-53f13b0e0197 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:08.304236 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154bfd8e-c9fb-4058-b940-53f13b0e0197 admin admin] PATH_INFO: `/v3/users/286c75953a7c4fe5824df380215b3f7c` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:08.310624 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154bfd8e-c9fb-4058-b940-53f13b0e0197 admin admin] RBAC: Authorizing `identity:delete_user(user_id=286c75953a7c4fe5824df380215b3f7c)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:08.324621 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154bfd8e-c9fb-4058-b940-53f13b0e0197 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:08.444754 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-154bfd8e-c9fb-4058-b940-53f13b0e0197 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '286c75953a7c4fe5824df380215b3f7c'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:08.455237 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-154bfd8e-c9fb-4058-b940-53f13b0e0197 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '286c75953a7c4fe5824df380215b3f7c'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:08.468204 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-154bfd8e-c9fb-4058-b940-53f13b0e0197 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '286c75953a7c4fe5824df380215b3f7c'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:08.480596 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:08.488595 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-154bfd8e-c9fb-4058-b940-53f13b0e0197 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '286c75953a7c4fe5824df380215b3f7c'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:08.490245 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-154bfd8e-c9fb-4058-b940-53f13b0e0197 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '286c75953a7c4fe5824df380215b3f7c'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:08.502359 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 911/1834] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 31 00:21:08 2022] DELETE /identity/v3/users/286c75953a7c4fe5824df380215b3f7c => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:21:08.507072 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204907ea-322a-444e-b7ba-d970759d5529 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:08.508895 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204907ea-322a-444e-b7ba-d970759d5529 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:08.509826 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204907ea-322a-444e-b7ba-d970759d5529 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:08.554193 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-204907ea-322a-444e-b7ba-d970759d5529 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:21:08.555846 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-204907ea-322a-444e-b7ba-d970759d5529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:08.573248 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:08.698963 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 924/1835] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:21:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:21:08.741182 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154bfd8e-c9fb-4058-b940-53f13b0e0197 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:08.743670 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-154bfd8e-c9fb-4058-b940-53f13b0e0197 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:08.936400 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154bfd8e-c9fb-4058-b940-53f13b0e0197 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:08.952413 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7135ed62-fd4d-481c-a4a8-67c990bc2b56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'daae792cd11d4c4ca7aae0558998aced', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:08.954054 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7135ed62-fd4d-481c-a4a8-67c990bc2b56 service neutron] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:08.955382 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7135ed62-fd4d-481c-a4a8-67c990bc2b56 service neutron] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:08.964819 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7135ed62-fd4d-481c-a4a8-67c990bc2b56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:09.040648 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7135ed62-fd4d-481c-a4a8-67c990bc2b56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:09.045991 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7135ed62-fd4d-481c-a4a8-67c990bc2b56 service neutron] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:09.087033 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 912/1836] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:21:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:21:09.507051 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3120397c-8123-4e17-bba0-33df79d66811 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:09.508114 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3120397c-8123-4e17-bba0-33df79d66811 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:09.508763 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3120397c-8123-4e17-bba0-33df79d66811 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:09.586761 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-3120397c-8123-4e17-bba0-33df79d66811 None None] MFA Rules not processed for user `1c36ea5848ee4edfaf8b11fa245086a4`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:21:09.588891 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-3120397c-8123-4e17-bba0-33df79d66811 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:09.823718 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 925/1837] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:21:09 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:21:09.829352 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7135ed62-fd4d-481c-a4a8-67c990bc2b56 service neutron] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:09.833648 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-7135ed62-fd4d-481c-a4a8-67c990bc2b56 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:09.879143 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7135ed62-fd4d-481c-a4a8-67c990bc2b56 service neutron] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:09.892230 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539d0a4e-bc9f-4fc7-83ca-67305cb67c0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:09.893659 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539d0a4e-bc9f-4fc7-83ca-67305cb67c0b admin admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:09.894619 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539d0a4e-bc9f-4fc7-83ca-67305cb67c0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:09.895204 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539d0a4e-bc9f-4fc7-83ca-67305cb67c0b admin admin] PATH_INFO: `/v3/projects` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:09.897616 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539d0a4e-bc9f-4fc7-83ca-67305cb67c0b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:09.905461 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539d0a4e-bc9f-4fc7-83ca-67305cb67c0b admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:10.006145 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 913/1838] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 31 00:21:09 2022] POST /identity/v3/projects => generated 373 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:21:10.010057 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3120397c-8123-4e17-bba0-33df79d66811 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:10.031208 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3120397c-8123-4e17-bba0-33df79d66811 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:10.119257 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bb1224-c9ca-4061-8647-28c61de6a92e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:10.120075 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bb1224-c9ca-4061-8647-28c61de6a92e admin admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:10.120561 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bb1224-c9ca-4061-8647-28c61de6a92e admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:10.121801 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bb1224-c9ca-4061-8647-28c61de6a92e admin admin] PATH_INFO: `/v3/users` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:10.122817 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bb1224-c9ca-4061-8647-28c61de6a92e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:10.124977 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bb1224-c9ca-4061-8647-28c61de6a92e admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:10.162608 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 926/1839] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 31 00:21:10 2022] POST /identity/v3/users => generated 293 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:21:10.168059 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539d0a4e-bc9f-4fc7-83ca-67305cb67c0b admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:10.206161 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539d0a4e-bc9f-4fc7-83ca-67305cb67c0b admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:10.219098 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496f3f26-93fd-450a-894b-b89cb0608aa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:10.219754 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496f3f26-93fd-450a-894b-b89cb0608aa7 admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:10.220047 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496f3f26-93fd-450a-894b-b89cb0608aa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:10.220327 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496f3f26-93fd-450a-894b-b89cb0608aa7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:10.221038 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496f3f26-93fd-450a-894b-b89cb0608aa7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:10.223611 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496f3f26-93fd-450a-894b-b89cb0608aa7 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:10.262206 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 914/1840] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 00:21:10 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:21:10.267410 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bb1224-c9ca-4061-8647-28c61de6a92e admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:10.282087 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bb1224-c9ca-4061-8647-28c61de6a92e admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:10.291100 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e1dc6d-3cb8-45da-98cf-e22e4bac38b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:10.292451 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e1dc6d-3cb8-45da-98cf-e22e4bac38b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:10.292984 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e1dc6d-3cb8-45da-98cf-e22e4bac38b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:10.293427 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e1dc6d-3cb8-45da-98cf-e22e4bac38b9 admin admin] PATH_INFO: `/v3/projects/871c0980061249538b44de32d998f060/users/6dcc1fdb1131480bae2fc23ee9301021/roles/12f6817f9aaa4e2bb477095a6bed5d0f` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:10.327104 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e1dc6d-3cb8-45da-98cf-e22e4bac38b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=871c0980061249538b44de32d998f060, user_id=6dcc1fdb1131480bae2fc23ee9301021, role_id=12f6817f9aaa4e2bb477095a6bed5d0f)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:10.331439 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e1dc6d-3cb8-45da-98cf-e22e4bac38b9 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:10.354359 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 927/1841] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 00:21:10 2022] PUT /identity/v3/projects/871c0980061249538b44de32d998f060/users/6dcc1fdb1131480bae2fc23ee9301021/roles/12f6817f9aaa4e2bb477095a6bed5d0f => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:21:10.359751 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496f3f26-93fd-450a-894b-b89cb0608aa7 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:10.384021 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496f3f26-93fd-450a-894b-b89cb0608aa7 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:10.578757 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e143d0-9ca9-455e-ad45-3c325b1b6a99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:10.579441 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e143d0-9ca9-455e-ad45-3c325b1b6a99 admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:10.579744 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e143d0-9ca9-455e-ad45-3c325b1b6a99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:10.579999 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e143d0-9ca9-455e-ad45-3c325b1b6a99 admin admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:10.580715 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e143d0-9ca9-455e-ad45-3c325b1b6a99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:10.584977 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e143d0-9ca9-455e-ad45-3c325b1b6a99 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:10.598555 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 915/1842] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 00:21:10 2022] GET /identity/v3/roles => generated 1420 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:21:10.604376 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e1dc6d-3cb8-45da-98cf-e22e4bac38b9 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:10.617547 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e1dc6d-3cb8-45da-98cf-e22e4bac38b9 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:10.623100 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36619b0d-5720-4c85-8d95-b3946fbe2c0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:10.623972 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36619b0d-5720-4c85-8d95-b3946fbe2c0d admin admin] REQUEST_METHOD: `PUT` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:10.624298 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36619b0d-5720-4c85-8d95-b3946fbe2c0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:10.625237 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36619b0d-5720-4c85-8d95-b3946fbe2c0d admin admin] PATH_INFO: `/v3/projects/871c0980061249538b44de32d998f060/users/6dcc1fdb1131480bae2fc23ee9301021/roles/12f6817f9aaa4e2bb477095a6bed5d0f` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:10.627284 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36619b0d-5720-4c85-8d95-b3946fbe2c0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=871c0980061249538b44de32d998f060, user_id=6dcc1fdb1131480bae2fc23ee9301021, role_id=12f6817f9aaa4e2bb477095a6bed5d0f)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:10.630954 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36619b0d-5720-4c85-8d95-b3946fbe2c0d admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:10.637365 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:10.654738 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 928/1843] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 00:21:10 2022] PUT /identity/v3/projects/871c0980061249538b44de32d998f060/users/6dcc1fdb1131480bae2fc23ee9301021/roles/12f6817f9aaa4e2bb477095a6bed5d0f => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:21:11.143786 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e143d0-9ca9-455e-ad45-3c325b1b6a99 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:11.145987 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-15e143d0-9ca9-455e-ad45-3c325b1b6a99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:11.162865 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e143d0-9ca9-455e-ad45-3c325b1b6a99 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:11.242302 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:INSERT=1 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:11.260282 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a366a7d7-4833-49dd-9b26-4cde35f720ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:11.261003 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a366a7d7-4833-49dd-9b26-4cde35f720ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:11.261412 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a366a7d7-4833-49dd-9b26-4cde35f720ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:11.261855 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a366a7d7-4833-49dd-9b26-4cde35f720ab admin admin] PATH_INFO: `/v3/projects/4e6e6df09cc54b4287635a02ba767f13` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:11.263461 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a366a7d7-4833-49dd-9b26-4cde35f720ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e6e6df09cc54b4287635a02ba767f13)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:11.266274 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a366a7d7-4833-49dd-9b26-4cde35f720ab admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:11.331765 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-a366a7d7-4833-49dd-9b26-4cde35f720ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e6e6df09cc54b4287635a02ba767f13', 'request_id': 'req-a366a7d7-4833-49dd-9b26-4cde35f720ab'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:11.340744 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-a366a7d7-4833-49dd-9b26-4cde35f720ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e6e6df09cc54b4287635a02ba767f13', 'request_id': 'req-a366a7d7-4833-49dd-9b26-4cde35f720ab'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:11.351603 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-a366a7d7-4833-49dd-9b26-4cde35f720ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e6e6df09cc54b4287635a02ba767f13', 'request_id': 'req-a366a7d7-4833-49dd-9b26-4cde35f720ab'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:11.409600 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-a366a7d7-4833-49dd-9b26-4cde35f720ab admin admin] The token cache is being invalidate because project 4e6e6df09cc54b4287635a02ba767f13 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81523) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:21:11.409832 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-a366a7d7-4833-49dd-9b26-4cde35f720ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:11.410744 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-a366a7d7-4833-49dd-9b26-4cde35f720ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:11.433617 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 916/1844] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 31 00:21:11 2022] DELETE /identity/v3/projects/4e6e6df09cc54b4287635a02ba767f13 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:21:11.437864 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36619b0d-5720-4c85-8d95-b3946fbe2c0d admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:11.440402 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-36619b0d-5720-4c85-8d95-b3946fbe2c0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:11.465590 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36619b0d-5720-4c85-8d95-b3946fbe2c0d admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:11.594115 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ded5101-2330-42d1-b098-4e38e66da799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:11.594922 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ded5101-2330-42d1-b098-4e38e66da799 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:11.595218 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ded5101-2330-42d1-b098-4e38e66da799 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:11.595497 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ded5101-2330-42d1-b098-4e38e66da799 admin admin] PATH_INFO: `/v3/users/61d245cadc87435db997858a07f9f5e3` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:11.596874 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ded5101-2330-42d1-b098-4e38e66da799 admin admin] RBAC: Authorizing `identity:delete_user(user_id=61d245cadc87435db997858a07f9f5e3)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:11.599481 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ded5101-2330-42d1-b098-4e38e66da799 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:11.690408 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-3ded5101-2330-42d1-b098-4e38e66da799 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61d245cadc87435db997858a07f9f5e3'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:11.700920 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-3ded5101-2330-42d1-b098-4e38e66da799 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61d245cadc87435db997858a07f9f5e3'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:11.714109 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-3ded5101-2330-42d1-b098-4e38e66da799 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61d245cadc87435db997858a07f9f5e3'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:11.715368 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-3ded5101-2330-42d1-b098-4e38e66da799 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61d245cadc87435db997858a07f9f5e3'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:11.756494 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-3ded5101-2330-42d1-b098-4e38e66da799 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61d245cadc87435db997858a07f9f5e3'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:11.772642 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 929/1845] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 31 00:21:11 2022] DELETE /identity/v3/users/61d245cadc87435db997858a07f9f5e3 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:21:12.585078 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921996b8-69ac-42fe-b1e7-c8c6225ce338 None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:12.585644 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921996b8-69ac-42fe-b1e7-c8c6225ce338 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:12.585644 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921996b8-69ac-42fe-b1e7-c8c6225ce338 None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:12.587360 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 917/1846] 10.222.0.47 () {54 vars in 921 bytes} [Wed Aug 31 00:21:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:21:12.609889 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a27c1d3-5717-403d-a306-43b99b7a8a54 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:12.610431 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a27c1d3-5717-403d-a306-43b99b7a8a54 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:12.610739 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a27c1d3-5717-403d-a306-43b99b7a8a54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:12.668710 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-7a27c1d3-5717-403d-a306-43b99b7a8a54 None None] MFA Rules not processed for user `9ea002bf49c248dbae7147665fa10fd1`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:21:12.672827 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-7a27c1d3-5717-403d-a306-43b99b7a8a54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:12.905136 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 930/1847] 10.222.0.47 () {58 vars in 1018 bytes} [Wed Aug 31 00:21:12 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:21:13.230542 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921996b8-69ac-42fe-b1e7-c8c6225ce338 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:13.234091 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-921996b8-69ac-42fe-b1e7-c8c6225ce338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:13.284494 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921996b8-69ac-42fe-b1e7-c8c6225ce338 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:13.299253 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf09c81c-fef7-406b-ab9e-3ba4410f3586 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea002bf49c248dbae7147665fa10fd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:13.300769 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf09c81c-fef7-406b-ab9e-3ba4410f3586 service nova] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:13.301570 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf09c81c-fef7-406b-ab9e-3ba4410f3586 service nova] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:13.303829 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf09c81c-fef7-406b-ab9e-3ba4410f3586 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:13.323125 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf09c81c-fef7-406b-ab9e-3ba4410f3586 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:13.326981 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf09c81c-fef7-406b-ab9e-3ba4410f3586 service nova] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:13.349388 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 918/1848] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:21:13 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:21:13.461483 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb534886-d5c5-4a7c-979b-d3c94a98e5a7 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:13.462223 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb534886-d5c5-4a7c-979b-d3c94a98e5a7 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:13.463583 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb534886-d5c5-4a7c-979b-d3c94a98e5a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:13.509856 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:13.546155 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-eb534886-d5c5-4a7c-979b-d3c94a98e5a7 None None] MFA Rules not processed for user `6dcc1fdb1131480bae2fc23ee9301021`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:21:13.551079 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-eb534886-d5c5-4a7c-979b-d3c94a98e5a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:13.605342 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf09c81c-fef7-406b-ab9e-3ba4410f3586 service nova] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:13.608141 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-bf09c81c-fef7-406b-ab9e-3ba4410f3586 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:13.755888 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 931/1849] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:21:13 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:21:13.771834 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb534886-d5c5-4a7c-979b-d3c94a98e5a7 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:13.773595 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-eb534886-d5c5-4a7c-979b-d3c94a98e5a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:13.858207 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf09c81c-fef7-406b-ab9e-3ba4410f3586 service nova] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:13.878899 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb705d00-2fa8-444f-8652-6d4879d9859a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:13.882146 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb705d00-2fa8-444f-8652-6d4879d9859a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:13.882146 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb705d00-2fa8-444f-8652-6d4879d9859a admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:13.882146 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb705d00-2fa8-444f-8652-6d4879d9859a admin admin] PATH_INFO: `/v3/projects/240d514650df4bbbb4326a209fc3b8b0` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:13.886048 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb705d00-2fa8-444f-8652-6d4879d9859a admin admin] RBAC: Authorizing `identity:delete_project(project_id=240d514650df4bbbb4326a209fc3b8b0)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:13.889242 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb705d00-2fa8-444f-8652-6d4879d9859a admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:13.907968 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb534886-d5c5-4a7c-979b-d3c94a98e5a7 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:13.918221 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26b6578-fa83-4e07-9248-ae0be4b98631 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beecda6e9feb400288618745c784989f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:13.919841 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26b6578-fa83-4e07-9248-ae0be4b98631 service cinder] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:13.920554 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26b6578-fa83-4e07-9248-ae0be4b98631 service cinder] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:13.921137 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26b6578-fa83-4e07-9248-ae0be4b98631 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:13.928767 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-a26b6578-fa83-4e07-9248-ae0be4b98631 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:14.047868 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-cb705d00-2fa8-444f-8652-6d4879d9859a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '240d514650df4bbbb4326a209fc3b8b0', 'request_id': 'req-cb705d00-2fa8-444f-8652-6d4879d9859a'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:14.068048 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-cb705d00-2fa8-444f-8652-6d4879d9859a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '240d514650df4bbbb4326a209fc3b8b0', 'request_id': 'req-cb705d00-2fa8-444f-8652-6d4879d9859a'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:14.095261 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26b6578-fa83-4e07-9248-ae0be4b98631 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:14.097326 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26b6578-fa83-4e07-9248-ae0be4b98631 service cinder] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:14.103500 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-cb705d00-2fa8-444f-8652-6d4879d9859a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '240d514650df4bbbb4326a209fc3b8b0', 'request_id': 'req-cb705d00-2fa8-444f-8652-6d4879d9859a'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:14.125309 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 932/1850] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:21:13 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 00:21:14.201713 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-cb705d00-2fa8-444f-8652-6d4879d9859a admin admin] The token cache is being invalidate because project 240d514650df4bbbb4326a209fc3b8b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81523) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:21:14.202398 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-cb705d00-2fa8-444f-8652-6d4879d9859a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:14.204423 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-cb705d00-2fa8-444f-8652-6d4879d9859a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:14.210818 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 919/1851] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 31 00:21:13 2022] DELETE /identity/v3/projects/240d514650df4bbbb4326a209fc3b8b0 => generated 0 bytes in 606 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:21:14.217563 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6710c7-1406-4d0f-a075-25fd67da7cf3 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:14.217884 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6710c7-1406-4d0f-a075-25fd67da7cf3 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:14.218131 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6710c7-1406-4d0f-a075-25fd67da7cf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:14.277830 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-0e6710c7-1406-4d0f-a075-25fd67da7cf3 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:21:14.278305 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-0e6710c7-1406-4d0f-a075-25fd67da7cf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:14.453173 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:14.519796 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 933/1852] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:21:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:21:14.527387 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e204b411-c7ec-463d-9662-337c2413dc89 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:14.528330 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e204b411-c7ec-463d-9662-337c2413dc89 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:14.528760 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e204b411-c7ec-463d-9662-337c2413dc89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:14.556688 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:14.606832 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-e204b411-c7ec-463d-9662-337c2413dc89 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:21:14.609166 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-e204b411-c7ec-463d-9662-337c2413dc89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:14.640092 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 920/1853] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:21:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:21:14.646193 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6710c7-1406-4d0f-a075-25fd67da7cf3 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:14.671808 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6710c7-1406-4d0f-a075-25fd67da7cf3 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:14.683503 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e79a07-2eb8-4ec4-9df9-157836dcb2e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:14.684235 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e79a07-2eb8-4ec4-9df9-157836dcb2e5 admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:14.684509 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e79a07-2eb8-4ec4-9df9-157836dcb2e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:14.684944 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e79a07-2eb8-4ec4-9df9-157836dcb2e5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:14.685625 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e79a07-2eb8-4ec4-9df9-157836dcb2e5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:21:14.685936 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e79a07-2eb8-4ec4-9df9-157836dcb2e5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:14.687872 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e79a07-2eb8-4ec4-9df9-157836dcb2e5 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:14.707391 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 934/1854] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 31 00:21:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:21:14.713248 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e204b411-c7ec-463d-9662-337c2413dc89 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:14.732413 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e204b411-c7ec-463d-9662-337c2413dc89 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:14.742558 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8251620b-87a3-4456-a992-382d44748eb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:14.743941 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8251620b-87a3-4456-a992-382d44748eb2 admin admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:14.744383 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8251620b-87a3-4456-a992-382d44748eb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:14.744806 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8251620b-87a3-4456-a992-382d44748eb2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:14.745882 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8251620b-87a3-4456-a992-382d44748eb2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:14.748199 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8251620b-87a3-4456-a992-382d44748eb2 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:14.815846 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 921/1855] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 31 00:21:14 2022] POST /identity/v3/projects => generated 379 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:21:14.832194 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e79a07-2eb8-4ec4-9df9-157836dcb2e5 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:14.846732 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e79a07-2eb8-4ec4-9df9-157836dcb2e5 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:15.062242 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6c5d1d-2305-48c2-887f-1efa41ea345c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:15.063229 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6c5d1d-2305-48c2-887f-1efa41ea345c admin admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:15.063229 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6c5d1d-2305-48c2-887f-1efa41ea345c admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:15.063560 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6c5d1d-2305-48c2-887f-1efa41ea345c admin admin] PATH_INFO: `/v3/users` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:15.064642 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6c5d1d-2305-48c2-887f-1efa41ea345c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:15.067207 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6c5d1d-2305-48c2-887f-1efa41ea345c admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:15.117309 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 935/1856] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 31 00:21:14 2022] POST /identity/v3/users => generated 290 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:21:15.134951 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8251620b-87a3-4456-a992-382d44748eb2 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:15.157522 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8251620b-87a3-4456-a992-382d44748eb2 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:15.179311 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453e9b66-be92-4ee9-91c9-e759a30163f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:15.180442 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453e9b66-be92-4ee9-91c9-e759a30163f1 admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:15.180939 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453e9b66-be92-4ee9-91c9-e759a30163f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:15.181432 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453e9b66-be92-4ee9-91c9-e759a30163f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:15.182702 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453e9b66-be92-4ee9-91c9-e759a30163f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:15.194841 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453e9b66-be92-4ee9-91c9-e759a30163f1 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:15.220097 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 922/1857] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 00:21:15 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:21:15.227028 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6c5d1d-2305-48c2-887f-1efa41ea345c admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:15.264723 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6c5d1d-2305-48c2-887f-1efa41ea345c admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:15.277643 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd256fd-a828-49c0-8178-44b7d207fb66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:15.278895 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd256fd-a828-49c0-8178-44b7d207fb66 admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:15.279542 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd256fd-a828-49c0-8178-44b7d207fb66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:15.280442 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd256fd-a828-49c0-8178-44b7d207fb66 admin admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:15.282078 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd256fd-a828-49c0-8178-44b7d207fb66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:15.285270 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd256fd-a828-49c0-8178-44b7d207fb66 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:15.314366 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 936/1858] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 00:21:15 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:21:15.322254 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453e9b66-be92-4ee9-91c9-e759a30163f1 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:15.368776 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453e9b66-be92-4ee9-91c9-e759a30163f1 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:15.384758 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe1fa3e-9a23-4985-85f2-26ac08fabd5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:15.385538 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe1fa3e-9a23-4985-85f2-26ac08fabd5d admin admin] REQUEST_METHOD: `PUT` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:15.386149 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe1fa3e-9a23-4985-85f2-26ac08fabd5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:15.386746 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe1fa3e-9a23-4985-85f2-26ac08fabd5d admin admin] PATH_INFO: `/v3/projects/8c840da065b146d8a12bd5fcce137843/users/1fa51f02ef5543978b8c9c23662d9e00/roles/fdad79ffbcbb4fa380dc9cf7dd108618` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:15.435477 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe1fa3e-9a23-4985-85f2-26ac08fabd5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c840da065b146d8a12bd5fcce137843, user_id=1fa51f02ef5543978b8c9c23662d9e00, role_id=fdad79ffbcbb4fa380dc9cf7dd108618)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:15.441797 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe1fa3e-9a23-4985-85f2-26ac08fabd5d admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:15.480208 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 923/1859] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 00:21:15 2022] PUT /identity/v3/projects/8c840da065b146d8a12bd5fcce137843/users/1fa51f02ef5543978b8c9c23662d9e00/roles/fdad79ffbcbb4fa380dc9cf7dd108618 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:21:15.499334 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1aed0f-2832-4477-9cc8-c5301e3eaf5e None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:15.500213 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1aed0f-2832-4477-9cc8-c5301e3eaf5e None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:15.500814 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1aed0f-2832-4477-9cc8-c5301e3eaf5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:15.565290 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-ca1aed0f-2832-4477-9cc8-c5301e3eaf5e None None] MFA Rules not processed for user `1fa51f02ef5543978b8c9c23662d9e00`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:21:15.566705 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-ca1aed0f-2832-4477-9cc8-c5301e3eaf5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:15.706313 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 937/1860] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:21:15 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:21:15.710164 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe1fa3e-9a23-4985-85f2-26ac08fabd5d admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:15.865308 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe1fa3e-9a23-4985-85f2-26ac08fabd5d admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:15.874765 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81e5da9-fb56-428c-b013-77420de41c95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:15.875845 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81e5da9-fb56-428c-b013-77420de41c95 admin admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:15.876625 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81e5da9-fb56-428c-b013-77420de41c95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:15.877088 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81e5da9-fb56-428c-b013-77420de41c95 admin admin] PATH_INFO: `/v3/projects` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:15.878342 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81e5da9-fb56-428c-b013-77420de41c95 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:15.889725 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81e5da9-fb56-428c-b013-77420de41c95 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:15.953785 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 924/1861] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 31 00:21:15 2022] POST /identity/v3/projects => generated 377 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:21:15.960075 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1aed0f-2832-4477-9cc8-c5301e3eaf5e None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:15.988026 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1aed0f-2832-4477-9cc8-c5301e3eaf5e None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:16.059283 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:16.100736 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf973e3-f9f0-4936-8d8a-70cd1b16ce4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:16.101967 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf973e3-f9f0-4936-8d8a-70cd1b16ce4e admin admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:16.102491 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf973e3-f9f0-4936-8d8a-70cd1b16ce4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:16.102993 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf973e3-f9f0-4936-8d8a-70cd1b16ce4e admin admin] PATH_INFO: `/v3/users` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:16.104253 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf973e3-f9f0-4936-8d8a-70cd1b16ce4e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:16.108510 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf973e3-f9f0-4936-8d8a-70cd1b16ce4e admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:16.157273 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 938/1862] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 31 00:21:15 2022] POST /identity/v3/users => generated 289 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:21:16.164744 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81e5da9-fb56-428c-b013-77420de41c95 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:16.204545 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81e5da9-fb56-428c-b013-77420de41c95 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:16.219162 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e340917b-ef51-440e-b7fe-db4ebe4844e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:16.222432 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e340917b-ef51-440e-b7fe-db4ebe4844e0 admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:16.224851 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e340917b-ef51-440e-b7fe-db4ebe4844e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:16.225644 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e340917b-ef51-440e-b7fe-db4ebe4844e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:16.228818 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e340917b-ef51-440e-b7fe-db4ebe4844e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:16.242281 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e340917b-ef51-440e-b7fe-db4ebe4844e0 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:16.258818 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf973e3-f9f0-4936-8d8a-70cd1b16ce4e admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:16.262910 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-acf973e3-f9f0-4936-8d8a-70cd1b16ce4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:16.340207 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 925/1863] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 00:21:16 2022] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 00:21:16.340207 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e340917b-ef51-440e-b7fe-db4ebe4844e0 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:16.381814 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e340917b-ef51-440e-b7fe-db4ebe4844e0 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:16.405123 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb82a8a-901c-4914-b509-0909008fc970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:16.406181 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb82a8a-901c-4914-b509-0909008fc970 admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:16.408976 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb82a8a-901c-4914-b509-0909008fc970 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:16.409942 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb82a8a-901c-4914-b509-0909008fc970 admin admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:16.411441 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb82a8a-901c-4914-b509-0909008fc970 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:16.414666 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb82a8a-901c-4914-b509-0909008fc970 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:16.460102 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 926/1864] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 00:21:16 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:21:16.466187 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb82a8a-901c-4914-b509-0909008fc970 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:16.497482 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb82a8a-901c-4914-b509-0909008fc970 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:16.510945 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6488d66-ce10-4a1b-b8a9-db9d6d983caa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:16.512966 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6488d66-ce10-4a1b-b8a9-db9d6d983caa admin admin] REQUEST_METHOD: `PUT` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:16.513737 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6488d66-ce10-4a1b-b8a9-db9d6d983caa admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:16.514485 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6488d66-ce10-4a1b-b8a9-db9d6d983caa admin admin] PATH_INFO: `/v3/projects/a1f1d3948d13457e89167104d4c19884/users/984d306949a04ce1949aaab5b5b30658/roles/fdad79ffbcbb4fa380dc9cf7dd108618` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:16.543373 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf973e3-f9f0-4936-8d8a-70cd1b16ce4e admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:16.545644 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6488d66-ce10-4a1b-b8a9-db9d6d983caa admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1f1d3948d13457e89167104d4c19884, user_id=984d306949a04ce1949aaab5b5b30658, role_id=fdad79ffbcbb4fa380dc9cf7dd108618)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:16.549796 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6488d66-ce10-4a1b-b8a9-db9d6d983caa admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:16.557720 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7958e0-f18e-418e-983c-947c7d32019b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beecda6e9feb400288618745c784989f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:16.558817 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7958e0-f18e-418e-983c-947c7d32019b service cinder] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:16.559337 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7958e0-f18e-418e-983c-947c7d32019b service cinder] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:16.559765 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7958e0-f18e-418e-983c-947c7d32019b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:16.570752 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 927/1865] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 00:21:16 2022] PUT /identity/v3/projects/a1f1d3948d13457e89167104d4c19884/users/984d306949a04ce1949aaab5b5b30658/roles/fdad79ffbcbb4fa380dc9cf7dd108618 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:21:16.582230 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-bb7958e0-f18e-418e-983c-947c7d32019b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:16.594630 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c1a222-723f-4420-b5a7-0473b1bfc337 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:16.595164 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c1a222-723f-4420-b5a7-0473b1bfc337 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:16.595586 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c1a222-723f-4420-b5a7-0473b1bfc337 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:16.659415 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-56c1a222-723f-4420-b5a7-0473b1bfc337 None None] MFA Rules not processed for user `984d306949a04ce1949aaab5b5b30658`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:21:16.662711 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-56c1a222-723f-4420-b5a7-0473b1bfc337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:16.710102 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:16.778126 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7958e0-f18e-418e-983c-947c7d32019b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:16.781238 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7958e0-f18e-418e-983c-947c7d32019b service cinder] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:16.801533 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 939/1866] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:21:16 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 544 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:21:16.849761 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 928/1867] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:21:16 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:21:16.851448 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7958e0-f18e-418e-983c-947c7d32019b service cinder] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:16.894768 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7958e0-f18e-418e-983c-947c7d32019b service cinder] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:17.157236 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9853a54-a215-426e-9bb4-26cf35cca578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:17.179458 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9853a54-a215-426e-9bb4-26cf35cca578 admin admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:17.180067 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9853a54-a215-426e-9bb4-26cf35cca578 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:17.180578 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9853a54-a215-426e-9bb4-26cf35cca578 admin admin] PATH_INFO: `/v3/projects` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:17.181816 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9853a54-a215-426e-9bb4-26cf35cca578 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:17.185593 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9853a54-a215-426e-9bb4-26cf35cca578 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:17.327130 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 940/1868] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 31 00:21:16 2022] POST /identity/v3/projects => generated 377 bytes in 475 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:21:17.334496 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c1a222-723f-4420-b5a7-0473b1bfc337 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:17.379297 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c1a222-723f-4420-b5a7-0473b1bfc337 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:17.530325 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb67453-6eb6-4973-80aa-63f209fd8577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:17.533529 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb67453-6eb6-4973-80aa-63f209fd8577 admin admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:17.533760 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb67453-6eb6-4973-80aa-63f209fd8577 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:17.534177 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb67453-6eb6-4973-80aa-63f209fd8577 admin admin] PATH_INFO: `/v3/users` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:17.537010 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb67453-6eb6-4973-80aa-63f209fd8577 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:17.539876 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb67453-6eb6-4973-80aa-63f209fd8577 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:17.600201 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 929/1869] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 31 00:21:17 2022] POST /identity/v3/users => generated 295 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:21:17.606331 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9853a54-a215-426e-9bb4-26cf35cca578 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:17.648909 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9853a54-a215-426e-9bb4-26cf35cca578 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:17.657231 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d72425-78b2-4190-a512-3fe85df68f4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:17.658719 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d72425-78b2-4190-a512-3fe85df68f4d admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:17.659291 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d72425-78b2-4190-a512-3fe85df68f4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:17.659870 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d72425-78b2-4190-a512-3fe85df68f4d admin admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:17.661178 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d72425-78b2-4190-a512-3fe85df68f4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:17.664388 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d72425-78b2-4190-a512-3fe85df68f4d admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:17.667329 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:17.690491 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 941/1870] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 00:21:17 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:21:17.695376 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb67453-6eb6-4973-80aa-63f209fd8577 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:17.707673 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb67453-6eb6-4973-80aa-63f209fd8577 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:17.713543 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2574a3-fae7-4173-9e22-c36ec4a99313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:17.714526 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2574a3-fae7-4173-9e22-c36ec4a99313 admin admin] REQUEST_METHOD: `PUT` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:17.715028 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2574a3-fae7-4173-9e22-c36ec4a99313 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:17.715310 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2574a3-fae7-4173-9e22-c36ec4a99313 admin admin] PATH_INFO: `/v3/projects/f55f15b28e5e4d14bdcd5209cb950b09/users/7ad767a7825547c1b13278f9c25b8fea/roles/12f6817f9aaa4e2bb477095a6bed5d0f` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:17.736632 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2574a3-fae7-4173-9e22-c36ec4a99313 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f55f15b28e5e4d14bdcd5209cb950b09, user_id=7ad767a7825547c1b13278f9c25b8fea, role_id=12f6817f9aaa4e2bb477095a6bed5d0f)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:17.741835 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2574a3-fae7-4173-9e22-c36ec4a99313 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:17.761117 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 930/1871] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 00:21:17 2022] PUT /identity/v3/projects/f55f15b28e5e4d14bdcd5209cb950b09/users/7ad767a7825547c1b13278f9c25b8fea/roles/12f6817f9aaa4e2bb477095a6bed5d0f => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:21:17.762635 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d72425-78b2-4190-a512-3fe85df68f4d admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:17.779731 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d72425-78b2-4190-a512-3fe85df68f4d admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:17.865409 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfc9b89-1600-4cea-993f-b8300f5acb51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:17.866716 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfc9b89-1600-4cea-993f-b8300f5acb51 admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:17.867496 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfc9b89-1600-4cea-993f-b8300f5acb51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:17.868215 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfc9b89-1600-4cea-993f-b8300f5acb51 admin admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:17.870014 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfc9b89-1600-4cea-993f-b8300f5acb51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:17.874073 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfc9b89-1600-4cea-993f-b8300f5acb51 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:17.912623 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 942/1872] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 00:21:17 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 00:21:17.918841 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2574a3-fae7-4173-9e22-c36ec4a99313 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:17.946629 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2574a3-fae7-4173-9e22-c36ec4a99313 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:17.962392 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2ce415-82c0-4ebf-8779-c04f5c4b2806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:17.966882 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2ce415-82c0-4ebf-8779-c04f5c4b2806 admin admin] REQUEST_METHOD: `PUT` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:17.967309 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2ce415-82c0-4ebf-8779-c04f5c4b2806 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:17.967652 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2ce415-82c0-4ebf-8779-c04f5c4b2806 admin admin] PATH_INFO: `/v3/projects/f55f15b28e5e4d14bdcd5209cb950b09/users/7ad767a7825547c1b13278f9c25b8fea/roles/12f6817f9aaa4e2bb477095a6bed5d0f` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:17.973055 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2ce415-82c0-4ebf-8779-c04f5c4b2806 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f55f15b28e5e4d14bdcd5209cb950b09, user_id=7ad767a7825547c1b13278f9c25b8fea, role_id=12f6817f9aaa4e2bb477095a6bed5d0f)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:17.976248 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2ce415-82c0-4ebf-8779-c04f5c4b2806 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:18.005035 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 931/1873] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 00:21:17 2022] PUT /identity/v3/projects/f55f15b28e5e4d14bdcd5209cb950b09/users/7ad767a7825547c1b13278f9c25b8fea/roles/12f6817f9aaa4e2bb477095a6bed5d0f => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:21:18.025752 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64adc671-799a-4c8d-a596-75fdd6cb3fcf None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:18.026248 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64adc671-799a-4c8d-a596-75fdd6cb3fcf None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:18.026780 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64adc671-799a-4c8d-a596-75fdd6cb3fcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:18.074779 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-64adc671-799a-4c8d-a596-75fdd6cb3fcf None None] MFA Rules not processed for user `7ad767a7825547c1b13278f9c25b8fea`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:21:18.078108 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-64adc671-799a-4c8d-a596-75fdd6cb3fcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:18.219502 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 943/1874] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:21:18 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:21:18.233825 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2ce415-82c0-4ebf-8779-c04f5c4b2806 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:18.361854 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2ce415-82c0-4ebf-8779-c04f5c4b2806 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:18.369864 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148c018e-8b93-4b0f-9206-2d0361728629 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beecda6e9feb400288618745c784989f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:18.370790 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148c018e-8b93-4b0f-9206-2d0361728629 service cinder] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:18.371733 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148c018e-8b93-4b0f-9206-2d0361728629 service cinder] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:18.372358 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148c018e-8b93-4b0f-9206-2d0361728629 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:18.388457 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148c018e-8b93-4b0f-9206-2d0361728629 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:18.390506 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148c018e-8b93-4b0f-9206-2d0361728629 service cinder] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:18.414290 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 932/1875] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:21:18 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:21:18.719545 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64adc671-799a-4c8d-a596-75fdd6cb3fcf None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:18.765771 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64adc671-799a-4c8d-a596-75fdd6cb3fcf None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:18.785199 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94ea354-eee2-47cb-afd0-698f064ffb9c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beecda6e9feb400288618745c784989f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:18.786770 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94ea354-eee2-47cb-afd0-698f064ffb9c service cinder] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:18.787219 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94ea354-eee2-47cb-afd0-698f064ffb9c service cinder] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:18.787661 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94ea354-eee2-47cb-afd0-698f064ffb9c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:18.944434 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94ea354-eee2-47cb-afd0-698f064ffb9c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:18.946830 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94ea354-eee2-47cb-afd0-698f064ffb9c service cinder] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:18.964866 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 944/1876] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:21:18 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:21:22.688429 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148c018e-8b93-4b0f-9206-2d0361728629 service cinder] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:22.756909 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:22.814340 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148c018e-8b93-4b0f-9206-2d0361728629 service cinder] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:22.820949 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ede795-0ed4-490f-9328-ff95ac6d144e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:22.821878 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ede795-0ed4-490f-9328-ff95ac6d144e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:22.822316 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ede795-0ed4-490f-9328-ff95ac6d144e admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:22.823138 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ede795-0ed4-490f-9328-ff95ac6d144e admin admin] PATH_INFO: `/v3/users/1fa51f02ef5543978b8c9c23662d9e00` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:22.824868 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ede795-0ed4-490f-9328-ff95ac6d144e admin admin] RBAC: Authorizing `identity:delete_user(user_id=1fa51f02ef5543978b8c9c23662d9e00)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:22.827108 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ede795-0ed4-490f-9328-ff95ac6d144e admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:22.947568 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-82ede795-0ed4-490f-9328-ff95ac6d144e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1fa51f02ef5543978b8c9c23662d9e00'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:22.964438 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-82ede795-0ed4-490f-9328-ff95ac6d144e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1fa51f02ef5543978b8c9c23662d9e00'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:22.992339 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-82ede795-0ed4-490f-9328-ff95ac6d144e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1fa51f02ef5543978b8c9c23662d9e00'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:23.042992 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-82ede795-0ed4-490f-9328-ff95ac6d144e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1fa51f02ef5543978b8c9c23662d9e00'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:23.047752 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-82ede795-0ed4-490f-9328-ff95ac6d144e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1fa51f02ef5543978b8c9c23662d9e00'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:23.058072 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 933/1877] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 31 00:21:22 2022] DELETE /identity/v3/users/1fa51f02ef5543978b8c9c23662d9e00 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:21:23.065446 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8bfa5f-58d4-463a-9f24-4e8cf1ebd537 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:23.066804 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8bfa5f-58d4-463a-9f24-4e8cf1ebd537 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:23.068865 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8bfa5f-58d4-463a-9f24-4e8cf1ebd537 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:23.120052 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-da8bfa5f-58d4-463a-9f24-4e8cf1ebd537 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:21:23.121395 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-da8bfa5f-58d4-463a-9f24-4e8cf1ebd537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:23.137499 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:23.217222 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 945/1878] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:21:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:21:23.227855 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ede795-0ed4-490f-9328-ff95ac6d144e admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:23.229357 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-82ede795-0ed4-490f-9328-ff95ac6d144e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:23.298381 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ede795-0ed4-490f-9328-ff95ac6d144e admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:23.302551 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc84ba36-50ed-45ea-9c98-72f0abf3d480 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'daae792cd11d4c4ca7aae0558998aced', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:23.303411 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc84ba36-50ed-45ea-9c98-72f0abf3d480 service neutron] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:23.303694 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc84ba36-50ed-45ea-9c98-72f0abf3d480 service neutron] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:23.303973 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc84ba36-50ed-45ea-9c98-72f0abf3d480 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:23.316168 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc84ba36-50ed-45ea-9c98-72f0abf3d480 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:23.319348 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc84ba36-50ed-45ea-9c98-72f0abf3d480 service neutron] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:23.334038 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 934/1879] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:21:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:21:24.089312 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8bfa5f-58d4-463a-9f24-4e8cf1ebd537 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:24.092001 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-da8bfa5f-58d4-463a-9f24-4e8cf1ebd537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:24.141589 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8bfa5f-58d4-463a-9f24-4e8cf1ebd537 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:24.153323 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad5d3a1-837f-4854-8c56-2eabdf9b87c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:24.153937 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad5d3a1-837f-4854-8c56-2eabdf9b87c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:24.154199 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad5d3a1-837f-4854-8c56-2eabdf9b87c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:24.157544 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad5d3a1-837f-4854-8c56-2eabdf9b87c3 admin admin] PATH_INFO: `/v3/projects/8c840da065b146d8a12bd5fcce137843` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:24.159330 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad5d3a1-837f-4854-8c56-2eabdf9b87c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c840da065b146d8a12bd5fcce137843)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:24.163631 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad5d3a1-837f-4854-8c56-2eabdf9b87c3 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:24.398211 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-7ad5d3a1-837f-4854-8c56-2eabdf9b87c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c840da065b146d8a12bd5fcce137843', 'request_id': 'req-7ad5d3a1-837f-4854-8c56-2eabdf9b87c3'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:24.417903 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-7ad5d3a1-837f-4854-8c56-2eabdf9b87c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c840da065b146d8a12bd5fcce137843', 'request_id': 'req-7ad5d3a1-837f-4854-8c56-2eabdf9b87c3'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:24.446484 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-7ad5d3a1-837f-4854-8c56-2eabdf9b87c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c840da065b146d8a12bd5fcce137843', 'request_id': 'req-7ad5d3a1-837f-4854-8c56-2eabdf9b87c3'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:24.477571 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-7ad5d3a1-837f-4854-8c56-2eabdf9b87c3 admin admin] The token cache is being invalidate because project 8c840da065b146d8a12bd5fcce137843 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:21:24.478420 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-7ad5d3a1-837f-4854-8c56-2eabdf9b87c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:24.479374 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-7ad5d3a1-837f-4854-8c56-2eabdf9b87c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:24.482438 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 946/1880] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 31 00:21:24 2022] DELETE /identity/v3/projects/8c840da065b146d8a12bd5fcce137843 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:21:24.488407 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc84ba36-50ed-45ea-9c98-72f0abf3d480 service neutron] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:24.513527 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc84ba36-50ed-45ea-9c98-72f0abf3d480 service neutron] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:24.658129 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:24.711223 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00968546-0f96-4d50-9240-e36dac885254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:24.711941 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00968546-0f96-4d50-9240-e36dac885254 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:24.712327 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00968546-0f96-4d50-9240-e36dac885254 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:24.712596 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00968546-0f96-4d50-9240-e36dac885254 admin admin] PATH_INFO: `/v3/users/984d306949a04ce1949aaab5b5b30658` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:24.713948 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00968546-0f96-4d50-9240-e36dac885254 admin admin] RBAC: Authorizing `identity:delete_user(user_id=984d306949a04ce1949aaab5b5b30658)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:24.716038 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00968546-0f96-4d50-9240-e36dac885254 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:24.823169 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-00968546-0f96-4d50-9240-e36dac885254 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '984d306949a04ce1949aaab5b5b30658'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:24.840139 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-00968546-0f96-4d50-9240-e36dac885254 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '984d306949a04ce1949aaab5b5b30658'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:24.857944 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-00968546-0f96-4d50-9240-e36dac885254 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '984d306949a04ce1949aaab5b5b30658'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:24.913753 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-00968546-0f96-4d50-9240-e36dac885254 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '984d306949a04ce1949aaab5b5b30658'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:24.915577 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-00968546-0f96-4d50-9240-e36dac885254 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '984d306949a04ce1949aaab5b5b30658'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:24.946617 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 935/1881] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 31 00:21:24 2022] DELETE /identity/v3/users/984d306949a04ce1949aaab5b5b30658 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:21:26.500792 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad5d3a1-837f-4854-8c56-2eabdf9b87c3 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:26.507153 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-7ad5d3a1-837f-4854-8c56-2eabdf9b87c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:26.543795 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad5d3a1-837f-4854-8c56-2eabdf9b87c3 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:26.610485 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00968546-0f96-4d50-9240-e36dac885254 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:26.613856 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-00968546-0f96-4d50-9240-e36dac885254 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:26.706685 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67cc8dd-9a25-4583-b01b-e9cbcfc61a5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:26.707854 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67cc8dd-9a25-4583-b01b-e9cbcfc61a5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:26.708616 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67cc8dd-9a25-4583-b01b-e9cbcfc61a5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:26.709274 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67cc8dd-9a25-4583-b01b-e9cbcfc61a5c admin admin] PATH_INFO: `/v3/users/25bad6a65d4a4fe487cb74fd360b6160` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:26.711815 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67cc8dd-9a25-4583-b01b-e9cbcfc61a5c admin admin] RBAC: Authorizing `identity:delete_user(user_id=25bad6a65d4a4fe487cb74fd360b6160)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:26.715858 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67cc8dd-9a25-4583-b01b-e9cbcfc61a5c admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:26.780212 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00968546-0f96-4d50-9240-e36dac885254 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:26.789996 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413d0f6d-e475-472d-b5d3-ef776d9913b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:26.792864 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413d0f6d-e475-472d-b5d3-ef776d9913b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:26.793347 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413d0f6d-e475-472d-b5d3-ef776d9913b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:26.793867 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413d0f6d-e475-472d-b5d3-ef776d9913b2 admin admin] PATH_INFO: `/v3/projects/a1f1d3948d13457e89167104d4c19884` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:26.796516 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413d0f6d-e475-472d-b5d3-ef776d9913b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1f1d3948d13457e89167104d4c19884)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:26.801208 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413d0f6d-e475-472d-b5d3-ef776d9913b2 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:26.894416 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:26.919174 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-b67cc8dd-9a25-4583-b01b-e9cbcfc61a5c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25bad6a65d4a4fe487cb74fd360b6160'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:26.934901 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-413d0f6d-e475-472d-b5d3-ef776d9913b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1f1d3948d13457e89167104d4c19884', 'request_id': 'req-413d0f6d-e475-472d-b5d3-ef776d9913b2'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:26.950152 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-413d0f6d-e475-472d-b5d3-ef776d9913b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1f1d3948d13457e89167104d4c19884', 'request_id': 'req-413d0f6d-e475-472d-b5d3-ef776d9913b2'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:26.963807 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-413d0f6d-e475-472d-b5d3-ef776d9913b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1f1d3948d13457e89167104d4c19884', 'request_id': 'req-413d0f6d-e475-472d-b5d3-ef776d9913b2'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:26.967551 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-b67cc8dd-9a25-4583-b01b-e9cbcfc61a5c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25bad6a65d4a4fe487cb74fd360b6160'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:26.969586 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:27.025123 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-b67cc8dd-9a25-4583-b01b-e9cbcfc61a5c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25bad6a65d4a4fe487cb74fd360b6160'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:27.026066 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-b67cc8dd-9a25-4583-b01b-e9cbcfc61a5c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25bad6a65d4a4fe487cb74fd360b6160'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:27.033644 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-413d0f6d-e475-472d-b5d3-ef776d9913b2 admin admin] The token cache is being invalidate because project a1f1d3948d13457e89167104d4c19884 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81523) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:21:27.037445 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-413d0f6d-e475-472d-b5d3-ef776d9913b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:27.040685 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-413d0f6d-e475-472d-b5d3-ef776d9913b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:27.043913 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 936/1882] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 31 00:21:26 2022] DELETE /identity/v3/projects/a1f1d3948d13457e89167104d4c19884 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:21:27.050500 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413d0f6d-e475-472d-b5d3-ef776d9913b2 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:27.055288 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-413d0f6d-e475-472d-b5d3-ef776d9913b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:27.064515 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-b67cc8dd-9a25-4583-b01b-e9cbcfc61a5c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25bad6a65d4a4fe487cb74fd360b6160'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:27.078099 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 947/1883] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 31 00:21:26 2022] DELETE /identity/v3/users/25bad6a65d4a4fe487cb74fd360b6160 => generated 0 bytes in 582 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:21:27.086322 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fc1a0f-0c09-44d8-a2a2-68648a7e9ced None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:27.086827 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fc1a0f-0c09-44d8-a2a2-68648a7e9ced None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:27.087324 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fc1a0f-0c09-44d8-a2a2-68648a7e9ced None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:27.166659 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-19fc1a0f-0c09-44d8-a2a2-68648a7e9ced None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:21:27.172687 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-19fc1a0f-0c09-44d8-a2a2-68648a7e9ced None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:27.293436 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413d0f6d-e475-472d-b5d3-ef776d9913b2 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:27.380124 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 948/1884] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:21:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:21:27.400801 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fc1a0f-0c09-44d8-a2a2-68648a7e9ced None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:27.403553 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-19fc1a0f-0c09-44d8-a2a2-68648a7e9ced None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:27.509408 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a0ceff-1b03-4a28-8aec-a6b037b611cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:27.510445 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a0ceff-1b03-4a28-8aec-a6b037b611cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:27.510922 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a0ceff-1b03-4a28-8aec-a6b037b611cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:27.511380 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a0ceff-1b03-4a28-8aec-a6b037b611cd admin admin] PATH_INFO: `/v3/users/7ad767a7825547c1b13278f9c25b8fea` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:27.515035 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a0ceff-1b03-4a28-8aec-a6b037b611cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ad767a7825547c1b13278f9c25b8fea)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:27.519138 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a0ceff-1b03-4a28-8aec-a6b037b611cd admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:27.554066 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fc1a0f-0c09-44d8-a2a2-68648a7e9ced None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:27.559409 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706a18c8-4273-4ed7-9238-2447c9731484 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'daae792cd11d4c4ca7aae0558998aced', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:27.560430 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706a18c8-4273-4ed7-9238-2447c9731484 service neutron] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:27.560883 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706a18c8-4273-4ed7-9238-2447c9731484 service neutron] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:27.561286 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706a18c8-4273-4ed7-9238-2447c9731484 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:27.572889 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706a18c8-4273-4ed7-9238-2447c9731484 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:27.575316 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706a18c8-4273-4ed7-9238-2447c9731484 service neutron] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:27.594670 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 949/1885] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:21:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:21:27.627580 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-34a0ceff-1b03-4a28-8aec-a6b037b611cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ad767a7825547c1b13278f9c25b8fea'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:27.640949 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-34a0ceff-1b03-4a28-8aec-a6b037b611cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ad767a7825547c1b13278f9c25b8fea'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:27.654812 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-34a0ceff-1b03-4a28-8aec-a6b037b611cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ad767a7825547c1b13278f9c25b8fea'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:27.687696 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-34a0ceff-1b03-4a28-8aec-a6b037b611cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ad767a7825547c1b13278f9c25b8fea'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:27.688741 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-34a0ceff-1b03-4a28-8aec-a6b037b611cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ad767a7825547c1b13278f9c25b8fea'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:27.716678 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 937/1886] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 31 00:21:27 2022] DELETE /identity/v3/users/7ad767a7825547c1b13278f9c25b8fea => generated 0 bytes in 653 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:21:28.115148 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706a18c8-4273-4ed7-9238-2447c9731484 service neutron] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:28.116749 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-706a18c8-4273-4ed7-9238-2447c9731484 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:28.143170 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706a18c8-4273-4ed7-9238-2447c9731484 service neutron] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:28.281951 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6950b075-6eea-4772-b95e-09246f9cb830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:28.283379 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6950b075-6eea-4772-b95e-09246f9cb830 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:28.284097 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6950b075-6eea-4772-b95e-09246f9cb830 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:28.284843 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6950b075-6eea-4772-b95e-09246f9cb830 admin admin] PATH_INFO: `/v3/projects/88136abe2a6a46e698d222c8eb7ee661` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:28.290049 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6950b075-6eea-4772-b95e-09246f9cb830 admin admin] RBAC: Authorizing `identity:delete_project(project_id=88136abe2a6a46e698d222c8eb7ee661)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:28.295475 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6950b075-6eea-4772-b95e-09246f9cb830 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:28.301064 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:28.474814 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-6950b075-6eea-4772-b95e-09246f9cb830 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88136abe2a6a46e698d222c8eb7ee661', 'request_id': 'req-6950b075-6eea-4772-b95e-09246f9cb830'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:28.510427 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-6950b075-6eea-4772-b95e-09246f9cb830 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88136abe2a6a46e698d222c8eb7ee661', 'request_id': 'req-6950b075-6eea-4772-b95e-09246f9cb830'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:28.513773 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a0ceff-1b03-4a28-8aec-a6b037b611cd admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:28.517119 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-34a0ceff-1b03-4a28-8aec-a6b037b611cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:28.531340 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-6950b075-6eea-4772-b95e-09246f9cb830 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88136abe2a6a46e698d222c8eb7ee661', 'request_id': 'req-6950b075-6eea-4772-b95e-09246f9cb830'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:28.568817 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-6950b075-6eea-4772-b95e-09246f9cb830 admin admin] The token cache is being invalidate because project 88136abe2a6a46e698d222c8eb7ee661 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:21:28.570094 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-6950b075-6eea-4772-b95e-09246f9cb830 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:28.571137 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-6950b075-6eea-4772-b95e-09246f9cb830 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:28.576923 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 950/1887] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 31 00:21:28 2022] DELETE /identity/v3/projects/88136abe2a6a46e698d222c8eb7ee661 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:21:28.579061 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b410d33-ec8c-4188-b9dd-860923b55488 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:28.579556 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b410d33-ec8c-4188-b9dd-860923b55488 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:28.580170 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b410d33-ec8c-4188-b9dd-860923b55488 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:28.592272 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a0ceff-1b03-4a28-8aec-a6b037b611cd admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:28.605709 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-2b410d33-ec8c-4188-b9dd-860923b55488 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:21:28.607584 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-2b410d33-ec8c-4188-b9dd-860923b55488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:28.661545 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:28.724307 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 951/1888] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:21:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:21:28.734301 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7171de-ecd5-41e8-b6db-07722d4d2059 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:28.734597 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7171de-ecd5-41e8-b6db-07722d4d2059 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:28.735082 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7171de-ecd5-41e8-b6db-07722d4d2059 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:28.768929 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-1d7171de-ecd5-41e8-b6db-07722d4d2059 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:21:28.771933 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-1d7171de-ecd5-41e8-b6db-07722d4d2059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:28.787481 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 952/1889] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:21:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:21:28.794317 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7171de-ecd5-41e8-b6db-07722d4d2059 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:28.813249 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7171de-ecd5-41e8-b6db-07722d4d2059 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:28.813517 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090b5c64-9dc0-49bb-984b-89a69e16c323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:28.818862 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090b5c64-9dc0-49bb-984b-89a69e16c323 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:28.822061 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090b5c64-9dc0-49bb-984b-89a69e16c323 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:28.822370 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090b5c64-9dc0-49bb-984b-89a69e16c323 admin admin] PATH_INFO: `/v3/projects/f55f15b28e5e4d14bdcd5209cb950b09` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:28.823476 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b89306d-7f7a-4ccd-9bc6-28b62a804501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:28.824282 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090b5c64-9dc0-49bb-984b-89a69e16c323 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f55f15b28e5e4d14bdcd5209cb950b09)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:28.824493 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b89306d-7f7a-4ccd-9bc6-28b62a804501 admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:28.826225 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b89306d-7f7a-4ccd-9bc6-28b62a804501 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:28.826225 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b89306d-7f7a-4ccd-9bc6-28b62a804501 admin admin] PATH_INFO: `/v3/domains` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:28.827436 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b89306d-7f7a-4ccd-9bc6-28b62a804501 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:21:28.827910 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b89306d-7f7a-4ccd-9bc6-28b62a804501 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:28.829509 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090b5c64-9dc0-49bb-984b-89a69e16c323 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:28.830974 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b89306d-7f7a-4ccd-9bc6-28b62a804501 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:28.863408 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 953/1890] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 31 00:21:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:21:28.869751 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b89306d-7f7a-4ccd-9bc6-28b62a804501 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:28.887991 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b89306d-7f7a-4ccd-9bc6-28b62a804501 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:28.923091 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-090b5c64-9dc0-49bb-984b-89a69e16c323 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f55f15b28e5e4d14bdcd5209cb950b09', 'request_id': 'req-090b5c64-9dc0-49bb-984b-89a69e16c323'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:28.937235 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-090b5c64-9dc0-49bb-984b-89a69e16c323 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f55f15b28e5e4d14bdcd5209cb950b09', 'request_id': 'req-090b5c64-9dc0-49bb-984b-89a69e16c323'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:28.945492 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-090b5c64-9dc0-49bb-984b-89a69e16c323 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f55f15b28e5e4d14bdcd5209cb950b09', 'request_id': 'req-090b5c64-9dc0-49bb-984b-89a69e16c323'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:28.971928 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-090b5c64-9dc0-49bb-984b-89a69e16c323 admin admin] The token cache is being invalidate because project f55f15b28e5e4d14bdcd5209cb950b09 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81523) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:21:28.972685 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-090b5c64-9dc0-49bb-984b-89a69e16c323 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:28.974493 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-090b5c64-9dc0-49bb-984b-89a69e16c323 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:28.977883 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 938/1891] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 31 00:21:28 2022] DELETE /identity/v3/projects/f55f15b28e5e4d14bdcd5209cb950b09 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:21:28.986547 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b042bcd-a608-43f4-a906-3efd91e13af1 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:28.986547 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b042bcd-a608-43f4-a906-3efd91e13af1 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:28.986547 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b042bcd-a608-43f4-a906-3efd91e13af1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:29.049973 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec3cb2a-93d4-4b16-aada-376b3d0c053a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:29.052486 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec3cb2a-93d4-4b16-aada-376b3d0c053a admin admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:29.053232 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec3cb2a-93d4-4b16-aada-376b3d0c053a admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:29.053685 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec3cb2a-93d4-4b16-aada-376b3d0c053a admin admin] PATH_INFO: `/v3/projects` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:29.055615 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec3cb2a-93d4-4b16-aada-376b3d0c053a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:29.059718 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec3cb2a-93d4-4b16-aada-376b3d0c053a admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:29.065939 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-6b042bcd-a608-43f4-a906-3efd91e13af1 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:21:29.073201 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-6b042bcd-a608-43f4-a906-3efd91e13af1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:29.103718 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 939/1892] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:21:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:21:29.121419 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215e43b0-68b6-44a8-a175-5ced8cfe8a8e None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:29.122005 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215e43b0-68b6-44a8-a175-5ced8cfe8a8e None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:29.122615 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215e43b0-68b6-44a8-a175-5ced8cfe8a8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:29.170792 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:29.190923 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-215e43b0-68b6-44a8-a175-5ced8cfe8a8e None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:21:29.200818 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-215e43b0-68b6-44a8-a175-5ced8cfe8a8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:29.213501 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 954/1893] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 31 00:21:28 2022] POST /identity/v3/projects => generated 383 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:21:29.215336 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec3cb2a-93d4-4b16-aada-376b3d0c053a admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:29.219436 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-dec3cb2a-93d4-4b16-aada-376b3d0c053a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:29.403094 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 940/1894] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:21:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:21:29.411122 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215e43b0-68b6-44a8-a175-5ced8cfe8a8e None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:29.441218 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215e43b0-68b6-44a8-a175-5ced8cfe8a8e None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:29.475693 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e610b5-a9ad-41d8-a6a8-08049979d3df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:29.477644 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e610b5-a9ad-41d8-a6a8-08049979d3df admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:29.478054 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e610b5-a9ad-41d8-a6a8-08049979d3df admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:29.479940 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e610b5-a9ad-41d8-a6a8-08049979d3df admin admin] PATH_INFO: `/v3/domains` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:29.483544 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e610b5-a9ad-41d8-a6a8-08049979d3df admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:21:29.484659 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e610b5-a9ad-41d8-a6a8-08049979d3df admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:29.488610 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e610b5-a9ad-41d8-a6a8-08049979d3df admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:29.535326 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 941/1895] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 31 00:21:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:21:29.543040 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e610b5-a9ad-41d8-a6a8-08049979d3df admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:29.586399 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec3cb2a-93d4-4b16-aada-376b3d0c053a admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:29.586891 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e610b5-a9ad-41d8-a6a8-08049979d3df admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:29.616729 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57720abb-1613-4344-b74c-da8a4c0670f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:29.616964 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6d2c98-8ba8-4ce3-87f4-0214747bb229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:29.617109 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57720abb-1613-4344-b74c-da8a4c0670f5 admin admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:29.617109 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57720abb-1613-4344-b74c-da8a4c0670f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:29.617273 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6d2c98-8ba8-4ce3-87f4-0214747bb229 admin admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:29.617364 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6d2c98-8ba8-4ce3-87f4-0214747bb229 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:29.617612 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6d2c98-8ba8-4ce3-87f4-0214747bb229 admin admin] PATH_INFO: `/v3/users` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:29.622412 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6d2c98-8ba8-4ce3-87f4-0214747bb229 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:29.622412 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6d2c98-8ba8-4ce3-87f4-0214747bb229 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:29.636554 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57720abb-1613-4344-b74c-da8a4c0670f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:29.637493 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57720abb-1613-4344-b74c-da8a4c0670f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:29.646833 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57720abb-1613-4344-b74c-da8a4c0670f5 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:29.673913 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 955/1896] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 31 00:21:29 2022] POST /identity/v3/users => generated 292 bytes in 457 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:21:29.675178 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6d2c98-8ba8-4ce3-87f4-0214747bb229 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:29.698636 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6d2c98-8ba8-4ce3-87f4-0214747bb229 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:29.713390 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0629e220-180d-4a58-8ff2-d0f87b64c17b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:29.715248 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0629e220-180d-4a58-8ff2-d0f87b64c17b admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:29.716051 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0629e220-180d-4a58-8ff2-d0f87b64c17b admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:29.716627 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0629e220-180d-4a58-8ff2-d0f87b64c17b admin admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:29.717999 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0629e220-180d-4a58-8ff2-d0f87b64c17b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:29.732001 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0629e220-180d-4a58-8ff2-d0f87b64c17b admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:29.740691 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 942/1897] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 31 00:21:29 2022] POST /identity/v3/projects => generated 377 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:21:29.747184 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57720abb-1613-4344-b74c-da8a4c0670f5 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:29.768555 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 956/1898] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 00:21:29 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:21:29.771745 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:29.773636 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0629e220-180d-4a58-8ff2-d0f87b64c17b admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:29.793995 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0629e220-180d-4a58-8ff2-d0f87b64c17b admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:29.877182 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57720abb-1613-4344-b74c-da8a4c0670f5 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:29.884676 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedb4aa9-e6cb-47c4-ba47-29c6eb276797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:29.885491 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedb4aa9-e6cb-47c4-ba47-29c6eb276797 admin admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:29.885897 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedb4aa9-e6cb-47c4-ba47-29c6eb276797 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:29.886276 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedb4aa9-e6cb-47c4-ba47-29c6eb276797 admin admin] PATH_INFO: `/v3/users` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:29.887156 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedb4aa9-e6cb-47c4-ba47-29c6eb276797 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:29.889952 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedb4aa9-e6cb-47c4-ba47-29c6eb276797 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:29.929638 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 943/1899] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 31 00:21:29 2022] POST /identity/v3/users => generated 289 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:21:29.939586 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedb4aa9-e6cb-47c4-ba47-29c6eb276797 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:29.979683 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedb4aa9-e6cb-47c4-ba47-29c6eb276797 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:29.999232 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d463c730-cec4-4bb3-879e-12c6789b7585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:29.999875 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d463c730-cec4-4bb3-879e-12c6789b7585 admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:30.000190 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d463c730-cec4-4bb3-879e-12c6789b7585 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:30.000476 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d463c730-cec4-4bb3-879e-12c6789b7585 admin admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:30.001939 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d463c730-cec4-4bb3-879e-12c6789b7585 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:30.004134 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d463c730-cec4-4bb3-879e-12c6789b7585 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:30.016375 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7714ffa-cde0-4864-a8fc-118fe6d75f13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:30.018199 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7714ffa-cde0-4864-a8fc-118fe6d75f13 admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:30.018905 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7714ffa-cde0-4864-a8fc-118fe6d75f13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:30.019621 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7714ffa-cde0-4864-a8fc-118fe6d75f13 admin admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:30.021691 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7714ffa-cde0-4864-a8fc-118fe6d75f13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:30.026727 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 944/1900] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 00:21:29 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 00:21:30.026915 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7714ffa-cde0-4864-a8fc-118fe6d75f13 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:30.028301 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d463c730-cec4-4bb3-879e-12c6789b7585 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:30.041367 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 957/1901] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 00:21:29 2022] GET /identity/v3/roles => generated 1420 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:21:30.045409 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d463c730-cec4-4bb3-879e-12c6789b7585 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:30.047060 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7714ffa-cde0-4864-a8fc-118fe6d75f13 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:30.063614 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7714ffa-cde0-4864-a8fc-118fe6d75f13 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:30.064822 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60ad13b-af0e-49b3-aecf-cd075858a622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:30.065464 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60ad13b-af0e-49b3-aecf-cd075858a622 admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:30.065750 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60ad13b-af0e-49b3-aecf-cd075858a622 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:30.066025 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60ad13b-af0e-49b3-aecf-cd075858a622 admin admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:30.066689 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60ad13b-af0e-49b3-aecf-cd075858a622 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:30.069217 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60ad13b-af0e-49b3-aecf-cd075858a622 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:30.080017 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86a2171-de98-4dda-bd38-c13fef2e0129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:30.081519 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86a2171-de98-4dda-bd38-c13fef2e0129 admin admin] REQUEST_METHOD: `PUT` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:30.082276 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86a2171-de98-4dda-bd38-c13fef2e0129 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:30.088406 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 945/1902] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 00:21:30 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 00:21:30.088616 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86a2171-de98-4dda-bd38-c13fef2e0129 admin admin] PATH_INFO: `/v3/projects/81900b31e0b84e32ae8fe17707fe7e6c/users/bbeedad8f7554fdf9f087b507267d6ba/roles/fdad79ffbcbb4fa380dc9cf7dd108618` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:30.089588 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60ad13b-af0e-49b3-aecf-cd075858a622 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:30.105710 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86a2171-de98-4dda-bd38-c13fef2e0129 admin admin] RBAC: Authorizing `identity:create_grant(project_id=81900b31e0b84e32ae8fe17707fe7e6c, user_id=bbeedad8f7554fdf9f087b507267d6ba, role_id=fdad79ffbcbb4fa380dc9cf7dd108618)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:30.111658 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86a2171-de98-4dda-bd38-c13fef2e0129 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:30.120984 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60ad13b-af0e-49b3-aecf-cd075858a622 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:30.129424 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 958/1903] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 00:21:30 2022] PUT /identity/v3/projects/81900b31e0b84e32ae8fe17707fe7e6c/users/bbeedad8f7554fdf9f087b507267d6ba/roles/fdad79ffbcbb4fa380dc9cf7dd108618 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:21:30.141667 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f79e947-f3f8-4673-a897-afcf3dc4af4d None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:30.142082 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f79e947-f3f8-4673-a897-afcf3dc4af4d None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:30.142422 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f79e947-f3f8-4673-a897-afcf3dc4af4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:30.194722 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-7f79e947-f3f8-4673-a897-afcf3dc4af4d None None] MFA Rules not processed for user `bbeedad8f7554fdf9f087b507267d6ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:21:30.196013 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-7f79e947-f3f8-4673-a897-afcf3dc4af4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:30.251811 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:30.283466 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4388fe5e-8d7c-48cc-9cef-ee5f0e72d745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:30.285181 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4388fe5e-8d7c-48cc-9cef-ee5f0e72d745 admin admin] REQUEST_METHOD: `PUT` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:30.285473 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4388fe5e-8d7c-48cc-9cef-ee5f0e72d745 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:30.286590 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4388fe5e-8d7c-48cc-9cef-ee5f0e72d745 admin admin] PATH_INFO: `/v3/projects/1cd21ff17c50462e8ed17cddcd7db8f2/users/bbd6c24d57884c1a96aa7e31f9c6b12d/roles/fdad79ffbcbb4fa380dc9cf7dd108618` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:30.309093 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4388fe5e-8d7c-48cc-9cef-ee5f0e72d745 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1cd21ff17c50462e8ed17cddcd7db8f2, user_id=bbd6c24d57884c1a96aa7e31f9c6b12d, role_id=fdad79ffbcbb4fa380dc9cf7dd108618)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:30.312082 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4388fe5e-8d7c-48cc-9cef-ee5f0e72d745 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:30.323431 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 959/1904] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:21:30 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:21:30.330378 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f79e947-f3f8-4673-a897-afcf3dc4af4d None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:30.352612 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 946/1905] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 00:21:30 2022] PUT /identity/v3/projects/1cd21ff17c50462e8ed17cddcd7db8f2/users/bbd6c24d57884c1a96aa7e31f9c6b12d/roles/fdad79ffbcbb4fa380dc9cf7dd108618 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:21:30.365601 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f79e947-f3f8-4673-a897-afcf3dc4af4d None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:30.372505 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fb935f-f37a-432f-a513-400680baa9de None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:30.372922 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fb935f-f37a-432f-a513-400680baa9de None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:30.373211 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fb935f-f37a-432f-a513-400680baa9de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:30.440532 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-38fb935f-f37a-432f-a513-400680baa9de None None] MFA Rules not processed for user `bbd6c24d57884c1a96aa7e31f9c6b12d`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:21:30.443443 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-38fb935f-f37a-432f-a513-400680baa9de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:30.471275 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58960d6-fb6b-45bb-9517-9d876e19580e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:30.471855 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58960d6-fb6b-45bb-9517-9d876e19580e admin admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:30.472661 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58960d6-fb6b-45bb-9517-9d876e19580e admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:30.473201 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58960d6-fb6b-45bb-9517-9d876e19580e admin admin] PATH_INFO: `/v3/projects` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:30.474283 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58960d6-fb6b-45bb-9517-9d876e19580e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:30.476567 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58960d6-fb6b-45bb-9517-9d876e19580e admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:30.529543 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 960/1906] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 31 00:21:30 2022] POST /identity/v3/projects => generated 385 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:21:30.534640 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58960d6-fb6b-45bb-9517-9d876e19580e admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:30.561996 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:30.603933 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 947/1907] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:21:30 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:21:30.608779 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fb935f-f37a-432f-a513-400680baa9de None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:30.631609 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fb935f-f37a-432f-a513-400680baa9de None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:30.637067 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58960d6-fb6b-45bb-9517-9d876e19580e admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:30.643860 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d1d4d1-33e0-471b-9a20-041e5099dba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:30.645238 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d1d4d1-33e0-471b-9a20-041e5099dba1 admin admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:30.645238 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d1d4d1-33e0-471b-9a20-041e5099dba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:30.645712 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d1d4d1-33e0-471b-9a20-041e5099dba1 admin admin] PATH_INFO: `/v3/users` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:30.647178 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d1d4d1-33e0-471b-9a20-041e5099dba1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:30.649494 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d1d4d1-33e0-471b-9a20-041e5099dba1 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:30.655921 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072df338-d16b-4326-b01a-dd8ee4ca14cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:30.656537 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072df338-d16b-4326-b01a-dd8ee4ca14cf admin admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:30.656818 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072df338-d16b-4326-b01a-dd8ee4ca14cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:30.657112 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072df338-d16b-4326-b01a-dd8ee4ca14cf admin admin] PATH_INFO: `/v3/projects` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:30.657784 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072df338-d16b-4326-b01a-dd8ee4ca14cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:30.659842 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072df338-d16b-4326-b01a-dd8ee4ca14cf admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:30.716288 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 961/1908] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 31 00:21:30 2022] POST /identity/v3/users => generated 293 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:21:30.720845 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d1d4d1-33e0-471b-9a20-041e5099dba1 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:30.753670 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 948/1909] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 31 00:21:30 2022] POST /identity/v3/projects => generated 377 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:21:30.755455 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d1d4d1-33e0-471b-9a20-041e5099dba1 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:30.758114 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072df338-d16b-4326-b01a-dd8ee4ca14cf admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:30.889099 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:30.917648 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320ab9a6-4c11-4cb0-a8dd-500dc3469ad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:30.918419 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320ab9a6-4c11-4cb0-a8dd-500dc3469ad1 admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:30.918733 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320ab9a6-4c11-4cb0-a8dd-500dc3469ad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:30.919025 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320ab9a6-4c11-4cb0-a8dd-500dc3469ad1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:30.920617 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320ab9a6-4c11-4cb0-a8dd-500dc3469ad1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:30.923886 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320ab9a6-4c11-4cb0-a8dd-500dc3469ad1 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:30.933564 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072df338-d16b-4326-b01a-dd8ee4ca14cf admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:30.939201 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 962/1910] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 00:21:30 2022] GET /identity/v3/roles => generated 1420 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:21:30.939451 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed46da4-289d-450e-b4b7-59626e752fe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:30.939977 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed46da4-289d-450e-b4b7-59626e752fe7 admin admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:30.940318 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed46da4-289d-450e-b4b7-59626e752fe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:30.940590 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed46da4-289d-450e-b4b7-59626e752fe7 admin admin] PATH_INFO: `/v3/users` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:30.941241 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed46da4-289d-450e-b4b7-59626e752fe7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:30.943807 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed46da4-289d-450e-b4b7-59626e752fe7 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:30.949392 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320ab9a6-4c11-4cb0-a8dd-500dc3469ad1 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:30.971154 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320ab9a6-4c11-4cb0-a8dd-500dc3469ad1 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:30.980205 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 949/1911] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 31 00:21:30 2022] POST /identity/v3/users => generated 289 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:21:30.982445 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed46da4-289d-450e-b4b7-59626e752fe7 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:30.983022 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c1dcae-37e0-4021-81f0-4a0853b971ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:30.984305 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c1dcae-37e0-4021-81f0-4a0853b971ac admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:30.984781 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c1dcae-37e0-4021-81f0-4a0853b971ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:30.985265 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c1dcae-37e0-4021-81f0-4a0853b971ac admin admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:30.987023 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c1dcae-37e0-4021-81f0-4a0853b971ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:30.990983 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c1dcae-37e0-4021-81f0-4a0853b971ac admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:31.010037 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed46da4-289d-450e-b4b7-59626e752fe7 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:31.016289 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 963/1912] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 00:21:30 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:21:31.016967 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a93f0c5-f6a0-475e-9eac-a7e95f074e09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:31.016967 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a93f0c5-f6a0-475e-9eac-a7e95f074e09 admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:31.016967 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a93f0c5-f6a0-475e-9eac-a7e95f074e09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:31.016967 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a93f0c5-f6a0-475e-9eac-a7e95f074e09 admin admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:31.017479 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a93f0c5-f6a0-475e-9eac-a7e95f074e09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:31.018945 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a93f0c5-f6a0-475e-9eac-a7e95f074e09 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:31.019124 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c1dcae-37e0-4021-81f0-4a0853b971ac admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:31.031620 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c1dcae-37e0-4021-81f0-4a0853b971ac admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:31.037359 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de851840-4c90-4f04-923e-ee2ac615b849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:31.038139 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de851840-4c90-4f04-923e-ee2ac615b849 admin admin] REQUEST_METHOD: `PUT` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:31.038487 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de851840-4c90-4f04-923e-ee2ac615b849 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:31.038830 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de851840-4c90-4f04-923e-ee2ac615b849 admin admin] PATH_INFO: `/v3/projects/1b69414823604671be2d3afad0f2b343/users/ba65a1db9cc44bcc920cf92bde03e295/roles/fdad79ffbcbb4fa380dc9cf7dd108618` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:31.041003 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 950/1913] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 00:21:30 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:21:31.045757 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a93f0c5-f6a0-475e-9eac-a7e95f074e09 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:31.061170 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de851840-4c90-4f04-923e-ee2ac615b849 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b69414823604671be2d3afad0f2b343, user_id=ba65a1db9cc44bcc920cf92bde03e295, role_id=fdad79ffbcbb4fa380dc9cf7dd108618)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:31.064573 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de851840-4c90-4f04-923e-ee2ac615b849 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:31.064897 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a93f0c5-f6a0-475e-9eac-a7e95f074e09 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:31.075361 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0553090e-7056-4f0a-bc91-214559d9c836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:31.076446 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0553090e-7056-4f0a-bc91-214559d9c836 admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:31.076924 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0553090e-7056-4f0a-bc91-214559d9c836 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:31.077425 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0553090e-7056-4f0a-bc91-214559d9c836 admin admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:31.078589 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0553090e-7056-4f0a-bc91-214559d9c836 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:31.081763 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0553090e-7056-4f0a-bc91-214559d9c836 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:31.090279 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 964/1914] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 00:21:31 2022] PUT /identity/v3/projects/1b69414823604671be2d3afad0f2b343/users/ba65a1db9cc44bcc920cf92bde03e295/roles/fdad79ffbcbb4fa380dc9cf7dd108618 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:21:31.102567 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a543ab21-6e93-4241-8673-c945ff9349ce None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:31.102567 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a543ab21-6e93-4241-8673-c945ff9349ce None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:31.102567 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a543ab21-6e93-4241-8673-c945ff9349ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:31.112203 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 951/1915] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 00:21:31 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 00:21:31.113927 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0553090e-7056-4f0a-bc91-214559d9c836 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:31.125307 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0553090e-7056-4f0a-bc91-214559d9c836 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:31.156518 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-a543ab21-6e93-4241-8673-c945ff9349ce None None] MFA Rules not processed for user `ba65a1db9cc44bcc920cf92bde03e295`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:21:31.158547 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-a543ab21-6e93-4241-8673-c945ff9349ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:31.213554 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15152969-4945-4eda-9e5d-3b5c8b3ff201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:31.214699 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15152969-4945-4eda-9e5d-3b5c8b3ff201 admin admin] REQUEST_METHOD: `PUT` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:31.215170 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15152969-4945-4eda-9e5d-3b5c8b3ff201 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:31.215643 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15152969-4945-4eda-9e5d-3b5c8b3ff201 admin admin] PATH_INFO: `/v3/projects/3b65ad5fb4164393a79003075b86479e/users/914d0f3261404aef85765bce4624d7bb/roles/fdad79ffbcbb4fa380dc9cf7dd108618` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:31.245550 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15152969-4945-4eda-9e5d-3b5c8b3ff201 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b65ad5fb4164393a79003075b86479e, user_id=914d0f3261404aef85765bce4624d7bb, role_id=fdad79ffbcbb4fa380dc9cf7dd108618)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:31.251980 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15152969-4945-4eda-9e5d-3b5c8b3ff201 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:31.282599 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 965/1916] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:21:31 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:21:31.286681 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 952/1917] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 00:21:31 2022] PUT /identity/v3/projects/3b65ad5fb4164393a79003075b86479e/users/914d0f3261404aef85765bce4624d7bb/roles/fdad79ffbcbb4fa380dc9cf7dd108618 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:21:31.297471 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a543ab21-6e93-4241-8673-c945ff9349ce None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:31.300365 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a547b0-ce51-469a-b472-151d7ec3d9dd None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:31.301975 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a547b0-ce51-469a-b472-151d7ec3d9dd None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:31.303289 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a547b0-ce51-469a-b472-151d7ec3d9dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:31.312324 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a543ab21-6e93-4241-8673-c945ff9349ce None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:31.376571 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-14a547b0-ce51-469a-b472-151d7ec3d9dd None None] MFA Rules not processed for user `914d0f3261404aef85765bce4624d7bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:21:31.379058 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-14a547b0-ce51-469a-b472-151d7ec3d9dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:31.390959 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:31.407108 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c891dc5-6372-4376-be6d-cd3d2e274177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:31.407887 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c891dc5-6372-4376-be6d-cd3d2e274177 admin admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:31.408265 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c891dc5-6372-4376-be6d-cd3d2e274177 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:31.409734 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c891dc5-6372-4376-be6d-cd3d2e274177 admin admin] PATH_INFO: `/v3/projects` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:31.410066 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c891dc5-6372-4376-be6d-cd3d2e274177 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:31.414483 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c891dc5-6372-4376-be6d-cd3d2e274177 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:31.525458 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 966/1918] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 31 00:21:31 2022] POST /identity/v3/projects => generated 383 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:21:31.527901 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c891dc5-6372-4376-be6d-cd3d2e274177 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:31.602695 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:31.605950 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 953/1919] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:21:31 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:21:31.613423 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a547b0-ce51-469a-b472-151d7ec3d9dd None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:31.647347 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a547b0-ce51-469a-b472-151d7ec3d9dd None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:31.680623 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c891dc5-6372-4376-be6d-cd3d2e274177 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:31.692806 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4b8ba4-b3b4-46f4-b2e6-35d82d085ad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:31.693442 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4b8ba4-b3b4-46f4-b2e6-35d82d085ad5 admin admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:31.694016 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4b8ba4-b3b4-46f4-b2e6-35d82d085ad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:31.694200 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4b8ba4-b3b4-46f4-b2e6-35d82d085ad5 admin admin] PATH_INFO: `/v3/users` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:31.694803 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4b8ba4-b3b4-46f4-b2e6-35d82d085ad5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:31.696864 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4b8ba4-b3b4-46f4-b2e6-35d82d085ad5 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:31.726558 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 967/1920] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 31 00:21:31 2022] POST /identity/v3/users => generated 298 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:21:31.731629 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4b8ba4-b3b4-46f4-b2e6-35d82d085ad5 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:31.742534 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03994908-a801-447a-8b58-1e4b1f2ae01f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:31.743270 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03994908-a801-447a-8b58-1e4b1f2ae01f admin admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:31.743607 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03994908-a801-447a-8b58-1e4b1f2ae01f admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:31.743965 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03994908-a801-447a-8b58-1e4b1f2ae01f admin admin] PATH_INFO: `/v3/projects` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:31.744907 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03994908-a801-447a-8b58-1e4b1f2ae01f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:31.745732 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4b8ba4-b3b4-46f4-b2e6-35d82d085ad5 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:31.747793 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03994908-a801-447a-8b58-1e4b1f2ae01f admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:31.753742 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c06d91-8681-4946-8d2a-c020f4113852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:31.754714 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c06d91-8681-4946-8d2a-c020f4113852 admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:31.755238 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c06d91-8681-4946-8d2a-c020f4113852 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:31.755688 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c06d91-8681-4946-8d2a-c020f4113852 admin admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:31.756811 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c06d91-8681-4946-8d2a-c020f4113852 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:31.759047 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c06d91-8681-4946-8d2a-c020f4113852 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:31.774536 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 968/1921] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 00:21:31 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:21:31.782340 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c06d91-8681-4946-8d2a-c020f4113852 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:31.795741 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c06d91-8681-4946-8d2a-c020f4113852 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:31.803791 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09e0a65-fb2d-4372-9b92-be948baecf03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:31.804721 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09e0a65-fb2d-4372-9b92-be948baecf03 admin admin] REQUEST_METHOD: `PUT` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:31.805062 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09e0a65-fb2d-4372-9b92-be948baecf03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:31.805474 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09e0a65-fb2d-4372-9b92-be948baecf03 admin admin] PATH_INFO: `/v3/projects/0425eff2e2234b8180870054a63a1413/users/8bc92050c8e24c5a9ea8e128d70ed61a/roles/12f6817f9aaa4e2bb477095a6bed5d0f` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:31.806033 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 954/1922] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 31 00:21:31 2022] POST /identity/v3/projects => generated 377 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:21:31.811380 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03994908-a801-447a-8b58-1e4b1f2ae01f admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:31.840744 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09e0a65-fb2d-4372-9b92-be948baecf03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0425eff2e2234b8180870054a63a1413, user_id=8bc92050c8e24c5a9ea8e128d70ed61a, role_id=12f6817f9aaa4e2bb477095a6bed5d0f)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:31.846560 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09e0a65-fb2d-4372-9b92-be948baecf03 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:31.892125 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 969/1923] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 00:21:31 2022] PUT /identity/v3/projects/0425eff2e2234b8180870054a63a1413/users/8bc92050c8e24c5a9ea8e128d70ed61a/roles/12f6817f9aaa4e2bb477095a6bed5d0f => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:21:31.898509 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09e0a65-fb2d-4372-9b92-be948baecf03 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:31.942553 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03994908-a801-447a-8b58-1e4b1f2ae01f admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:32.022824 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:32.035577 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09e0a65-fb2d-4372-9b92-be948baecf03 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:32.043900 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c80060-7bca-4cfe-bbf3-2b01fdef1d60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:32.044576 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c80060-7bca-4cfe-bbf3-2b01fdef1d60 admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:32.044862 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c80060-7bca-4cfe-bbf3-2b01fdef1d60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:32.045135 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c80060-7bca-4cfe-bbf3-2b01fdef1d60 admin admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:32.045815 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c80060-7bca-4cfe-bbf3-2b01fdef1d60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:32.047505 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c80060-7bca-4cfe-bbf3-2b01fdef1d60 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:32.057498 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97f8ba8-8690-4f40-be4c-0217fbc0055d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:32.058129 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97f8ba8-8690-4f40-be4c-0217fbc0055d admin admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:32.058725 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97f8ba8-8690-4f40-be4c-0217fbc0055d admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:32.059004 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97f8ba8-8690-4f40-be4c-0217fbc0055d admin admin] PATH_INFO: `/v3/users` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:32.059656 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97f8ba8-8690-4f40-be4c-0217fbc0055d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:32.063997 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 970/1924] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 00:21:31 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 00:21:32.064211 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97f8ba8-8690-4f40-be4c-0217fbc0055d admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:32.066015 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c80060-7bca-4cfe-bbf3-2b01fdef1d60 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:32.077561 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c80060-7bca-4cfe-bbf3-2b01fdef1d60 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:32.084251 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5445e7-bcf5-40f1-83a1-9d11485ca4a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:32.085063 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5445e7-bcf5-40f1-83a1-9d11485ca4a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:32.085421 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5445e7-bcf5-40f1-83a1-9d11485ca4a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:32.085743 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5445e7-bcf5-40f1-83a1-9d11485ca4a0 admin admin] PATH_INFO: `/v3/projects/0425eff2e2234b8180870054a63a1413/users/8bc92050c8e24c5a9ea8e128d70ed61a/roles/12f6817f9aaa4e2bb477095a6bed5d0f` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:32.088210 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5445e7-bcf5-40f1-83a1-9d11485ca4a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0425eff2e2234b8180870054a63a1413, user_id=8bc92050c8e24c5a9ea8e128d70ed61a, role_id=12f6817f9aaa4e2bb477095a6bed5d0f)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:32.091256 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5445e7-bcf5-40f1-83a1-9d11485ca4a0 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:32.092123 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 955/1925] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 31 00:21:31 2022] POST /identity/v3/users => generated 295 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:21:32.098546 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97f8ba8-8690-4f40-be4c-0217fbc0055d admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:32.107928 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 971/1926] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 00:21:32 2022] PUT /identity/v3/projects/0425eff2e2234b8180870054a63a1413/users/8bc92050c8e24c5a9ea8e128d70ed61a/roles/12f6817f9aaa4e2bb477095a6bed5d0f => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:21:32.111490 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97f8ba8-8690-4f40-be4c-0217fbc0055d admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:32.119878 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825d46c8-55b8-4abf-a0a8-e92dff4fc92f None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:32.120457 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825d46c8-55b8-4abf-a0a8-e92dff4fc92f None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:32.120764 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825d46c8-55b8-4abf-a0a8-e92dff4fc92f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:32.157990 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-825d46c8-55b8-4abf-a0a8-e92dff4fc92f None None] MFA Rules not processed for user `8bc92050c8e24c5a9ea8e128d70ed61a`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:21:32.159659 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-825d46c8-55b8-4abf-a0a8-e92dff4fc92f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:32.201516 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d81897-cf76-456c-bf42-db3c43340895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:32.202132 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d81897-cf76-456c-bf42-db3c43340895 admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:32.202478 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d81897-cf76-456c-bf42-db3c43340895 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:32.202862 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d81897-cf76-456c-bf42-db3c43340895 admin admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:32.203626 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d81897-cf76-456c-bf42-db3c43340895 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:32.205532 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d81897-cf76-456c-bf42-db3c43340895 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:32.221969 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 956/1927] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 00:21:32 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:21:32.227688 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d81897-cf76-456c-bf42-db3c43340895 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:32.230863 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:32.245372 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d81897-cf76-456c-bf42-db3c43340895 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:32.252358 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d1d8e9-b2d5-40cf-8ddb-794d0da8c17f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:32.253108 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d1d8e9-b2d5-40cf-8ddb-794d0da8c17f admin admin] REQUEST_METHOD: `PUT` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:32.253470 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d1d8e9-b2d5-40cf-8ddb-794d0da8c17f admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:32.254102 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d1d8e9-b2d5-40cf-8ddb-794d0da8c17f admin admin] PATH_INFO: `/v3/projects/d8a89b2e8508444489fe0d0ad1036fbb/users/02c245290c1f41369e246460f67d7c00/roles/12f6817f9aaa4e2bb477095a6bed5d0f` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:32.276414 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 972/1928] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:21:32 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:21:32.277603 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d1d8e9-b2d5-40cf-8ddb-794d0da8c17f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8a89b2e8508444489fe0d0ad1036fbb, user_id=02c245290c1f41369e246460f67d7c00, role_id=12f6817f9aaa4e2bb477095a6bed5d0f)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:32.283258 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d1d8e9-b2d5-40cf-8ddb-794d0da8c17f admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:32.294445 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825d46c8-55b8-4abf-a0a8-e92dff4fc92f None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:32.296714 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-825d46c8-55b8-4abf-a0a8-e92dff4fc92f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:32.303081 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 957/1929] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 00:21:32 2022] PUT /identity/v3/projects/d8a89b2e8508444489fe0d0ad1036fbb/users/02c245290c1f41369e246460f67d7c00/roles/12f6817f9aaa4e2bb477095a6bed5d0f => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:21:32.307863 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d1d8e9-b2d5-40cf-8ddb-794d0da8c17f admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:32.390197 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d1d8e9-b2d5-40cf-8ddb-794d0da8c17f admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:32.392498 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825d46c8-55b8-4abf-a0a8-e92dff4fc92f None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:32.397149 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2a3cfa-d738-46cc-98a1-b6cf1b367eab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:32.398308 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2a3cfa-d738-46cc-98a1-b6cf1b367eab admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:32.398873 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2a3cfa-d738-46cc-98a1-b6cf1b367eab admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:32.399435 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2a3cfa-d738-46cc-98a1-b6cf1b367eab admin admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:32.400968 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2a3cfa-d738-46cc-98a1-b6cf1b367eab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:32.403884 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2a3cfa-d738-46cc-98a1-b6cf1b367eab admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:32.417864 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 958/1930] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 00:21:32 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:21:32.422582 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2a3cfa-d738-46cc-98a1-b6cf1b367eab admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:32.432895 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2a3cfa-d738-46cc-98a1-b6cf1b367eab admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:32.437802 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9540213-7f17-4f6d-84ef-025a520e83a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:32.438495 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9540213-7f17-4f6d-84ef-025a520e83a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:32.438774 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9540213-7f17-4f6d-84ef-025a520e83a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:32.439038 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9540213-7f17-4f6d-84ef-025a520e83a6 admin admin] PATH_INFO: `/v3/projects/d8a89b2e8508444489fe0d0ad1036fbb/users/02c245290c1f41369e246460f67d7c00/roles/12f6817f9aaa4e2bb477095a6bed5d0f` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:32.441135 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9540213-7f17-4f6d-84ef-025a520e83a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8a89b2e8508444489fe0d0ad1036fbb, user_id=02c245290c1f41369e246460f67d7c00, role_id=12f6817f9aaa4e2bb477095a6bed5d0f)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:32.444505 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9540213-7f17-4f6d-84ef-025a520e83a6 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:32.458182 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 959/1931] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 00:21:32 2022] PUT /identity/v3/projects/d8a89b2e8508444489fe0d0ad1036fbb/users/02c245290c1f41369e246460f67d7c00/roles/12f6817f9aaa4e2bb477095a6bed5d0f => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:21:32.470062 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a0969e-a338-4ad6-ae2f-196ce124b80f None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:32.470322 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a0969e-a338-4ad6-ae2f-196ce124b80f None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:32.470609 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a0969e-a338-4ad6-ae2f-196ce124b80f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:32.489544 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5b8308-1e0f-4867-9816-e8a6b65990bb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beecda6e9feb400288618745c784989f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:32.490703 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5b8308-1e0f-4867-9816-e8a6b65990bb service cinder] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:32.491199 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5b8308-1e0f-4867-9816-e8a6b65990bb service cinder] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:32.491697 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5b8308-1e0f-4867-9816-e8a6b65990bb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:32.507649 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-f0a0969e-a338-4ad6-ae2f-196ce124b80f None None] MFA Rules not processed for user `02c245290c1f41369e246460f67d7c00`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:21:32.508971 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-f0a0969e-a338-4ad6-ae2f-196ce124b80f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:32.523673 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:32.592855 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5b8308-1e0f-4867-9816-e8a6b65990bb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:32.595853 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5b8308-1e0f-4867-9816-e8a6b65990bb service cinder] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:32.617362 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 973/1932] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:21:32 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 00:21:32.633333 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 960/1933] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:21:32 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:21:32.652850 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5b8308-1e0f-4867-9816-e8a6b65990bb service cinder] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:32.655374 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-3b5b8308-1e0f-4867-9816-e8a6b65990bb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:32.670552 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5b8308-1e0f-4867-9816-e8a6b65990bb service cinder] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:32.763608 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c048c214-6970-4942-b6bf-efa86a846bf2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beecda6e9feb400288618745c784989f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:32.764581 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c048c214-6970-4942-b6bf-efa86a846bf2 service cinder] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:32.764782 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c048c214-6970-4942-b6bf-efa86a846bf2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:32.765982 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c048c214-6970-4942-b6bf-efa86a846bf2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:32.791463 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:32.878229 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c048c214-6970-4942-b6bf-efa86a846bf2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:32.879933 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c048c214-6970-4942-b6bf-efa86a846bf2 service cinder] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:32.891756 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 974/1934] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:21:32 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:21:34.675222 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a0969e-a338-4ad6-ae2f-196ce124b80f None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:34.699910 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a0969e-a338-4ad6-ae2f-196ce124b80f None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:34.710171 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd254f75-b9d4-42c9-8382-5ae310fd8d63 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beecda6e9feb400288618745c784989f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:34.711348 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd254f75-b9d4-42c9-8382-5ae310fd8d63 service cinder] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:34.712689 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd254f75-b9d4-42c9-8382-5ae310fd8d63 service cinder] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:34.713283 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd254f75-b9d4-42c9-8382-5ae310fd8d63 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:34.852038 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd254f75-b9d4-42c9-8382-5ae310fd8d63 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:34.853951 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd254f75-b9d4-42c9-8382-5ae310fd8d63 service cinder] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:34.873849 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 961/1935] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:21:34 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:21:34.950345 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737ca51f-e798-474c-810a-4e1e49370f8e None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:34.951193 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737ca51f-e798-474c-810a-4e1e49370f8e None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:34.951751 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737ca51f-e798-474c-810a-4e1e49370f8e None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:34.955260 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 975/1936] 10.222.0.47 () {54 vars in 921 bytes} [Wed Aug 31 00:21:34 2022] GET /identity => generated 270 bytes in 18 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:21:35.003197 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785d39de-c661-498a-ae93-5dd52aca737d None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:35.005407 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785d39de-c661-498a-ae93-5dd52aca737d None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:35.005407 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785d39de-c661-498a-ae93-5dd52aca737d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:35.024194 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737ca51f-e798-474c-810a-4e1e49370f8e None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:35.055246 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-785d39de-c661-498a-ae93-5dd52aca737d None None] MFA Rules not processed for user `8f76e01e32264ff7a6a7740ffa0a207d`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:21:35.060658 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-785d39de-c661-498a-ae93-5dd52aca737d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:35.064795 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737ca51f-e798-474c-810a-4e1e49370f8e None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:35.077397 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b3f20d-84b9-40af-a4d9-ffeaf70ecda8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beecda6e9feb400288618745c784989f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:35.079309 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b3f20d-84b9-40af-a4d9-ffeaf70ecda8 service cinder] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:35.079564 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b3f20d-84b9-40af-a4d9-ffeaf70ecda8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:35.079855 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b3f20d-84b9-40af-a4d9-ffeaf70ecda8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:35.263065 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b3f20d-84b9-40af-a4d9-ffeaf70ecda8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:35.264686 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b3f20d-84b9-40af-a4d9-ffeaf70ecda8 service cinder] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:35.289484 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 962/1937] 10.222.0.47 () {58 vars in 1018 bytes} [Wed Aug 31 00:21:35 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:21:35.292476 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 976/1938] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:21:35 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:21:35.317556 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e633b07d-0fb9-4875-bdec-6efc9be8b96e None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:35.319352 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e633b07d-0fb9-4875-bdec-6efc9be8b96e None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:35.320338 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e633b07d-0fb9-4875-bdec-6efc9be8b96e None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:35.328433 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 963/1939] 10.222.0.47 () {54 vars in 961 bytes} [Wed Aug 31 00:21:35 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 00:21:35.333482 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4892a1fd-f82b-45c2-99bc-455489702b8d None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:35.334863 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4892a1fd-f82b-45c2-99bc-455489702b8d None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:35.335466 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4892a1fd-f82b-45c2-99bc-455489702b8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:35.362338 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-4892a1fd-f82b-45c2-99bc-455489702b8d None None] MFA Rules not processed for user `8f76e01e32264ff7a6a7740ffa0a207d`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:21:35.364244 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-4892a1fd-f82b-45c2-99bc-455489702b8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:35.378883 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 977/1940] 10.222.0.47 () {58 vars in 1058 bytes} [Wed Aug 31 00:21:35 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:21:35.389329 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e633b07d-0fb9-4875-bdec-6efc9be8b96e None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:35.418821 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e633b07d-0fb9-4875-bdec-6efc9be8b96e None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:35.434534 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c089e6-3b1a-4cc2-9506-aa4367e4cb23 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f76e01e32264ff7a6a7740ffa0a207d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:35.438793 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c089e6-3b1a-4cc2-9506-aa4367e4cb23 service placement] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:35.439818 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c089e6-3b1a-4cc2-9506-aa4367e4cb23 service placement] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:35.440904 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c089e6-3b1a-4cc2-9506-aa4367e4cb23 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:35.464382 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c089e6-3b1a-4cc2-9506-aa4367e4cb23 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:35.467954 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c089e6-3b1a-4cc2-9506-aa4367e4cb23 service placement] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:35.491674 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 964/1941] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:21:35 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:21:36.058863 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4892a1fd-f82b-45c2-99bc-455489702b8d None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:36.085432 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4892a1fd-f82b-45c2-99bc-455489702b8d None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:36.092889 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28313c45-f335-42fc-a52c-4f8d9510fd34 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beecda6e9feb400288618745c784989f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:36.094166 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28313c45-f335-42fc-a52c-4f8d9510fd34 service cinder] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:36.094693 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28313c45-f335-42fc-a52c-4f8d9510fd34 service cinder] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:36.095238 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28313c45-f335-42fc-a52c-4f8d9510fd34 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:36.248234 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28313c45-f335-42fc-a52c-4f8d9510fd34 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:36.251412 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28313c45-f335-42fc-a52c-4f8d9510fd34 service cinder] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:36.280474 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 978/1942] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:21:36 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 00:21:36.290262 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c089e6-3b1a-4cc2-9506-aa4367e4cb23 service placement] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:36.302377 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c089e6-3b1a-4cc2-9506-aa4367e4cb23 service placement] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:36.308448 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e43ec8d-d05c-4e6c-9083-05a7789b1deb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beecda6e9feb400288618745c784989f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:36.309175 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e43ec8d-d05c-4e6c-9083-05a7789b1deb service cinder] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:36.309464 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e43ec8d-d05c-4e6c-9083-05a7789b1deb service cinder] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:36.309735 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e43ec8d-d05c-4e6c-9083-05a7789b1deb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:36.322790 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e43ec8d-d05c-4e6c-9083-05a7789b1deb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:36.323989 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e43ec8d-d05c-4e6c-9083-05a7789b1deb service cinder] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:36.356660 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 965/1943] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:21:36 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:21:36.394482 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87077787-7d9a-483b-8580-3c8f3524b12d None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:36.396532 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87077787-7d9a-483b-8580-3c8f3524b12d None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:36.396532 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87077787-7d9a-483b-8580-3c8f3524b12d None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:36.399222 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 979/1944] 10.222.0.47 () {54 vars in 921 bytes} [Wed Aug 31 00:21:36 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 00:21:36.429644 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab0b567-fa43-4f79-bf92-5e5b5d54f8e0 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:36.430093 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab0b567-fa43-4f79-bf92-5e5b5d54f8e0 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:36.430543 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab0b567-fa43-4f79-bf92-5e5b5d54f8e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:36.481150 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-dab0b567-fa43-4f79-bf92-5e5b5d54f8e0 None None] MFA Rules not processed for user `8f76e01e32264ff7a6a7740ffa0a207d`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:21:36.483543 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-dab0b567-fa43-4f79-bf92-5e5b5d54f8e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:36.501472 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 966/1945] 10.222.0.47 () {58 vars in 1018 bytes} [Wed Aug 31 00:21:36 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:21:36.555912 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87077787-7d9a-483b-8580-3c8f3524b12d None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:36.595896 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab0b567-fa43-4f79-bf92-5e5b5d54f8e0 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:36.600286 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-dab0b567-fa43-4f79-bf92-5e5b5d54f8e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:36.612749 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87077787-7d9a-483b-8580-3c8f3524b12d None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:36.627552 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0981e918-497e-4e14-a9a2-5950d4be03f6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f76e01e32264ff7a6a7740ffa0a207d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:36.630389 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:36.630764 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0981e918-497e-4e14-a9a2-5950d4be03f6 service placement] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:36.631115 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0981e918-497e-4e14-a9a2-5950d4be03f6 service placement] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:36.631556 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0981e918-497e-4e14-a9a2-5950d4be03f6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:36.657484 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0981e918-497e-4e14-a9a2-5950d4be03f6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:36.659744 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0981e918-497e-4e14-a9a2-5950d4be03f6 service placement] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:36.685221 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 980/1946] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:21:36 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 00:21:36.755771 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab0b567-fa43-4f79-bf92-5e5b5d54f8e0 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:36.762101 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a895e6-8ae8-427b-8332-f1c412a3ae46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:36.762782 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a895e6-8ae8-427b-8332-f1c412a3ae46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:36.763061 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a895e6-8ae8-427b-8332-f1c412a3ae46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:36.763330 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a895e6-8ae8-427b-8332-f1c412a3ae46 admin admin] PATH_INFO: `/v3/users/1c36ea5848ee4edfaf8b11fa245086a4` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:36.764737 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a895e6-8ae8-427b-8332-f1c412a3ae46 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c36ea5848ee4edfaf8b11fa245086a4)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:36.766793 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a895e6-8ae8-427b-8332-f1c412a3ae46 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:36.840770 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-e0a895e6-8ae8-427b-8332-f1c412a3ae46 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c36ea5848ee4edfaf8b11fa245086a4'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:36.850794 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-e0a895e6-8ae8-427b-8332-f1c412a3ae46 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c36ea5848ee4edfaf8b11fa245086a4'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:36.863119 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-e0a895e6-8ae8-427b-8332-f1c412a3ae46 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c36ea5848ee4edfaf8b11fa245086a4'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:36.887794 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-e0a895e6-8ae8-427b-8332-f1c412a3ae46 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c36ea5848ee4edfaf8b11fa245086a4'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:36.889039 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-e0a895e6-8ae8-427b-8332-f1c412a3ae46 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c36ea5848ee4edfaf8b11fa245086a4'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:36.900911 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 967/1947] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 31 00:21:36 2022] DELETE /identity/v3/users/1c36ea5848ee4edfaf8b11fa245086a4 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:21:37.249455 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0981e918-497e-4e14-a9a2-5950d4be03f6 service placement] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:37.275387 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0981e918-497e-4e14-a9a2-5950d4be03f6 service placement] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:37.309495 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:37.349287 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9dafaa-80db-4ae2-9e63-853eba7bf659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:37.349955 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9dafaa-80db-4ae2-9e63-853eba7bf659 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:37.350235 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9dafaa-80db-4ae2-9e63-853eba7bf659 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:37.350512 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9dafaa-80db-4ae2-9e63-853eba7bf659 admin admin] PATH_INFO: `/v3/projects/151f333a22b440568ca316d8bc5c1507` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:37.351739 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9dafaa-80db-4ae2-9e63-853eba7bf659 admin admin] RBAC: Authorizing `identity:delete_project(project_id=151f333a22b440568ca316d8bc5c1507)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:37.353802 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9dafaa-80db-4ae2-9e63-853eba7bf659 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:37.422517 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-be9dafaa-80db-4ae2-9e63-853eba7bf659 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '151f333a22b440568ca316d8bc5c1507', 'request_id': 'req-be9dafaa-80db-4ae2-9e63-853eba7bf659'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:37.431392 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-be9dafaa-80db-4ae2-9e63-853eba7bf659 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '151f333a22b440568ca316d8bc5c1507', 'request_id': 'req-be9dafaa-80db-4ae2-9e63-853eba7bf659'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:37.440111 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-be9dafaa-80db-4ae2-9e63-853eba7bf659 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '151f333a22b440568ca316d8bc5c1507', 'request_id': 'req-be9dafaa-80db-4ae2-9e63-853eba7bf659'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:37.455898 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-be9dafaa-80db-4ae2-9e63-853eba7bf659 admin admin] The token cache is being invalidate because project 151f333a22b440568ca316d8bc5c1507 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:21:37.456221 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-be9dafaa-80db-4ae2-9e63-853eba7bf659 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:37.456876 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-be9dafaa-80db-4ae2-9e63-853eba7bf659 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:37.458454 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 981/1948] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 31 00:21:37 2022] DELETE /identity/v3/projects/151f333a22b440568ca316d8bc5c1507 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:21:37.463034 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a895e6-8ae8-427b-8332-f1c412a3ae46 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:37.464591 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-e0a895e6-8ae8-427b-8332-f1c412a3ae46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:37.479260 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a895e6-8ae8-427b-8332-f1c412a3ae46 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:37.551347 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5aa6677-53f8-4282-be46-8cf29cc7ec81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:37.552492 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5aa6677-53f8-4282-be46-8cf29cc7ec81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:37.552976 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5aa6677-53f8-4282-be46-8cf29cc7ec81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:37.553454 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5aa6677-53f8-4282-be46-8cf29cc7ec81 admin admin] PATH_INFO: `/v3/users/6dcc1fdb1131480bae2fc23ee9301021` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:37.555504 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5aa6677-53f8-4282-be46-8cf29cc7ec81 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6dcc1fdb1131480bae2fc23ee9301021)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:37.559289 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5aa6677-53f8-4282-be46-8cf29cc7ec81 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:37.637422 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:37.671481 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-b5aa6677-53f8-4282-be46-8cf29cc7ec81 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6dcc1fdb1131480bae2fc23ee9301021'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:37.692258 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-b5aa6677-53f8-4282-be46-8cf29cc7ec81 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6dcc1fdb1131480bae2fc23ee9301021'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:37.706383 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-b5aa6677-53f8-4282-be46-8cf29cc7ec81 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6dcc1fdb1131480bae2fc23ee9301021'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:37.725629 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-b5aa6677-53f8-4282-be46-8cf29cc7ec81 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6dcc1fdb1131480bae2fc23ee9301021'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:37.726525 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-b5aa6677-53f8-4282-be46-8cf29cc7ec81 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6dcc1fdb1131480bae2fc23ee9301021'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:37.735173 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 968/1949] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 31 00:21:37 2022] DELETE /identity/v3/users/6dcc1fdb1131480bae2fc23ee9301021 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:21:38.245433 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9dafaa-80db-4ae2-9e63-853eba7bf659 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:38.248085 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-be9dafaa-80db-4ae2-9e63-853eba7bf659 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:38.300071 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9dafaa-80db-4ae2-9e63-853eba7bf659 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:38.443820 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfa3a9d-9be5-4318-b837-b1c2b8002e7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:38.444651 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfa3a9d-9be5-4318-b837-b1c2b8002e7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:38.445013 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfa3a9d-9be5-4318-b837-b1c2b8002e7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:38.445427 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfa3a9d-9be5-4318-b837-b1c2b8002e7c admin admin] PATH_INFO: `/v3/projects/871c0980061249538b44de32d998f060` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:38.447028 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfa3a9d-9be5-4318-b837-b1c2b8002e7c admin admin] RBAC: Authorizing `identity:delete_project(project_id=871c0980061249538b44de32d998f060)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:38.449505 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfa3a9d-9be5-4318-b837-b1c2b8002e7c admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:38.553031 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-4bfa3a9d-9be5-4318-b837-b1c2b8002e7c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '871c0980061249538b44de32d998f060', 'request_id': 'req-4bfa3a9d-9be5-4318-b837-b1c2b8002e7c'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:38.566994 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-4bfa3a9d-9be5-4318-b837-b1c2b8002e7c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '871c0980061249538b44de32d998f060', 'request_id': 'req-4bfa3a9d-9be5-4318-b837-b1c2b8002e7c'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:38.577348 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:38.579781 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-4bfa3a9d-9be5-4318-b837-b1c2b8002e7c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '871c0980061249538b44de32d998f060', 'request_id': 'req-4bfa3a9d-9be5-4318-b837-b1c2b8002e7c'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:38.602770 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-4bfa3a9d-9be5-4318-b837-b1c2b8002e7c admin admin] The token cache is being invalidate because project 871c0980061249538b44de32d998f060 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:21:38.603213 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-4bfa3a9d-9be5-4318-b837-b1c2b8002e7c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:38.604048 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-4bfa3a9d-9be5-4318-b837-b1c2b8002e7c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:38.606485 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 982/1950] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 31 00:21:38 2022] DELETE /identity/v3/projects/871c0980061249538b44de32d998f060 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:21:38.613660 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0907722c-7512-470e-8844-b6705a6aec8f None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:38.616097 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0907722c-7512-470e-8844-b6705a6aec8f None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:38.616097 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0907722c-7512-470e-8844-b6705a6aec8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:38.640925 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-0907722c-7512-470e-8844-b6705a6aec8f None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:21:38.643031 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-0907722c-7512-470e-8844-b6705a6aec8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:38.762468 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 969/1951] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:21:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:21:38.771645 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca352de4-5bba-40c5-99f3-e46d6c439531 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:38.771918 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca352de4-5bba-40c5-99f3-e46d6c439531 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:38.772239 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca352de4-5bba-40c5-99f3-e46d6c439531 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:38.794568 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-ca352de4-5bba-40c5-99f3-e46d6c439531 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:21:38.795838 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-ca352de4-5bba-40c5-99f3-e46d6c439531 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:38.804457 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 983/1952] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:21:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:21:38.809866 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0907722c-7512-470e-8844-b6705a6aec8f None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:38.827372 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0907722c-7512-470e-8844-b6705a6aec8f None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:38.835900 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5005d0fa-ba59-4b89-a901-d9f183febdc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:38.837066 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5005d0fa-ba59-4b89-a901-d9f183febdc7 admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:38.837909 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5005d0fa-ba59-4b89-a901-d9f183febdc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:38.838394 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5005d0fa-ba59-4b89-a901-d9f183febdc7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:38.839516 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5005d0fa-ba59-4b89-a901-d9f183febdc7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:21:38.840060 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5005d0fa-ba59-4b89-a901-d9f183febdc7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:38.843124 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5005d0fa-ba59-4b89-a901-d9f183febdc7 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:38.859640 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 970/1953] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 31 00:21:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:21:38.865165 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca352de4-5bba-40c5-99f3-e46d6c439531 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:38.883451 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca352de4-5bba-40c5-99f3-e46d6c439531 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:38.891315 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e90da5f-6213-488b-9267-ff6244d008ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:38.892472 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e90da5f-6213-488b-9267-ff6244d008ab admin admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:38.892934 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e90da5f-6213-488b-9267-ff6244d008ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:38.893546 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e90da5f-6213-488b-9267-ff6244d008ab admin admin] PATH_INFO: `/v3/projects` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:38.894787 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e90da5f-6213-488b-9267-ff6244d008ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:38.899301 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e90da5f-6213-488b-9267-ff6244d008ab admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:38.953228 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 984/1954] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 31 00:21:38 2022] POST /identity/v3/projects => generated 383 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:21:38.954305 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5005d0fa-ba59-4b89-a901-d9f183febdc7 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:38.966747 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5005d0fa-ba59-4b89-a901-d9f183febdc7 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:39.051879 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f5e42a-75b3-477a-98d7-03dfe5699220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:39.052784 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f5e42a-75b3-477a-98d7-03dfe5699220 admin admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:39.053207 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f5e42a-75b3-477a-98d7-03dfe5699220 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:39.053567 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f5e42a-75b3-477a-98d7-03dfe5699220 admin admin] PATH_INFO: `/v3/users` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:39.054337 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f5e42a-75b3-477a-98d7-03dfe5699220 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:39.057123 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f5e42a-75b3-477a-98d7-03dfe5699220 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:39.083844 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 971/1955] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 31 00:21:38 2022] POST /identity/v3/users => generated 292 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:21:39.088792 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e90da5f-6213-488b-9267-ff6244d008ab admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:39.101252 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e90da5f-6213-488b-9267-ff6244d008ab admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:39.106654 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f898ecf-79c4-4908-8a3e-6ddc560943a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:39.107572 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f898ecf-79c4-4908-8a3e-6ddc560943a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:39.108019 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f898ecf-79c4-4908-8a3e-6ddc560943a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:39.108442 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f898ecf-79c4-4908-8a3e-6ddc560943a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:39.109240 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f898ecf-79c4-4908-8a3e-6ddc560943a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:39.111173 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f898ecf-79c4-4908-8a3e-6ddc560943a8 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:39.124114 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 985/1956] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 00:21:39 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:21:39.128524 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f5e42a-75b3-477a-98d7-03dfe5699220 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:39.141777 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f5e42a-75b3-477a-98d7-03dfe5699220 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:39.149442 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5907c0b4-034b-4697-8123-c0230471f602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:39.150351 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5907c0b4-034b-4697-8123-c0230471f602 admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:39.150634 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5907c0b4-034b-4697-8123-c0230471f602 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:39.150905 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5907c0b4-034b-4697-8123-c0230471f602 admin admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:39.151575 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5907c0b4-034b-4697-8123-c0230471f602 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:39.153392 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5907c0b4-034b-4697-8123-c0230471f602 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:39.172835 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 972/1957] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 00:21:39 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:21:39.174440 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f898ecf-79c4-4908-8a3e-6ddc560943a8 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:39.188062 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f898ecf-79c4-4908-8a3e-6ddc560943a8 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:39.198229 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33ed812-a651-4dbf-9a5b-ef09abe17715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:39.199056 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33ed812-a651-4dbf-9a5b-ef09abe17715 admin admin] REQUEST_METHOD: `PUT` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:39.199455 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33ed812-a651-4dbf-9a5b-ef09abe17715 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:39.199922 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33ed812-a651-4dbf-9a5b-ef09abe17715 admin admin] PATH_INFO: `/v3/projects/c77a949233bf460cbad47d11e374e718/users/bb8cc60d206649eabeb3aee48f977569/roles/fdad79ffbcbb4fa380dc9cf7dd108618` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:39.219997 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33ed812-a651-4dbf-9a5b-ef09abe17715 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c77a949233bf460cbad47d11e374e718, user_id=bb8cc60d206649eabeb3aee48f977569, role_id=fdad79ffbcbb4fa380dc9cf7dd108618)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:39.223638 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33ed812-a651-4dbf-9a5b-ef09abe17715 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:39.243059 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 986/1958] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 00:21:39 2022] PUT /identity/v3/projects/c77a949233bf460cbad47d11e374e718/users/bb8cc60d206649eabeb3aee48f977569/roles/fdad79ffbcbb4fa380dc9cf7dd108618 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:21:39.257649 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ab58f3-1d0b-4c85-99e7-840e45631b70 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:39.258285 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ab58f3-1d0b-4c85-99e7-840e45631b70 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:39.258285 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ab58f3-1d0b-4c85-99e7-840e45631b70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:39.295900 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-b2ab58f3-1d0b-4c85-99e7-840e45631b70 None None] MFA Rules not processed for user `bb8cc60d206649eabeb3aee48f977569`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:21:39.297559 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-b2ab58f3-1d0b-4c85-99e7-840e45631b70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:39.303327 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:39.469142 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 973/1959] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:21:39 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:21:39.470883 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33ed812-a651-4dbf-9a5b-ef09abe17715 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:39.621177 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33ed812-a651-4dbf-9a5b-ef09abe17715 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:39.646866 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f88e1be-ea50-4b29-becc-f58cada699a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:39.649595 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f88e1be-ea50-4b29-becc-f58cada699a1 admin admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:39.650629 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f88e1be-ea50-4b29-becc-f58cada699a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:39.651659 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f88e1be-ea50-4b29-becc-f58cada699a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:39.653403 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f88e1be-ea50-4b29-becc-f58cada699a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:39.659351 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f88e1be-ea50-4b29-becc-f58cada699a1 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:39.721763 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 987/1960] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 31 00:21:39 2022] POST /identity/v3/projects => generated 383 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:21:39.726764 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ab58f3-1d0b-4c85-99e7-840e45631b70 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:39.747251 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ab58f3-1d0b-4c85-99e7-840e45631b70 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:39.940417 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb827f26-7350-4be5-b4fc-06f08b746903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:39.942709 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb827f26-7350-4be5-b4fc-06f08b746903 admin admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:39.943195 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb827f26-7350-4be5-b4fc-06f08b746903 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:39.943741 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb827f26-7350-4be5-b4fc-06f08b746903 admin admin] PATH_INFO: `/v3/users` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:39.945367 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb827f26-7350-4be5-b4fc-06f08b746903 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:39.956552 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb827f26-7350-4be5-b4fc-06f08b746903 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:40.015977 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 974/1961] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 31 00:21:39 2022] POST /identity/v3/users => generated 298 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:21:40.022199 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f88e1be-ea50-4b29-becc-f58cada699a1 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:40.042746 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f88e1be-ea50-4b29-becc-f58cada699a1 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:40.048686 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f074c2d3-6fc6-4b3f-aca0-c83523e140f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:40.063019 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f074c2d3-6fc6-4b3f-aca0-c83523e140f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:40.063642 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f074c2d3-6fc6-4b3f-aca0-c83523e140f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:40.065028 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f074c2d3-6fc6-4b3f-aca0-c83523e140f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:40.066300 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f074c2d3-6fc6-4b3f-aca0-c83523e140f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:40.072330 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f074c2d3-6fc6-4b3f-aca0-c83523e140f9 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:40.100953 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 988/1962] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 00:21:40 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:21:40.103368 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb827f26-7350-4be5-b4fc-06f08b746903 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:40.124536 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb827f26-7350-4be5-b4fc-06f08b746903 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:40.132988 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db52a8f5-b6da-4df5-8609-c9277499a05c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:40.133992 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db52a8f5-b6da-4df5-8609-c9277499a05c admin admin] REQUEST_METHOD: `PUT` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:40.134401 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db52a8f5-b6da-4df5-8609-c9277499a05c admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:40.134809 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db52a8f5-b6da-4df5-8609-c9277499a05c admin admin] PATH_INFO: `/v3/projects/04818fa374fb460090132bca37216717/users/98ce03de40594116bff6d9242ac2c90e/roles/12f6817f9aaa4e2bb477095a6bed5d0f` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:40.170043 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db52a8f5-b6da-4df5-8609-c9277499a05c admin admin] RBAC: Authorizing `identity:create_grant(project_id=04818fa374fb460090132bca37216717, user_id=98ce03de40594116bff6d9242ac2c90e, role_id=12f6817f9aaa4e2bb477095a6bed5d0f)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:40.173655 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db52a8f5-b6da-4df5-8609-c9277499a05c admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:40.196016 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 975/1963] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 00:21:40 2022] PUT /identity/v3/projects/04818fa374fb460090132bca37216717/users/98ce03de40594116bff6d9242ac2c90e/roles/12f6817f9aaa4e2bb477095a6bed5d0f => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:21:40.201746 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f074c2d3-6fc6-4b3f-aca0-c83523e140f9 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:40.219334 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f074c2d3-6fc6-4b3f-aca0-c83523e140f9 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:40.335047 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda5f17a-2dcb-4e5a-9b4c-aa1fc92cf85a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:40.336125 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda5f17a-2dcb-4e5a-9b4c-aa1fc92cf85a admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:40.336549 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda5f17a-2dcb-4e5a-9b4c-aa1fc92cf85a admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:40.336793 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda5f17a-2dcb-4e5a-9b4c-aa1fc92cf85a admin admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:40.337760 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda5f17a-2dcb-4e5a-9b4c-aa1fc92cf85a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:40.339800 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda5f17a-2dcb-4e5a-9b4c-aa1fc92cf85a admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:40.343378 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:40.361966 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 989/1964] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 00:21:40 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:21:40.369039 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db52a8f5-b6da-4df5-8609-c9277499a05c admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:40.395876 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db52a8f5-b6da-4df5-8609-c9277499a05c admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:40.404332 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51706c2-ff62-4a80-a094-2e37c4c4bbfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:40.405160 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51706c2-ff62-4a80-a094-2e37c4c4bbfd admin admin] REQUEST_METHOD: `PUT` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:40.405808 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51706c2-ff62-4a80-a094-2e37c4c4bbfd admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:40.406135 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51706c2-ff62-4a80-a094-2e37c4c4bbfd admin admin] PATH_INFO: `/v3/projects/04818fa374fb460090132bca37216717/users/98ce03de40594116bff6d9242ac2c90e/roles/12f6817f9aaa4e2bb477095a6bed5d0f` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:40.408713 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51706c2-ff62-4a80-a094-2e37c4c4bbfd admin admin] RBAC: Authorizing `identity:create_grant(project_id=04818fa374fb460090132bca37216717, user_id=98ce03de40594116bff6d9242ac2c90e, role_id=12f6817f9aaa4e2bb477095a6bed5d0f)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:40.412377 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51706c2-ff62-4a80-a094-2e37c4c4bbfd admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:40.431040 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 976/1965] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 00:21:40 2022] PUT /identity/v3/projects/04818fa374fb460090132bca37216717/users/98ce03de40594116bff6d9242ac2c90e/roles/12f6817f9aaa4e2bb477095a6bed5d0f => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:21:40.444856 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a82278-6095-4a19-b8c6-c69e5ced80bf None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:40.445309 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a82278-6095-4a19-b8c6-c69e5ced80bf None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:40.445474 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a82278-6095-4a19-b8c6-c69e5ced80bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:40.479529 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-33a82278-6095-4a19-b8c6-c69e5ced80bf None None] MFA Rules not processed for user `98ce03de40594116bff6d9242ac2c90e`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:21:40.481047 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-33a82278-6095-4a19-b8c6-c69e5ced80bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:40.604303 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 990/1966] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:21:40 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:21:40.618009 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51706c2-ff62-4a80-a094-2e37c4c4bbfd admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:40.619819 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-f51706c2-ff62-4a80-a094-2e37c4c4bbfd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:40.717474 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51706c2-ff62-4a80-a094-2e37c4c4bbfd admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:40.725612 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94878e7-0de5-4c7b-8af7-013aee7b4a1b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beecda6e9feb400288618745c784989f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:40.726469 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94878e7-0de5-4c7b-8af7-013aee7b4a1b service cinder] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:40.726944 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94878e7-0de5-4c7b-8af7-013aee7b4a1b service cinder] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:40.727865 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94878e7-0de5-4c7b-8af7-013aee7b4a1b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:40.741147 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:40.818979 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94878e7-0de5-4c7b-8af7-013aee7b4a1b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:40.820793 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94878e7-0de5-4c7b-8af7-013aee7b4a1b service cinder] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:40.862937 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 977/1967] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:21:40 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:21:41.043404 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a82278-6095-4a19-b8c6-c69e5ced80bf None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:41.045849 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-33a82278-6095-4a19-b8c6-c69e5ced80bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:41.192693 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94878e7-0de5-4c7b-8af7-013aee7b4a1b service cinder] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:41.195642 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-c94878e7-0de5-4c7b-8af7-013aee7b4a1b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:41.212298 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a82278-6095-4a19-b8c6-c69e5ced80bf None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:41.220310 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a53902-3a4f-4664-87a5-2929c1bdf0b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:41.221220 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a53902-3a4f-4664-87a5-2929c1bdf0b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:41.222235 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a53902-3a4f-4664-87a5-2929c1bdf0b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:41.222728 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a53902-3a4f-4664-87a5-2929c1bdf0b9 admin admin] PATH_INFO: `/v3/users/bbeedad8f7554fdf9f087b507267d6ba` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:41.226020 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a53902-3a4f-4664-87a5-2929c1bdf0b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bbeedad8f7554fdf9f087b507267d6ba)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:41.228775 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a53902-3a4f-4664-87a5-2929c1bdf0b9 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:41.240947 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94878e7-0de5-4c7b-8af7-013aee7b4a1b service cinder] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:41.259745 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd56ee96-f0be-48b3-adc0-94503bca5abb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:41.261322 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd56ee96-f0be-48b3-adc0-94503bca5abb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:41.262257 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd56ee96-f0be-48b3-adc0-94503bca5abb admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:41.262807 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd56ee96-f0be-48b3-adc0-94503bca5abb admin admin] PATH_INFO: `/v3/users/bbd6c24d57884c1a96aa7e31f9c6b12d` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:41.266222 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd56ee96-f0be-48b3-adc0-94503bca5abb admin admin] RBAC: Authorizing `identity:delete_user(user_id=bbd6c24d57884c1a96aa7e31f9c6b12d)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:41.272139 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd56ee96-f0be-48b3-adc0-94503bca5abb admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:41.354415 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-62a53902-3a4f-4664-87a5-2929c1bdf0b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bbeedad8f7554fdf9f087b507267d6ba'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:41.381186 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-62a53902-3a4f-4664-87a5-2929c1bdf0b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bbeedad8f7554fdf9f087b507267d6ba'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:41.403722 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-62a53902-3a4f-4664-87a5-2929c1bdf0b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bbeedad8f7554fdf9f087b507267d6ba'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:41.405000 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-62a53902-3a4f-4664-87a5-2929c1bdf0b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bbeedad8f7554fdf9f087b507267d6ba'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:41.409186 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-dd56ee96-f0be-48b3-adc0-94503bca5abb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bbd6c24d57884c1a96aa7e31f9c6b12d'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:41.433111 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-dd56ee96-f0be-48b3-adc0-94503bca5abb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bbd6c24d57884c1a96aa7e31f9c6b12d'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:41.436128 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-62a53902-3a4f-4664-87a5-2929c1bdf0b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bbeedad8f7554fdf9f087b507267d6ba'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:41.442576 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:41.451725 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 991/1968] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 31 00:21:41 2022] DELETE /identity/v3/users/bbeedad8f7554fdf9f087b507267d6ba => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:21:41.460204 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c26914b-d56d-4416-8b07-e5e36dca4ec4 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:41.460502 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c26914b-d56d-4416-8b07-e5e36dca4ec4 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:41.460867 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c26914b-d56d-4416-8b07-e5e36dca4ec4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:41.465113 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-dd56ee96-f0be-48b3-adc0-94503bca5abb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bbd6c24d57884c1a96aa7e31f9c6b12d'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:41.490386 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-dd56ee96-f0be-48b3-adc0-94503bca5abb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bbd6c24d57884c1a96aa7e31f9c6b12d'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:41.491430 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-dd56ee96-f0be-48b3-adc0-94503bca5abb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bbd6c24d57884c1a96aa7e31f9c6b12d'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:41.496896 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-6c26914b-d56d-4416-8b07-e5e36dca4ec4 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:21:41.498177 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-6c26914b-d56d-4416-8b07-e5e36dca4ec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:41.501017 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 978/1969] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 31 00:21:41 2022] DELETE /identity/v3/users/bbd6c24d57884c1a96aa7e31f9c6b12d => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:21:41.508444 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5386a7c-5332-4641-a6de-f4ef171af102 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:41.509177 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5386a7c-5332-4641-a6de-f4ef171af102 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:41.509853 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5386a7c-5332-4641-a6de-f4ef171af102 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:41.538904 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-f5386a7c-5332-4641-a6de-f4ef171af102 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:21:41.540267 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-f5386a7c-5332-4641-a6de-f4ef171af102 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:41.627684 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 992/1970] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:21:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:21:41.642580 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c26914b-d56d-4416-8b07-e5e36dca4ec4 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:41.644982 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-6c26914b-d56d-4416-8b07-e5e36dca4ec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:41.687092 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 979/1971] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:21:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:21:41.700046 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5386a7c-5332-4641-a6de-f4ef171af102 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:41.701688 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-f5386a7c-5332-4641-a6de-f4ef171af102 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:41.792088 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:41.822764 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c26914b-d56d-4416-8b07-e5e36dca4ec4 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:41.841574 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c1b240-49f9-4ceb-976a-446956cfb0b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'daae792cd11d4c4ca7aae0558998aced', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:41.844965 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c1b240-49f9-4ceb-976a-446956cfb0b7 service neutron] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:41.845434 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c1b240-49f9-4ceb-976a-446956cfb0b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:41.845906 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c1b240-49f9-4ceb-976a-446956cfb0b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:41.880102 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5386a7c-5332-4641-a6de-f4ef171af102 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:41.885580 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a6e143-3868-48d2-974c-9c39ae026931 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'daae792cd11d4c4ca7aae0558998aced', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:41.886654 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a6e143-3868-48d2-974c-9c39ae026931 service neutron] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:41.887162 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a6e143-3868-48d2-974c-9c39ae026931 service neutron] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:41.888648 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a6e143-3868-48d2-974c-9c39ae026931 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:41.889205 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c1b240-49f9-4ceb-976a-446956cfb0b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:41.893182 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c1b240-49f9-4ceb-976a-446956cfb0b7 service neutron] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:41.907151 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a6e143-3868-48d2-974c-9c39ae026931 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:41.911094 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a6e143-3868-48d2-974c-9c39ae026931 service neutron] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:41.925798 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 980/1972] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:21:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 00:21:41.932475 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 993/1973] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:21:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:21:42.654773 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a6e143-3868-48d2-974c-9c39ae026931 service neutron] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:42.656870 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-48a6e143-3868-48d2-974c-9c39ae026931 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:42.675525 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c1b240-49f9-4ceb-976a-446956cfb0b7 service neutron] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:42.677709 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-89c1b240-49f9-4ceb-976a-446956cfb0b7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:42.711120 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a6e143-3868-48d2-974c-9c39ae026931 service neutron] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:42.723987 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c1b240-49f9-4ceb-976a-446956cfb0b7 service neutron] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:42.746208 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49070f75-4a64-4750-939d-65d31c011204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:42.746897 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49070f75-4a64-4750-939d-65d31c011204 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:42.747185 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49070f75-4a64-4750-939d-65d31c011204 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:42.747459 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49070f75-4a64-4750-939d-65d31c011204 admin admin] PATH_INFO: `/v3/projects/81900b31e0b84e32ae8fe17707fe7e6c` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:42.749345 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49070f75-4a64-4750-939d-65d31c011204 admin admin] RBAC: Authorizing `identity:delete_project(project_id=81900b31e0b84e32ae8fe17707fe7e6c)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:42.751392 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49070f75-4a64-4750-939d-65d31c011204 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:42.758060 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d2177f-1549-40ab-88e8-563440df8f5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:42.758733 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d2177f-1549-40ab-88e8-563440df8f5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:42.760847 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d2177f-1549-40ab-88e8-563440df8f5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:42.760847 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d2177f-1549-40ab-88e8-563440df8f5c admin admin] PATH_INFO: `/v3/projects/1cd21ff17c50462e8ed17cddcd7db8f2` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:42.762493 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d2177f-1549-40ab-88e8-563440df8f5c admin admin] RBAC: Authorizing `identity:delete_project(project_id=1cd21ff17c50462e8ed17cddcd7db8f2)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:42.768554 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d2177f-1549-40ab-88e8-563440df8f5c admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:42.884615 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-d8d2177f-1549-40ab-88e8-563440df8f5c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1cd21ff17c50462e8ed17cddcd7db8f2', 'request_id': 'req-d8d2177f-1549-40ab-88e8-563440df8f5c'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:42.895692 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-49070f75-4a64-4750-939d-65d31c011204 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81900b31e0b84e32ae8fe17707fe7e6c', 'request_id': 'req-49070f75-4a64-4750-939d-65d31c011204'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:42.906186 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-d8d2177f-1549-40ab-88e8-563440df8f5c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1cd21ff17c50462e8ed17cddcd7db8f2', 'request_id': 'req-d8d2177f-1549-40ab-88e8-563440df8f5c'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:42.906571 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-49070f75-4a64-4750-939d-65d31c011204 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81900b31e0b84e32ae8fe17707fe7e6c', 'request_id': 'req-49070f75-4a64-4750-939d-65d31c011204'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:42.936383 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-49070f75-4a64-4750-939d-65d31c011204 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81900b31e0b84e32ae8fe17707fe7e6c', 'request_id': 'req-49070f75-4a64-4750-939d-65d31c011204'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:42.940682 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-d8d2177f-1549-40ab-88e8-563440df8f5c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1cd21ff17c50462e8ed17cddcd7db8f2', 'request_id': 'req-d8d2177f-1549-40ab-88e8-563440df8f5c'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:42.982471 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-49070f75-4a64-4750-939d-65d31c011204 admin admin] The token cache is being invalidate because project 81900b31e0b84e32ae8fe17707fe7e6c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81523) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:21:42.982954 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-49070f75-4a64-4750-939d-65d31c011204 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:42.984811 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-d8d2177f-1549-40ab-88e8-563440df8f5c admin admin] The token cache is being invalidate because project 1cd21ff17c50462e8ed17cddcd7db8f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:21:42.989804 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-d8d2177f-1549-40ab-88e8-563440df8f5c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:42.990512 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-49070f75-4a64-4750-939d-65d31c011204 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:42.992091 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-d8d2177f-1549-40ab-88e8-563440df8f5c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:42.998434 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 981/1974] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 31 00:21:42 2022] DELETE /identity/v3/projects/81900b31e0b84e32ae8fe17707fe7e6c => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:21:42.999892 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 994/1975] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 31 00:21:42 2022] DELETE /identity/v3/projects/1cd21ff17c50462e8ed17cddcd7db8f2 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:21:43.005979 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49070f75-4a64-4750-939d-65d31c011204 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:43.008312 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d2177f-1549-40ab-88e8-563440df8f5c admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:43.011830 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-d8d2177f-1549-40ab-88e8-563440df8f5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:43.012091 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-49070f75-4a64-4750-939d-65d31c011204 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:43.186319 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:43.262740 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49070f75-4a64-4750-939d-65d31c011204 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:43.269156 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaac327e-d4de-49fa-8b63-81bcf780b539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:43.270664 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaac327e-d4de-49fa-8b63-81bcf780b539 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:43.271054 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaac327e-d4de-49fa-8b63-81bcf780b539 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:43.271436 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaac327e-d4de-49fa-8b63-81bcf780b539 admin admin] PATH_INFO: `/v3/users/ba65a1db9cc44bcc920cf92bde03e295` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:43.275805 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaac327e-d4de-49fa-8b63-81bcf780b539 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba65a1db9cc44bcc920cf92bde03e295)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:43.278801 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaac327e-d4de-49fa-8b63-81bcf780b539 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:43.348041 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d2177f-1549-40ab-88e8-563440df8f5c admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:43.360443 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812b1e88-9ed7-4f3a-80d1-e25e0b12aa80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:43.361655 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812b1e88-9ed7-4f3a-80d1-e25e0b12aa80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:43.364222 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812b1e88-9ed7-4f3a-80d1-e25e0b12aa80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:43.365770 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812b1e88-9ed7-4f3a-80d1-e25e0b12aa80 admin admin] PATH_INFO: `/v3/users/914d0f3261404aef85765bce4624d7bb` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:43.368044 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812b1e88-9ed7-4f3a-80d1-e25e0b12aa80 admin admin] RBAC: Authorizing `identity:delete_user(user_id=914d0f3261404aef85765bce4624d7bb)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:43.374420 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812b1e88-9ed7-4f3a-80d1-e25e0b12aa80 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:43.376919 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-eaac327e-d4de-49fa-8b63-81bcf780b539 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba65a1db9cc44bcc920cf92bde03e295'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:43.390084 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:43.398205 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-eaac327e-d4de-49fa-8b63-81bcf780b539 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba65a1db9cc44bcc920cf92bde03e295'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:43.423496 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-eaac327e-d4de-49fa-8b63-81bcf780b539 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba65a1db9cc44bcc920cf92bde03e295'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:43.449837 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-eaac327e-d4de-49fa-8b63-81bcf780b539 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba65a1db9cc44bcc920cf92bde03e295'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:43.452141 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-eaac327e-d4de-49fa-8b63-81bcf780b539 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba65a1db9cc44bcc920cf92bde03e295'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:43.466344 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 982/1976] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 31 00:21:43 2022] DELETE /identity/v3/users/ba65a1db9cc44bcc920cf92bde03e295 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:21:43.486107 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-812b1e88-9ed7-4f3a-80d1-e25e0b12aa80 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '914d0f3261404aef85765bce4624d7bb'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:43.510879 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-812b1e88-9ed7-4f3a-80d1-e25e0b12aa80 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '914d0f3261404aef85765bce4624d7bb'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:43.537103 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-812b1e88-9ed7-4f3a-80d1-e25e0b12aa80 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '914d0f3261404aef85765bce4624d7bb'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:43.538142 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-812b1e88-9ed7-4f3a-80d1-e25e0b12aa80 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '914d0f3261404aef85765bce4624d7bb'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:43.582108 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-812b1e88-9ed7-4f3a-80d1-e25e0b12aa80 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '914d0f3261404aef85765bce4624d7bb'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:43.595065 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 995/1977] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 31 00:21:43 2022] DELETE /identity/v3/users/914d0f3261404aef85765bce4624d7bb => generated 0 bytes in 591 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:21:44.165673 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaac327e-d4de-49fa-8b63-81bcf780b539 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:44.172248 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-eaac327e-d4de-49fa-8b63-81bcf780b539 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:44.253770 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812b1e88-9ed7-4f3a-80d1-e25e0b12aa80 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:44.256646 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-812b1e88-9ed7-4f3a-80d1-e25e0b12aa80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:44.344603 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaac327e-d4de-49fa-8b63-81bcf780b539 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:44.406222 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812b1e88-9ed7-4f3a-80d1-e25e0b12aa80 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:44.417850 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b081e00-e123-4ade-a461-7709b2da967d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:44.419379 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b081e00-e123-4ade-a461-7709b2da967d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:44.419974 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b081e00-e123-4ade-a461-7709b2da967d admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:44.420897 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b081e00-e123-4ade-a461-7709b2da967d admin admin] PATH_INFO: `/v3/projects/3b65ad5fb4164393a79003075b86479e` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:44.424779 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b081e00-e123-4ade-a461-7709b2da967d admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b65ad5fb4164393a79003075b86479e)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:44.431815 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b081e00-e123-4ade-a461-7709b2da967d admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:44.434935 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecf4515-3aaf-488b-a745-a7935f3c8abe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:44.436274 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecf4515-3aaf-488b-a745-a7935f3c8abe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:44.436766 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecf4515-3aaf-488b-a745-a7935f3c8abe admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:44.437261 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecf4515-3aaf-488b-a745-a7935f3c8abe admin admin] PATH_INFO: `/v3/projects/1b69414823604671be2d3afad0f2b343` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:44.440756 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecf4515-3aaf-488b-a745-a7935f3c8abe admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b69414823604671be2d3afad0f2b343)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:44.445634 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecf4515-3aaf-488b-a745-a7935f3c8abe admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:44.562057 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:44.565583 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-3b081e00-e123-4ade-a461-7709b2da967d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b65ad5fb4164393a79003075b86479e', 'request_id': 'req-3b081e00-e123-4ade-a461-7709b2da967d'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:44.568203 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-8ecf4515-3aaf-488b-a745-a7935f3c8abe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b69414823604671be2d3afad0f2b343', 'request_id': 'req-8ecf4515-3aaf-488b-a745-a7935f3c8abe'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:44.577233 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-3b081e00-e123-4ade-a461-7709b2da967d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b65ad5fb4164393a79003075b86479e', 'request_id': 'req-3b081e00-e123-4ade-a461-7709b2da967d'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:44.587671 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-3b081e00-e123-4ade-a461-7709b2da967d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b65ad5fb4164393a79003075b86479e', 'request_id': 'req-3b081e00-e123-4ade-a461-7709b2da967d'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:44.590757 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-8ecf4515-3aaf-488b-a745-a7935f3c8abe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b69414823604671be2d3afad0f2b343', 'request_id': 'req-8ecf4515-3aaf-488b-a745-a7935f3c8abe'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:44.609185 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-3b081e00-e123-4ade-a461-7709b2da967d admin admin] The token cache is being invalidate because project 3b65ad5fb4164393a79003075b86479e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:21:44.609584 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-3b081e00-e123-4ade-a461-7709b2da967d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:44.610679 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-3b081e00-e123-4ade-a461-7709b2da967d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:44.611794 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-8ecf4515-3aaf-488b-a745-a7935f3c8abe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b69414823604671be2d3afad0f2b343', 'request_id': 'req-8ecf4515-3aaf-488b-a745-a7935f3c8abe'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:44.613002 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 996/1978] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 31 00:21:44 2022] DELETE /identity/v3/projects/3b65ad5fb4164393a79003075b86479e => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:21:44.620631 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b081e00-e123-4ade-a461-7709b2da967d admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:44.623899 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-3b081e00-e123-4ade-a461-7709b2da967d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:44.639293 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-8ecf4515-3aaf-488b-a745-a7935f3c8abe admin admin] The token cache is being invalidate because project 1b69414823604671be2d3afad0f2b343 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81523) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:21:44.640043 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-8ecf4515-3aaf-488b-a745-a7935f3c8abe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:44.647623 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-8ecf4515-3aaf-488b-a745-a7935f3c8abe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:44.657318 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 983/1979] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 31 00:21:44 2022] DELETE /identity/v3/projects/1b69414823604671be2d3afad0f2b343 => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:21:44.661726 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecf4515-3aaf-488b-a745-a7935f3c8abe admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:44.664732 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-8ecf4515-3aaf-488b-a745-a7935f3c8abe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:44.693255 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:44.789218 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b081e00-e123-4ade-a461-7709b2da967d admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:44.795560 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d82f7dc-8fe6-4e28-a4ca-781fdfa435eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:44.796683 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d82f7dc-8fe6-4e28-a4ca-781fdfa435eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:44.797066 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d82f7dc-8fe6-4e28-a4ca-781fdfa435eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:44.797439 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d82f7dc-8fe6-4e28-a4ca-781fdfa435eb admin admin] PATH_INFO: `/v3/users/02c245290c1f41369e246460f67d7c00` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:44.800835 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d82f7dc-8fe6-4e28-a4ca-781fdfa435eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=02c245290c1f41369e246460f67d7c00)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:44.803903 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d82f7dc-8fe6-4e28-a4ca-781fdfa435eb admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:44.853583 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecf4515-3aaf-488b-a745-a7935f3c8abe admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:44.874571 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6592b5f-2955-4c15-9ec3-3013e76e28dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:44.875723 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6592b5f-2955-4c15-9ec3-3013e76e28dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:44.876228 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6592b5f-2955-4c15-9ec3-3013e76e28dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:44.876948 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6592b5f-2955-4c15-9ec3-3013e76e28dc admin admin] PATH_INFO: `/v3/users/8bc92050c8e24c5a9ea8e128d70ed61a` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:44.880391 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6592b5f-2955-4c15-9ec3-3013e76e28dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=8bc92050c8e24c5a9ea8e128d70ed61a)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:44.885453 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6592b5f-2955-4c15-9ec3-3013e76e28dc admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:44.907122 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-9d82f7dc-8fe6-4e28-a4ca-781fdfa435eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02c245290c1f41369e246460f67d7c00'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:44.920721 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-9d82f7dc-8fe6-4e28-a4ca-781fdfa435eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02c245290c1f41369e246460f67d7c00'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:44.940440 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-9d82f7dc-8fe6-4e28-a4ca-781fdfa435eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02c245290c1f41369e246460f67d7c00'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:44.942406 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-9d82f7dc-8fe6-4e28-a4ca-781fdfa435eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02c245290c1f41369e246460f67d7c00'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:44.983389 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-d6592b5f-2955-4c15-9ec3-3013e76e28dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8bc92050c8e24c5a9ea8e128d70ed61a'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:44.989206 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-9d82f7dc-8fe6-4e28-a4ca-781fdfa435eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02c245290c1f41369e246460f67d7c00'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:44.993895 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-d6592b5f-2955-4c15-9ec3-3013e76e28dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8bc92050c8e24c5a9ea8e128d70ed61a'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:45.005813 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-d6592b5f-2955-4c15-9ec3-3013e76e28dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8bc92050c8e24c5a9ea8e128d70ed61a'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:45.007705 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 997/1980] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 31 00:21:44 2022] DELETE /identity/v3/users/02c245290c1f41369e246460f67d7c00 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:21:45.051091 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-d6592b5f-2955-4c15-9ec3-3013e76e28dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8bc92050c8e24c5a9ea8e128d70ed61a'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:45.053039 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-d6592b5f-2955-4c15-9ec3-3013e76e28dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8bc92050c8e24c5a9ea8e128d70ed61a'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:45.066175 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 984/1981] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 31 00:21:44 2022] DELETE /identity/v3/users/8bc92050c8e24c5a9ea8e128d70ed61a => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:21:45.582597 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d82f7dc-8fe6-4e28-a4ca-781fdfa435eb admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:45.584628 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-9d82f7dc-8fe6-4e28-a4ca-781fdfa435eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:45.717030 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:45.725774 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d82f7dc-8fe6-4e28-a4ca-781fdfa435eb admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:45.823030 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2de9b84-2cba-4726-a313-a0aeef2061d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:45.824774 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2de9b84-2cba-4726-a313-a0aeef2061d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:45.825361 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2de9b84-2cba-4726-a313-a0aeef2061d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:45.825777 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2de9b84-2cba-4726-a313-a0aeef2061d4 admin admin] PATH_INFO: `/v3/projects/d8a89b2e8508444489fe0d0ad1036fbb` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:45.827536 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2de9b84-2cba-4726-a313-a0aeef2061d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8a89b2e8508444489fe0d0ad1036fbb)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:45.830628 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2de9b84-2cba-4726-a313-a0aeef2061d4 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:45.918632 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-a2de9b84-2cba-4726-a313-a0aeef2061d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8a89b2e8508444489fe0d0ad1036fbb', 'request_id': 'req-a2de9b84-2cba-4726-a313-a0aeef2061d4'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:45.928280 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-a2de9b84-2cba-4726-a313-a0aeef2061d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8a89b2e8508444489fe0d0ad1036fbb', 'request_id': 'req-a2de9b84-2cba-4726-a313-a0aeef2061d4'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:45.936758 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-a2de9b84-2cba-4726-a313-a0aeef2061d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8a89b2e8508444489fe0d0ad1036fbb', 'request_id': 'req-a2de9b84-2cba-4726-a313-a0aeef2061d4'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:45.960544 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-a2de9b84-2cba-4726-a313-a0aeef2061d4 admin admin] The token cache is being invalidate because project d8a89b2e8508444489fe0d0ad1036fbb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:21:45.961045 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-a2de9b84-2cba-4726-a313-a0aeef2061d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:45.962149 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-a2de9b84-2cba-4726-a313-a0aeef2061d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:45.965431 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 998/1982] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 31 00:21:45 2022] DELETE /identity/v3/projects/d8a89b2e8508444489fe0d0ad1036fbb => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:21:45.972099 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a980aa-dfc3-42e4-9e97-2f321bfed32e None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:45.973638 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a980aa-dfc3-42e4-9e97-2f321bfed32e None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:45.973638 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a980aa-dfc3-42e4-9e97-2f321bfed32e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:46.013266 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-01a980aa-dfc3-42e4-9e97-2f321bfed32e None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:21:46.015446 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-01a980aa-dfc3-42e4-9e97-2f321bfed32e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:46.054328 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2de9b84-2cba-4726-a313-a0aeef2061d4 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:46.058423 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-a2de9b84-2cba-4726-a313-a0aeef2061d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:46.147483 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 985/1983] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:21:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:21:46.161652 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687e3ce0-34a7-4243-9a17-b3355d89691d None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:46.162544 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687e3ce0-34a7-4243-9a17-b3355d89691d None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:46.163060 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687e3ce0-34a7-4243-9a17-b3355d89691d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:46.202707 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-687e3ce0-34a7-4243-9a17-b3355d89691d None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:21:46.205167 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-687e3ce0-34a7-4243-9a17-b3355d89691d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:46.220194 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 986/1984] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:21:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:21:46.227299 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687e3ce0-34a7-4243-9a17-b3355d89691d None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:46.242473 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687e3ce0-34a7-4243-9a17-b3355d89691d None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:46.249987 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2de9b84-2cba-4726-a313-a0aeef2061d4 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:46.252919 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd456bd1-ba23-4a29-b9f0-5c2c98ae1b6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:46.253732 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd456bd1-ba23-4a29-b9f0-5c2c98ae1b6f admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:46.254016 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd456bd1-ba23-4a29-b9f0-5c2c98ae1b6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:46.254430 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd456bd1-ba23-4a29-b9f0-5c2c98ae1b6f admin admin] PATH_INFO: `/v3/domains` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:46.255516 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd456bd1-ba23-4a29-b9f0-5c2c98ae1b6f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:21:46.255823 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd456bd1-ba23-4a29-b9f0-5c2c98ae1b6f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:46.257693 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd456bd1-ba23-4a29-b9f0-5c2c98ae1b6f admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:46.264622 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83528bd4-d854-4c5f-be88-9dffa9ebbe57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:46.267489 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83528bd4-d854-4c5f-be88-9dffa9ebbe57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:46.270642 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83528bd4-d854-4c5f-be88-9dffa9ebbe57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:46.271488 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83528bd4-d854-4c5f-be88-9dffa9ebbe57 admin admin] PATH_INFO: `/v3/projects/0425eff2e2234b8180870054a63a1413` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:46.277087 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 987/1985] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 31 00:21:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:21:46.281538 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd456bd1-ba23-4a29-b9f0-5c2c98ae1b6f admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:46.282121 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83528bd4-d854-4c5f-be88-9dffa9ebbe57 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0425eff2e2234b8180870054a63a1413)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:46.286990 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83528bd4-d854-4c5f-be88-9dffa9ebbe57 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:46.294583 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd456bd1-ba23-4a29-b9f0-5c2c98ae1b6f admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:46.300254 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28e92fd-9cec-4cb0-a196-d9fc088a5c45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:46.301629 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28e92fd-9cec-4cb0-a196-d9fc088a5c45 admin admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:46.301900 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28e92fd-9cec-4cb0-a196-d9fc088a5c45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:46.302159 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28e92fd-9cec-4cb0-a196-d9fc088a5c45 admin admin] PATH_INFO: `/v3/projects` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:46.303617 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28e92fd-9cec-4cb0-a196-d9fc088a5c45 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:46.306017 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28e92fd-9cec-4cb0-a196-d9fc088a5c45 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:46.311441 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:46.362951 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 988/1986] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 31 00:21:46 2022] POST /identity/v3/projects => generated 373 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:21:46.367511 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28e92fd-9cec-4cb0-a196-d9fc088a5c45 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:46.377480 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:46.409410 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-83528bd4-d854-4c5f-be88-9dffa9ebbe57 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0425eff2e2234b8180870054a63a1413', 'request_id': 'req-83528bd4-d854-4c5f-be88-9dffa9ebbe57'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:46.425222 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-83528bd4-d854-4c5f-be88-9dffa9ebbe57 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0425eff2e2234b8180870054a63a1413', 'request_id': 'req-83528bd4-d854-4c5f-be88-9dffa9ebbe57'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:46.438427 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-83528bd4-d854-4c5f-be88-9dffa9ebbe57 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0425eff2e2234b8180870054a63a1413', 'request_id': 'req-83528bd4-d854-4c5f-be88-9dffa9ebbe57'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:46.466595 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28e92fd-9cec-4cb0-a196-d9fc088a5c45 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:46.467285 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-83528bd4-d854-4c5f-be88-9dffa9ebbe57 admin admin] The token cache is being invalidate because project 0425eff2e2234b8180870054a63a1413 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:21:46.468096 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-83528bd4-d854-4c5f-be88-9dffa9ebbe57 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:46.470259 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-83528bd4-d854-4c5f-be88-9dffa9ebbe57 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:46.474509 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 999/1987] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 31 00:21:46 2022] DELETE /identity/v3/projects/0425eff2e2234b8180870054a63a1413 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:21:46.482396 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767e6f2b-149e-4640-8a95-5f77900a6b1e None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:46.482566 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767e6f2b-149e-4640-8a95-5f77900a6b1e None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:46.482957 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767e6f2b-149e-4640-8a95-5f77900a6b1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:46.532954 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-767e6f2b-149e-4640-8a95-5f77900a6b1e None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:21:46.535161 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-767e6f2b-149e-4640-8a95-5f77900a6b1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:46.601807 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d207d710-c24c-4665-b1cd-b383bfef5264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:46.603050 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d207d710-c24c-4665-b1cd-b383bfef5264 admin admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:46.603893 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d207d710-c24c-4665-b1cd-b383bfef5264 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:46.604697 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d207d710-c24c-4665-b1cd-b383bfef5264 admin admin] PATH_INFO: `/v3/users` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:46.609546 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d207d710-c24c-4665-b1cd-b383bfef5264 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:46.611315 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d207d710-c24c-4665-b1cd-b383bfef5264 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:46.640130 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1000/1988] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:21:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:21:46.655357 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1a0f50-71ff-4a2d-b670-f50c247af50e None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:46.655914 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1a0f50-71ff-4a2d-b670-f50c247af50e None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:46.656409 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1a0f50-71ff-4a2d-b670-f50c247af50e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:46.673523 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 989/1989] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 31 00:21:46 2022] POST /identity/v3/users => generated 287 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:21:46.674876 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d207d710-c24c-4665-b1cd-b383bfef5264 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:46.683492 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-d207d710-c24c-4665-b1cd-b383bfef5264 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:46.696906 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d207d710-c24c-4665-b1cd-b383bfef5264 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:46.698421 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-1d1a0f50-71ff-4a2d-b670-f50c247af50e None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:21:46.700345 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-1d1a0f50-71ff-4a2d-b670-f50c247af50e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:46.717844 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1001/1990] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:21:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:21:46.724531 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1a0f50-71ff-4a2d-b670-f50c247af50e None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:46.726617 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c038acd-5e13-4be4-8244-bb120d994b73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:46.727465 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c038acd-5e13-4be4-8244-bb120d994b73 admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:46.727915 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c038acd-5e13-4be4-8244-bb120d994b73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:46.728666 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c038acd-5e13-4be4-8244-bb120d994b73 admin admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:46.729801 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c038acd-5e13-4be4-8244-bb120d994b73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:46.732942 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c038acd-5e13-4be4-8244-bb120d994b73 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:46.734922 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1a0f50-71ff-4a2d-b670-f50c247af50e None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:46.742278 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c33f3ba-5ffe-44f8-97d9-069894751f30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:46.742928 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c33f3ba-5ffe-44f8-97d9-069894751f30 admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:46.743361 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c33f3ba-5ffe-44f8-97d9-069894751f30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:46.743521 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c33f3ba-5ffe-44f8-97d9-069894751f30 admin admin] PATH_INFO: `/v3/domains` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:46.744191 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c33f3ba-5ffe-44f8-97d9-069894751f30 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:21:46.744488 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c33f3ba-5ffe-44f8-97d9-069894751f30 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:46.746271 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c33f3ba-5ffe-44f8-97d9-069894751f30 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:46.751399 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 990/1991] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 00:21:46 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:21:46.753095 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c038acd-5e13-4be4-8244-bb120d994b73 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:46.756110 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-0c038acd-5e13-4be4-8244-bb120d994b73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:46.765298 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1002/1992] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 31 00:21:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:21:46.766031 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c33f3ba-5ffe-44f8-97d9-069894751f30 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:46.781247 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c33f3ba-5ffe-44f8-97d9-069894751f30 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:46.788979 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890c9bb8-c00d-4bca-b647-f79a943cda91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:46.790480 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890c9bb8-c00d-4bca-b647-f79a943cda91 admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:46.790957 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890c9bb8-c00d-4bca-b647-f79a943cda91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:46.791703 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890c9bb8-c00d-4bca-b647-f79a943cda91 admin admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:46.792426 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890c9bb8-c00d-4bca-b647-f79a943cda91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:46.794322 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890c9bb8-c00d-4bca-b647-f79a943cda91 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:46.819326 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1003/1993] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 00:21:46 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:21:46.821147 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890c9bb8-c00d-4bca-b647-f79a943cda91 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:46.842704 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890c9bb8-c00d-4bca-b647-f79a943cda91 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:46.851385 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc056c5f-d943-446e-95d9-74e75cad9e04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:46.852449 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc056c5f-d943-446e-95d9-74e75cad9e04 admin admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:46.852911 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc056c5f-d943-446e-95d9-74e75cad9e04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:46.853609 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc056c5f-d943-446e-95d9-74e75cad9e04 admin admin] PATH_INFO: `/v3/projects` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:46.854708 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc056c5f-d943-446e-95d9-74e75cad9e04 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:46.858459 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc056c5f-d943-446e-95d9-74e75cad9e04 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:46.878883 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c038acd-5e13-4be4-8244-bb120d994b73 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:46.885881 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45f1837-3c36-46a7-a7fe-d91e39d31c62 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beecda6e9feb400288618745c784989f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:46.886940 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45f1837-3c36-46a7-a7fe-d91e39d31c62 service cinder] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:46.887562 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45f1837-3c36-46a7-a7fe-d91e39d31c62 service cinder] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:46.888105 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45f1837-3c36-46a7-a7fe-d91e39d31c62 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:46.891113 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-c45f1837-3c36-46a7-a7fe-d91e39d31c62 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:46.912482 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1004/1994] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 31 00:21:46 2022] POST /identity/v3/projects => generated 367 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:21:46.917481 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc056c5f-d943-446e-95d9-74e75cad9e04 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:46.970899 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:47.058193 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45f1837-3c36-46a7-a7fe-d91e39d31c62 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:47.060487 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45f1837-3c36-46a7-a7fe-d91e39d31c62 service cinder] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:47.068739 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc056c5f-d943-446e-95d9-74e75cad9e04 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:47.075722 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c39495-4037-46ac-b40e-3a1f8360b168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:47.076992 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c39495-4037-46ac-b40e-3a1f8360b168 admin admin] REQUEST_METHOD: `PUT` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:47.077182 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 991/1995] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:21:46 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:21:47.077840 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45f1837-3c36-46a7-a7fe-d91e39d31c62 service cinder] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:47.087985 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c39495-4037-46ac-b40e-3a1f8360b168 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:47.088740 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c39495-4037-46ac-b40e-3a1f8360b168 admin admin] PATH_INFO: `/v3/projects/62bf9962e6544c2c9fb8f24997fedc2e/users/89a0c31b91524259859882534d27d562/roles/fdad79ffbcbb4fa380dc9cf7dd108618` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:47.093875 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45f1837-3c36-46a7-a7fe-d91e39d31c62 service cinder] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:47.101811 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6819c8ee-75e5-455e-bb29-94bb66860fde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:47.104876 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6819c8ee-75e5-455e-bb29-94bb66860fde admin admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:47.104876 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6819c8ee-75e5-455e-bb29-94bb66860fde admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:47.104876 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6819c8ee-75e5-455e-bb29-94bb66860fde admin admin] PATH_INFO: `/v3/users` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:47.104876 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6819c8ee-75e5-455e-bb29-94bb66860fde admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:47.106283 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6819c8ee-75e5-455e-bb29-94bb66860fde admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:47.122129 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c39495-4037-46ac-b40e-3a1f8360b168 admin admin] RBAC: Authorizing `identity:create_grant(project_id=62bf9962e6544c2c9fb8f24997fedc2e, user_id=89a0c31b91524259859882534d27d562, role_id=fdad79ffbcbb4fa380dc9cf7dd108618)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:47.127511 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c39495-4037-46ac-b40e-3a1f8360b168 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:47.131713 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:DELETE=5,keystone:SELECT=93,keystone:INSERT=2 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:47.136106 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 992/1996] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 31 00:21:47 2022] POST /identity/v3/users => generated 284 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:21:47.140836 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6819c8ee-75e5-455e-bb29-94bb66860fde admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:47.160334 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1005/1997] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 00:21:46 2022] PUT /identity/v3/projects/62bf9962e6544c2c9fb8f24997fedc2e/users/89a0c31b91524259859882534d27d562/roles/fdad79ffbcbb4fa380dc9cf7dd108618 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:21:47.162650 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6819c8ee-75e5-455e-bb29-94bb66860fde admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:47.173672 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44f8d84-4b2a-479f-aed7-d585b51f2558 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:47.174019 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44f8d84-4b2a-479f-aed7-d585b51f2558 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:47.174380 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44f8d84-4b2a-479f-aed7-d585b51f2558 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:47.218153 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-d44f8d84-4b2a-479f-aed7-d585b51f2558 None None] MFA Rules not processed for user `89a0c31b91524259859882534d27d562`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:21:47.219553 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-d44f8d84-4b2a-479f-aed7-d585b51f2558 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:47.250299 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3525ad2-318d-4e64-bf1d-10a652b2513c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:47.251390 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3525ad2-318d-4e64-bf1d-10a652b2513c admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:47.251896 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3525ad2-318d-4e64-bf1d-10a652b2513c admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:47.252637 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3525ad2-318d-4e64-bf1d-10a652b2513c admin admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:47.253540 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3525ad2-318d-4e64-bf1d-10a652b2513c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:47.256438 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3525ad2-318d-4e64-bf1d-10a652b2513c admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:47.281307 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 993/1998] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 00:21:47 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:21:47.291995 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3525ad2-318d-4e64-bf1d-10a652b2513c admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:47.313001 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3525ad2-318d-4e64-bf1d-10a652b2513c admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:47.324394 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21368f91-c421-44be-a411-ab5e3fcb38e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:47.329042 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21368f91-c421-44be-a411-ab5e3fcb38e3 admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:47.330107 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21368f91-c421-44be-a411-ab5e3fcb38e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:47.330845 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21368f91-c421-44be-a411-ab5e3fcb38e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:47.333934 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21368f91-c421-44be-a411-ab5e3fcb38e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:47.337881 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21368f91-c421-44be-a411-ab5e3fcb38e3 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:47.355304 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1006/1999] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:21:47 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:21:47.365615 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 994/2000] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 00:21:47 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:21:47.369999 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44f8d84-4b2a-479f-aed7-d585b51f2558 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:47.378701 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21368f91-c421-44be-a411-ab5e3fcb38e3 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:47.383337 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-21368f91-c421-44be-a411-ab5e3fcb38e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:47.403597 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44f8d84-4b2a-479f-aed7-d585b51f2558 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:47.409298 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffaa6f1-29b7-40a9-b824-a528c5d91c9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:47.410008 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffaa6f1-29b7-40a9-b824-a528c5d91c9e admin admin] REQUEST_METHOD: `PUT` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:47.410312 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffaa6f1-29b7-40a9-b824-a528c5d91c9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:47.411283 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffaa6f1-29b7-40a9-b824-a528c5d91c9e admin admin] PATH_INFO: `/v3/projects/075279c216eb43b2a3a0d12dbd14cf63/users/b5de6d1ff4cc47ee90b25d974856b81e/roles/fdad79ffbcbb4fa380dc9cf7dd108618` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:47.443797 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffaa6f1-29b7-40a9-b824-a528c5d91c9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=075279c216eb43b2a3a0d12dbd14cf63, user_id=b5de6d1ff4cc47ee90b25d974856b81e, role_id=fdad79ffbcbb4fa380dc9cf7dd108618)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:47.448317 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffaa6f1-29b7-40a9-b824-a528c5d91c9e admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:47.471294 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1007/2001] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 00:21:47 2022] PUT /identity/v3/projects/075279c216eb43b2a3a0d12dbd14cf63/users/b5de6d1ff4cc47ee90b25d974856b81e/roles/fdad79ffbcbb4fa380dc9cf7dd108618 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:21:47.485505 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1328c9-10f4-45e8-86be-028ec82a2cf0 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:47.485905 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1328c9-10f4-45e8-86be-028ec82a2cf0 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:47.486200 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1328c9-10f4-45e8-86be-028ec82a2cf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:47.519269 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21368f91-c421-44be-a411-ab5e3fcb38e3 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:47.560646 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-df1328c9-10f4-45e8-86be-028ec82a2cf0 None None] MFA Rules not processed for user `b5de6d1ff4cc47ee90b25d974856b81e`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:21:47.563048 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-df1328c9-10f4-45e8-86be-028ec82a2cf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:47.592629 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:47.612732 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df21a99d-8d32-408e-aa4c-eb71949e00e1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beecda6e9feb400288618745c784989f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:47.614378 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df21a99d-8d32-408e-aa4c-eb71949e00e1 service cinder] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:47.615166 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df21a99d-8d32-408e-aa4c-eb71949e00e1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:47.615946 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df21a99d-8d32-408e-aa4c-eb71949e00e1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:47.752550 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df21a99d-8d32-408e-aa4c-eb71949e00e1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:47.755833 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df21a99d-8d32-408e-aa4c-eb71949e00e1 service cinder] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:47.764781 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1008/2002] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:21:47 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:21:47.789437 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 995/2003] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:21:47 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:21:47.800539 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1328c9-10f4-45e8-86be-028ec82a2cf0 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:47.803996 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-df1328c9-10f4-45e8-86be-028ec82a2cf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:47.828837 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df21a99d-8d32-408e-aa4c-eb71949e00e1 service cinder] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:47.929825 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:47.938470 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1328c9-10f4-45e8-86be-028ec82a2cf0 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:47.948220 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691e483f-5b21-4d49-b9a3-43d9382ac92b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc025521e1dc4c91ab50a8718a87754f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:47.950536 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691e483f-5b21-4d49-b9a3-43d9382ac92b service glance] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:47.951747 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691e483f-5b21-4d49-b9a3-43d9382ac92b service glance] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:47.952524 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691e483f-5b21-4d49-b9a3-43d9382ac92b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:47.963344 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df21a99d-8d32-408e-aa4c-eb71949e00e1 service cinder] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:47.970389 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691e483f-5b21-4d49-b9a3-43d9382ac92b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:47.971867 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c637f9-767b-485f-9579-5183a9cae622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:47.973152 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c637f9-767b-485f-9579-5183a9cae622 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:47.973661 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691e483f-5b21-4d49-b9a3-43d9382ac92b service glance] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:47.973866 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c637f9-767b-485f-9579-5183a9cae622 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:47.974322 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c637f9-767b-485f-9579-5183a9cae622 admin admin] PATH_INFO: `/v3/users/89a0c31b91524259859882534d27d562` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:47.977048 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c637f9-767b-485f-9579-5183a9cae622 admin admin] RBAC: Authorizing `identity:delete_user(user_id=89a0c31b91524259859882534d27d562)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:47.981472 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c637f9-767b-485f-9579-5183a9cae622 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:48.006682 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1009/2004] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:21:47 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:21:48.103909 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-29c637f9-767b-485f-9579-5183a9cae622 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89a0c31b91524259859882534d27d562'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:48.121402 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-29c637f9-767b-485f-9579-5183a9cae622 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89a0c31b91524259859882534d27d562'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:48.137999 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-29c637f9-767b-485f-9579-5183a9cae622 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89a0c31b91524259859882534d27d562'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:48.197198 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-29c637f9-767b-485f-9579-5183a9cae622 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89a0c31b91524259859882534d27d562'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:48.211886 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-29c637f9-767b-485f-9579-5183a9cae622 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89a0c31b91524259859882534d27d562'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:48.234080 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 996/2005] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 31 00:21:47 2022] DELETE /identity/v3/users/89a0c31b91524259859882534d27d562 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:21:48.236326 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf40de1-4b4d-4385-8dbd-620668f72dab None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:48.236621 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf40de1-4b4d-4385-8dbd-620668f72dab None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:48.236902 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf40de1-4b4d-4385-8dbd-620668f72dab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:48.261123 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-9bf40de1-4b4d-4385-8dbd-620668f72dab None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:21:48.262588 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-9bf40de1-4b4d-4385-8dbd-620668f72dab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:48.344779 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1010/2006] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:21:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:21:48.352912 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c637f9-767b-485f-9579-5183a9cae622 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:48.355572 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-29c637f9-767b-485f-9579-5183a9cae622 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:48.384925 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:48.461163 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c637f9-767b-485f-9579-5183a9cae622 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:48.468015 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69699364-1ab6-48a7-99cc-a6fa6193f92e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'daae792cd11d4c4ca7aae0558998aced', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:48.469093 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69699364-1ab6-48a7-99cc-a6fa6193f92e service neutron] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:48.469494 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69699364-1ab6-48a7-99cc-a6fa6193f92e service neutron] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:48.470000 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69699364-1ab6-48a7-99cc-a6fa6193f92e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:48.484593 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69699364-1ab6-48a7-99cc-a6fa6193f92e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:48.486603 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69699364-1ab6-48a7-99cc-a6fa6193f92e service neutron] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:48.504930 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 997/2007] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:21:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:21:48.979564 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf40de1-4b4d-4385-8dbd-620668f72dab None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:48.989387 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-9bf40de1-4b4d-4385-8dbd-620668f72dab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:49.013473 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf40de1-4b4d-4385-8dbd-620668f72dab None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:49.024483 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8829022-0c28-4ce3-b8f5-1b2c7dfbb6d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:49.026792 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8829022-0c28-4ce3-b8f5-1b2c7dfbb6d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:49.027907 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8829022-0c28-4ce3-b8f5-1b2c7dfbb6d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:49.029093 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8829022-0c28-4ce3-b8f5-1b2c7dfbb6d2 admin admin] PATH_INFO: `/v3/projects/62bf9962e6544c2c9fb8f24997fedc2e` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:49.031725 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8829022-0c28-4ce3-b8f5-1b2c7dfbb6d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=62bf9962e6544c2c9fb8f24997fedc2e)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:49.034089 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8829022-0c28-4ce3-b8f5-1b2c7dfbb6d2 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:49.172603 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-b8829022-0c28-4ce3-b8f5-1b2c7dfbb6d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62bf9962e6544c2c9fb8f24997fedc2e', 'request_id': 'req-b8829022-0c28-4ce3-b8f5-1b2c7dfbb6d2'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:49.189778 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-b8829022-0c28-4ce3-b8f5-1b2c7dfbb6d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62bf9962e6544c2c9fb8f24997fedc2e', 'request_id': 'req-b8829022-0c28-4ce3-b8f5-1b2c7dfbb6d2'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:49.207490 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-b8829022-0c28-4ce3-b8f5-1b2c7dfbb6d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62bf9962e6544c2c9fb8f24997fedc2e', 'request_id': 'req-b8829022-0c28-4ce3-b8f5-1b2c7dfbb6d2'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:49.230663 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-b8829022-0c28-4ce3-b8f5-1b2c7dfbb6d2 admin admin] The token cache is being invalidate because project 62bf9962e6544c2c9fb8f24997fedc2e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:21:49.231103 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-b8829022-0c28-4ce3-b8f5-1b2c7dfbb6d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:49.232292 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-b8829022-0c28-4ce3-b8f5-1b2c7dfbb6d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:49.233943 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1011/2008] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 31 00:21:48 2022] DELETE /identity/v3/projects/62bf9962e6544c2c9fb8f24997fedc2e => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:21:51.216634 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69699364-1ab6-48a7-99cc-a6fa6193f92e service neutron] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:51.218577 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-69699364-1ab6-48a7-99cc-a6fa6193f92e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:51.243907 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69699364-1ab6-48a7-99cc-a6fa6193f92e service neutron] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:51.358003 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5abe0d5-e5d4-4909-b715-65393c0b87f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:51.359148 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5abe0d5-e5d4-4909-b715-65393c0b87f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:51.359730 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5abe0d5-e5d4-4909-b715-65393c0b87f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:51.360258 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5abe0d5-e5d4-4909-b715-65393c0b87f3 admin admin] PATH_INFO: `/v3/users/2ae7c3709577481b8661ccd80369bd4a` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:51.362661 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5abe0d5-e5d4-4909-b715-65393c0b87f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ae7c3709577481b8661ccd80369bd4a)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:51.367524 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5abe0d5-e5d4-4909-b715-65393c0b87f3 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:51.448390 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-e5abe0d5-e5d4-4909-b715-65393c0b87f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ae7c3709577481b8661ccd80369bd4a'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:51.457743 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-e5abe0d5-e5d4-4909-b715-65393c0b87f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ae7c3709577481b8661ccd80369bd4a'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:51.467991 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-e5abe0d5-e5d4-4909-b715-65393c0b87f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ae7c3709577481b8661ccd80369bd4a'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:51.486181 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-e5abe0d5-e5d4-4909-b715-65393c0b87f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ae7c3709577481b8661ccd80369bd4a'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:51.487186 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-e5abe0d5-e5d4-4909-b715-65393c0b87f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ae7c3709577481b8661ccd80369bd4a'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:51.499252 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 998/2009] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 31 00:21:51 2022] DELETE /identity/v3/users/2ae7c3709577481b8661ccd80369bd4a => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:21:51.709220 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8829022-0c28-4ce3-b8f5-1b2c7dfbb6d2 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:51.711692 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-b8829022-0c28-4ce3-b8f5-1b2c7dfbb6d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:51.751216 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8829022-0c28-4ce3-b8f5-1b2c7dfbb6d2 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:51.860648 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df35fc3-5c46-4426-9996-04908e44b609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:51.862173 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df35fc3-5c46-4426-9996-04908e44b609 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:51.862362 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df35fc3-5c46-4426-9996-04908e44b609 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:51.862875 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df35fc3-5c46-4426-9996-04908e44b609 admin admin] PATH_INFO: `/v3/projects/d3406349e71d4d96bd33248ce77d5066` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:51.866003 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df35fc3-5c46-4426-9996-04908e44b609 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3406349e71d4d96bd33248ce77d5066)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:51.869758 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df35fc3-5c46-4426-9996-04908e44b609 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:51.893360 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:51.933388 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-6df35fc3-5c46-4426-9996-04908e44b609 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3406349e71d4d96bd33248ce77d5066', 'request_id': 'req-6df35fc3-5c46-4426-9996-04908e44b609'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:51.941944 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-6df35fc3-5c46-4426-9996-04908e44b609 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3406349e71d4d96bd33248ce77d5066', 'request_id': 'req-6df35fc3-5c46-4426-9996-04908e44b609'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:51.951299 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-6df35fc3-5c46-4426-9996-04908e44b609 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3406349e71d4d96bd33248ce77d5066', 'request_id': 'req-6df35fc3-5c46-4426-9996-04908e44b609'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:51.971911 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-6df35fc3-5c46-4426-9996-04908e44b609 admin admin] The token cache is being invalidate because project d3406349e71d4d96bd33248ce77d5066 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:21:51.971911 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-6df35fc3-5c46-4426-9996-04908e44b609 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:51.973216 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-6df35fc3-5c46-4426-9996-04908e44b609 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:51.975361 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1012/2010] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 31 00:21:51 2022] DELETE /identity/v3/projects/d3406349e71d4d96bd33248ce77d5066 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:21:51.984180 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a8965e-0063-464a-9d1c-6dbb3c45f6cc None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:51.984708 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a8965e-0063-464a-9d1c-6dbb3c45f6cc None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:51.985180 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a8965e-0063-464a-9d1c-6dbb3c45f6cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:52.028741 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-09a8965e-0063-464a-9d1c-6dbb3c45f6cc None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:21:52.030248 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-09a8965e-0063-464a-9d1c-6dbb3c45f6cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:52.088287 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:52.141065 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 999/2011] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:21:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:21:52.151471 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02017678-bad1-4422-8fb8-b75b0210a324 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:52.151756 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02017678-bad1-4422-8fb8-b75b0210a324 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:52.152088 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02017678-bad1-4422-8fb8-b75b0210a324 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:52.175337 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-02017678-bad1-4422-8fb8-b75b0210a324 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:21:52.178701 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-02017678-bad1-4422-8fb8-b75b0210a324 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:52.198427 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1013/2012] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:21:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:21:52.199904 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a8965e-0063-464a-9d1c-6dbb3c45f6cc None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:52.213863 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a8965e-0063-464a-9d1c-6dbb3c45f6cc None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:52.220086 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9629f498-6d60-4d54-9cd5-6a09c3c15d96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:52.221273 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9629f498-6d60-4d54-9cd5-6a09c3c15d96 admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:52.221273 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9629f498-6d60-4d54-9cd5-6a09c3c15d96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:52.221583 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9629f498-6d60-4d54-9cd5-6a09c3c15d96 admin admin] PATH_INFO: `/v3/domains` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:52.222177 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9629f498-6d60-4d54-9cd5-6a09c3c15d96 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:21:52.222522 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9629f498-6d60-4d54-9cd5-6a09c3c15d96 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:52.225037 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9629f498-6d60-4d54-9cd5-6a09c3c15d96 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:52.241938 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1000/2013] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 31 00:21:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:21:52.247358 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02017678-bad1-4422-8fb8-b75b0210a324 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:52.265828 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02017678-bad1-4422-8fb8-b75b0210a324 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:52.275436 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef8ca4d-758c-4840-9496-ae57b9726af4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:52.276531 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef8ca4d-758c-4840-9496-ae57b9726af4 admin admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:52.277020 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef8ca4d-758c-4840-9496-ae57b9726af4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:52.277504 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef8ca4d-758c-4840-9496-ae57b9726af4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:52.278712 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef8ca4d-758c-4840-9496-ae57b9726af4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:52.282762 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef8ca4d-758c-4840-9496-ae57b9726af4 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:52.344444 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1014/2014] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 31 00:21:52 2022] POST /identity/v3/projects => generated 383 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:21:52.344612 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9629f498-6d60-4d54-9cd5-6a09c3c15d96 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:52.359896 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9629f498-6d60-4d54-9cd5-6a09c3c15d96 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:52.432437 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a379e08c-f985-4a64-8285-659672f41bfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:52.433414 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a379e08c-f985-4a64-8285-659672f41bfb admin admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:52.433793 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a379e08c-f985-4a64-8285-659672f41bfb admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:52.434181 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a379e08c-f985-4a64-8285-659672f41bfb admin admin] PATH_INFO: `/v3/users` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:52.435165 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a379e08c-f985-4a64-8285-659672f41bfb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:52.437558 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a379e08c-f985-4a64-8285-659672f41bfb admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:52.464332 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1001/2015] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 31 00:21:52 2022] POST /identity/v3/users => generated 292 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:21:52.469849 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef8ca4d-758c-4840-9496-ae57b9726af4 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:52.491197 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef8ca4d-758c-4840-9496-ae57b9726af4 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:52.502324 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998f0322-d596-4304-aebf-c65891734077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:52.503260 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998f0322-d596-4304-aebf-c65891734077 admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:52.503837 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998f0322-d596-4304-aebf-c65891734077 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:52.504706 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998f0322-d596-4304-aebf-c65891734077 admin admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:52.505939 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998f0322-d596-4304-aebf-c65891734077 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:52.507702 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998f0322-d596-4304-aebf-c65891734077 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:52.522602 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1015/2016] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 00:21:52 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:21:52.527391 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a379e08c-f985-4a64-8285-659672f41bfb admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:52.539902 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a379e08c-f985-4a64-8285-659672f41bfb admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:52.546826 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58de63a-daa7-4f62-aab7-a49d8f0d8923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:52.547535 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58de63a-daa7-4f62-aab7-a49d8f0d8923 admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:52.547837 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58de63a-daa7-4f62-aab7-a49d8f0d8923 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:52.548074 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58de63a-daa7-4f62-aab7-a49d8f0d8923 admin admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:52.548801 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58de63a-daa7-4f62-aab7-a49d8f0d8923 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:52.550480 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58de63a-daa7-4f62-aab7-a49d8f0d8923 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:52.563363 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1002/2017] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 00:21:52 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 00:21:52.569145 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998f0322-d596-4304-aebf-c65891734077 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:52.580362 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998f0322-d596-4304-aebf-c65891734077 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:52.586137 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b2d191-7351-4cd9-943a-9ff6239f1643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:52.586823 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b2d191-7351-4cd9-943a-9ff6239f1643 admin admin] REQUEST_METHOD: `PUT` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:52.587103 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b2d191-7351-4cd9-943a-9ff6239f1643 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:52.587379 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b2d191-7351-4cd9-943a-9ff6239f1643 admin admin] PATH_INFO: `/v3/projects/87fb5fe2d3e84551aeb13c1999d9c7e5/users/e91d3b6d368d4ada956e63c0faf2d09b/roles/fdad79ffbcbb4fa380dc9cf7dd108618` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:52.606536 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b2d191-7351-4cd9-943a-9ff6239f1643 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87fb5fe2d3e84551aeb13c1999d9c7e5, user_id=e91d3b6d368d4ada956e63c0faf2d09b, role_id=fdad79ffbcbb4fa380dc9cf7dd108618)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:52.609539 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b2d191-7351-4cd9-943a-9ff6239f1643 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:52.625604 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1016/2018] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 00:21:52 2022] PUT /identity/v3/projects/87fb5fe2d3e84551aeb13c1999d9c7e5/users/e91d3b6d368d4ada956e63c0faf2d09b/roles/fdad79ffbcbb4fa380dc9cf7dd108618 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:21:52.638121 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a074ee-de9e-42de-85dd-f15f45192ea6 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:52.638616 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a074ee-de9e-42de-85dd-f15f45192ea6 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:52.639140 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a074ee-de9e-42de-85dd-f15f45192ea6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:52.692602 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-99a074ee-de9e-42de-85dd-f15f45192ea6 None None] MFA Rules not processed for user `e91d3b6d368d4ada956e63c0faf2d09b`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:21:52.693983 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-99a074ee-de9e-42de-85dd-f15f45192ea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:52.770239 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1003/2019] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:21:52 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:21:52.782763 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b2d191-7351-4cd9-943a-9ff6239f1643 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:52.784647 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-97b2d191-7351-4cd9-943a-9ff6239f1643 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:52.886589 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b2d191-7351-4cd9-943a-9ff6239f1643 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:52.893941 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b6fbc2-6ebf-45cf-8d67-761c6e365df7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea002bf49c248dbae7147665fa10fd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:52.894656 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b6fbc2-6ebf-45cf-8d67-761c6e365df7 service nova] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:52.894933 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b6fbc2-6ebf-45cf-8d67-761c6e365df7 service nova] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:52.895253 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b6fbc2-6ebf-45cf-8d67-761c6e365df7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:52.904559 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b6fbc2-6ebf-45cf-8d67-761c6e365df7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:52.906265 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b6fbc2-6ebf-45cf-8d67-761c6e365df7 service nova] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:52.917839 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1017/2020] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:21:52 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 00:21:53.093838 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a074ee-de9e-42de-85dd-f15f45192ea6 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:53.097039 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-99a074ee-de9e-42de-85dd-f15f45192ea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:53.170126 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:53.229307 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a074ee-de9e-42de-85dd-f15f45192ea6 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:53.235903 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5711459d-fe9d-4858-9188-cda950ab2e96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:53.236833 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5711459d-fe9d-4858-9188-cda950ab2e96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:53.237148 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5711459d-fe9d-4858-9188-cda950ab2e96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:53.237550 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5711459d-fe9d-4858-9188-cda950ab2e96 admin admin] PATH_INFO: `/v3/users/bb8cc60d206649eabeb3aee48f977569` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:53.239523 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5711459d-fe9d-4858-9188-cda950ab2e96 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb8cc60d206649eabeb3aee48f977569)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:53.241770 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5711459d-fe9d-4858-9188-cda950ab2e96 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:53.308492 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-5711459d-fe9d-4858-9188-cda950ab2e96 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb8cc60d206649eabeb3aee48f977569'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:53.320848 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-5711459d-fe9d-4858-9188-cda950ab2e96 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb8cc60d206649eabeb3aee48f977569'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:53.336951 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-5711459d-fe9d-4858-9188-cda950ab2e96 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb8cc60d206649eabeb3aee48f977569'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:53.384220 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-5711459d-fe9d-4858-9188-cda950ab2e96 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb8cc60d206649eabeb3aee48f977569'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:53.384220 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-5711459d-fe9d-4858-9188-cda950ab2e96 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb8cc60d206649eabeb3aee48f977569'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:53.393450 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1004/2021] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 31 00:21:53 2022] DELETE /identity/v3/users/bb8cc60d206649eabeb3aee48f977569 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:21:53.401645 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e1db36-5830-4a49-9310-78c7e60e0044 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:53.402127 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e1db36-5830-4a49-9310-78c7e60e0044 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:53.402575 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e1db36-5830-4a49-9310-78c7e60e0044 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:53.439202 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-f9e1db36-5830-4a49-9310-78c7e60e0044 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:21:53.441312 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-f9e1db36-5830-4a49-9310-78c7e60e0044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:53.487051 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:53.587293 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1018/2022] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:21:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:21:53.599047 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5711459d-fe9d-4858-9188-cda950ab2e96 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:53.600770 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-5711459d-fe9d-4858-9188-cda950ab2e96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:53.684248 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5711459d-fe9d-4858-9188-cda950ab2e96 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:53.690320 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9043fe3-f711-477e-85ab-f80727af59b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'daae792cd11d4c4ca7aae0558998aced', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:53.691315 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9043fe3-f711-477e-85ab-f80727af59b2 service neutron] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:53.691785 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9043fe3-f711-477e-85ab-f80727af59b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:53.692265 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9043fe3-f711-477e-85ab-f80727af59b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:53.709314 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9043fe3-f711-477e-85ab-f80727af59b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:53.712305 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9043fe3-f711-477e-85ab-f80727af59b2 service neutron] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:53.730633 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1005/2023] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:21:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 00:21:54.084806 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e1db36-5830-4a49-9310-78c7e60e0044 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:54.087170 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-f9e1db36-5830-4a49-9310-78c7e60e0044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:54.115137 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e1db36-5830-4a49-9310-78c7e60e0044 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:54.124281 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c70f25-ccc7-4cd2-96e3-4b5b86ef8e69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:54.124957 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c70f25-ccc7-4cd2-96e3-4b5b86ef8e69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:54.125342 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c70f25-ccc7-4cd2-96e3-4b5b86ef8e69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:54.125639 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c70f25-ccc7-4cd2-96e3-4b5b86ef8e69 admin admin] PATH_INFO: `/v3/projects/c77a949233bf460cbad47d11e374e718` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:54.128317 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c70f25-ccc7-4cd2-96e3-4b5b86ef8e69 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c77a949233bf460cbad47d11e374e718)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:54.132206 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c70f25-ccc7-4cd2-96e3-4b5b86ef8e69 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:54.196526 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-48c70f25-ccc7-4cd2-96e3-4b5b86ef8e69 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c77a949233bf460cbad47d11e374e718', 'request_id': 'req-48c70f25-ccc7-4cd2-96e3-4b5b86ef8e69'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:54.207882 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-48c70f25-ccc7-4cd2-96e3-4b5b86ef8e69 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c77a949233bf460cbad47d11e374e718', 'request_id': 'req-48c70f25-ccc7-4cd2-96e3-4b5b86ef8e69'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:54.215303 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-48c70f25-ccc7-4cd2-96e3-4b5b86ef8e69 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c77a949233bf460cbad47d11e374e718', 'request_id': 'req-48c70f25-ccc7-4cd2-96e3-4b5b86ef8e69'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:54.234313 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-48c70f25-ccc7-4cd2-96e3-4b5b86ef8e69 admin admin] The token cache is being invalidate because project c77a949233bf460cbad47d11e374e718 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:21:54.234817 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-48c70f25-ccc7-4cd2-96e3-4b5b86ef8e69 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:54.235939 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-48c70f25-ccc7-4cd2-96e3-4b5b86ef8e69 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:54.237772 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1019/2024] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 31 00:21:54 2022] DELETE /identity/v3/projects/c77a949233bf460cbad47d11e374e718 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:21:54.242229 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9043fe3-f711-477e-85ab-f80727af59b2 service neutron] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:54.257049 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9043fe3-f711-477e-85ab-f80727af59b2 service neutron] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:54.333602 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:54.342985 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f2ffce-e28e-46db-96a6-c7f2ce83e5bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:54.343909 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f2ffce-e28e-46db-96a6-c7f2ce83e5bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:54.344304 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f2ffce-e28e-46db-96a6-c7f2ce83e5bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:54.344983 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f2ffce-e28e-46db-96a6-c7f2ce83e5bb admin admin] PATH_INFO: `/v3/users/98ce03de40594116bff6d9242ac2c90e` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:54.346580 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f2ffce-e28e-46db-96a6-c7f2ce83e5bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=98ce03de40594116bff6d9242ac2c90e)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:54.350413 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f2ffce-e28e-46db-96a6-c7f2ce83e5bb admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:54.418747 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-90f2ffce-e28e-46db-96a6-c7f2ce83e5bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98ce03de40594116bff6d9242ac2c90e'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:54.428791 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-90f2ffce-e28e-46db-96a6-c7f2ce83e5bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98ce03de40594116bff6d9242ac2c90e'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:54.441296 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-90f2ffce-e28e-46db-96a6-c7f2ce83e5bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98ce03de40594116bff6d9242ac2c90e'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:54.458622 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-90f2ffce-e28e-46db-96a6-c7f2ce83e5bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98ce03de40594116bff6d9242ac2c90e'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:54.459404 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-90f2ffce-e28e-46db-96a6-c7f2ce83e5bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98ce03de40594116bff6d9242ac2c90e'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:54.466512 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1006/2025] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 31 00:21:54 2022] DELETE /identity/v3/users/98ce03de40594116bff6d9242ac2c90e => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:21:54.967947 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c70f25-ccc7-4cd2-96e3-4b5b86ef8e69 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:54.970769 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-48c70f25-ccc7-4cd2-96e3-4b5b86ef8e69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:55.034203 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c70f25-ccc7-4cd2-96e3-4b5b86ef8e69 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:55.146417 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937ce41f-47db-4abe-9399-57dc81351888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:55.147367 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937ce41f-47db-4abe-9399-57dc81351888 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:55.147560 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937ce41f-47db-4abe-9399-57dc81351888 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:55.147966 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937ce41f-47db-4abe-9399-57dc81351888 admin admin] PATH_INFO: `/v3/projects/04818fa374fb460090132bca37216717` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:55.150177 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937ce41f-47db-4abe-9399-57dc81351888 admin admin] RBAC: Authorizing `identity:delete_project(project_id=04818fa374fb460090132bca37216717)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:55.152690 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937ce41f-47db-4abe-9399-57dc81351888 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:55.242460 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-937ce41f-47db-4abe-9399-57dc81351888 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04818fa374fb460090132bca37216717', 'request_id': 'req-937ce41f-47db-4abe-9399-57dc81351888'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:55.246796 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:55.253272 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-937ce41f-47db-4abe-9399-57dc81351888 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04818fa374fb460090132bca37216717', 'request_id': 'req-937ce41f-47db-4abe-9399-57dc81351888'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:55.263688 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-937ce41f-47db-4abe-9399-57dc81351888 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04818fa374fb460090132bca37216717', 'request_id': 'req-937ce41f-47db-4abe-9399-57dc81351888'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:55.281408 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-937ce41f-47db-4abe-9399-57dc81351888 admin admin] The token cache is being invalidate because project 04818fa374fb460090132bca37216717 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:21:55.281752 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-937ce41f-47db-4abe-9399-57dc81351888 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:55.282602 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-937ce41f-47db-4abe-9399-57dc81351888 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:21:55.284230 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1020/2026] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 31 00:21:54 2022] DELETE /identity/v3/projects/04818fa374fb460090132bca37216717 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:21:55.290955 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9979461-f0cb-4769-b67c-8185d3652c68 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:55.291794 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9979461-f0cb-4769-b67c-8185d3652c68 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:55.291951 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9979461-f0cb-4769-b67c-8185d3652c68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:55.317990 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-b9979461-f0cb-4769-b67c-8185d3652c68 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:21:55.317990 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-b9979461-f0cb-4769-b67c-8185d3652c68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:55.402626 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1007/2027] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:21:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:21:55.412733 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c7445b-f845-4c5e-81a5-4d9e51591713 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:55.413080 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c7445b-f845-4c5e-81a5-4d9e51591713 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:55.413394 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c7445b-f845-4c5e-81a5-4d9e51591713 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:55.435960 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-c6c7445b-f845-4c5e-81a5-4d9e51591713 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:21:55.437374 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-c6c7445b-f845-4c5e-81a5-4d9e51591713 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:55.446553 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1021/2028] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:21:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:21:55.451727 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9979461-f0cb-4769-b67c-8185d3652c68 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:55.464435 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9979461-f0cb-4769-b67c-8185d3652c68 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:55.469646 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7d3670-4630-401f-9de1-57cb1a20da8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:55.470327 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7d3670-4630-401f-9de1-57cb1a20da8a admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:55.470643 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7d3670-4630-401f-9de1-57cb1a20da8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:55.470952 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7d3670-4630-401f-9de1-57cb1a20da8a admin admin] PATH_INFO: `/v3/domains` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:55.471664 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7d3670-4630-401f-9de1-57cb1a20da8a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:21:55.472028 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7d3670-4630-401f-9de1-57cb1a20da8a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:55.473892 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7d3670-4630-401f-9de1-57cb1a20da8a admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:55.489273 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1008/2029] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 31 00:21:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:21:55.494292 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c7445b-f845-4c5e-81a5-4d9e51591713 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:55.508908 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c7445b-f845-4c5e-81a5-4d9e51591713 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:55.517471 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d3e065-f177-4c4f-90fc-190354ac8df5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:55.518549 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d3e065-f177-4c4f-90fc-190354ac8df5 admin admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:55.519049 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d3e065-f177-4c4f-90fc-190354ac8df5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:55.520229 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d3e065-f177-4c4f-90fc-190354ac8df5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:55.521457 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d3e065-f177-4c4f-90fc-190354ac8df5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:55.526068 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d3e065-f177-4c4f-90fc-190354ac8df5 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:55.570596 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1022/2030] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 31 00:21:55 2022] POST /identity/v3/projects => generated 369 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:21:55.575398 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7d3670-4630-401f-9de1-57cb1a20da8a admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:55.587392 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7d3670-4630-401f-9de1-57cb1a20da8a admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:55.661253 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26f77af-ea31-42a5-beaa-eeb752f20bb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:55.661966 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26f77af-ea31-42a5-beaa-eeb752f20bb1 admin admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:55.662290 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26f77af-ea31-42a5-beaa-eeb752f20bb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:55.662607 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26f77af-ea31-42a5-beaa-eeb752f20bb1 admin admin] PATH_INFO: `/v3/users` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:55.663313 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26f77af-ea31-42a5-beaa-eeb752f20bb1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:55.665425 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26f77af-ea31-42a5-beaa-eeb752f20bb1 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:55.677498 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:21:55.697886 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1009/2031] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 31 00:21:55 2022] POST /identity/v3/users => generated 285 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:21:55.702845 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d3e065-f177-4c4f-90fc-190354ac8df5 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:55.715067 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d3e065-f177-4c4f-90fc-190354ac8df5 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:55.722002 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29bf072-d8bf-40f7-9ae2-b40f9b16e073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:55.723722 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29bf072-d8bf-40f7-9ae2-b40f9b16e073 admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:55.724379 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29bf072-d8bf-40f7-9ae2-b40f9b16e073 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:55.724904 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29bf072-d8bf-40f7-9ae2-b40f9b16e073 admin admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:55.726238 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29bf072-d8bf-40f7-9ae2-b40f9b16e073 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:55.729961 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29bf072-d8bf-40f7-9ae2-b40f9b16e073 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:55.745376 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1023/2032] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 00:21:55 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 00:21:55.749686 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26f77af-ea31-42a5-beaa-eeb752f20bb1 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:55.761437 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26f77af-ea31-42a5-beaa-eeb752f20bb1 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:55.766831 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b141182d-5a76-4358-bba1-0ca36cb7101e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:55.767499 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b141182d-5a76-4358-bba1-0ca36cb7101e admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:55.767811 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b141182d-5a76-4358-bba1-0ca36cb7101e admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:55.768136 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b141182d-5a76-4358-bba1-0ca36cb7101e admin admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:55.768872 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b141182d-5a76-4358-bba1-0ca36cb7101e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:55.771025 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b141182d-5a76-4358-bba1-0ca36cb7101e admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:55.784525 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1010/2033] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 00:21:55 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:21:55.789879 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29bf072-d8bf-40f7-9ae2-b40f9b16e073 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:55.802604 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29bf072-d8bf-40f7-9ae2-b40f9b16e073 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:55.807922 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4df96a-8edc-4d30-b73a-95dbf2a98878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:55.808726 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4df96a-8edc-4d30-b73a-95dbf2a98878 admin admin] REQUEST_METHOD: `PUT` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:55.809087 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4df96a-8edc-4d30-b73a-95dbf2a98878 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:55.809414 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4df96a-8edc-4d30-b73a-95dbf2a98878 admin admin] PATH_INFO: `/v3/projects/b7806f1130cb456399af33f7b72d21aa/users/23b8a48086e141948da4703ad299f671/roles/fdad79ffbcbb4fa380dc9cf7dd108618` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:55.827315 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4df96a-8edc-4d30-b73a-95dbf2a98878 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7806f1130cb456399af33f7b72d21aa, user_id=23b8a48086e141948da4703ad299f671, role_id=fdad79ffbcbb4fa380dc9cf7dd108618)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:55.830147 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4df96a-8edc-4d30-b73a-95dbf2a98878 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:55.847475 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1024/2034] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 00:21:55 2022] PUT /identity/v3/projects/b7806f1130cb456399af33f7b72d21aa/users/23b8a48086e141948da4703ad299f671/roles/fdad79ffbcbb4fa380dc9cf7dd108618 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:21:55.862119 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8579d4d-401d-4e95-8d19-74c4cb42fdde None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:55.862403 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8579d4d-401d-4e95-8d19-74c4cb42fdde None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:55.862680 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8579d4d-401d-4e95-8d19-74c4cb42fdde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:55.911982 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-f8579d4d-401d-4e95-8d19-74c4cb42fdde None None] MFA Rules not processed for user `23b8a48086e141948da4703ad299f671`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:21:55.913096 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-f8579d4d-401d-4e95-8d19-74c4cb42fdde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:55.996577 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1011/2035] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:21:55 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:21:56.012121 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4df96a-8edc-4d30-b73a-95dbf2a98878 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:21:56.014839 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-ff4df96a-8edc-4d30-b73a-95dbf2a98878 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:21:56.139038 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4df96a-8edc-4d30-b73a-95dbf2a98878 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:21:56.146050 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2492ed8-0632-40ab-9ddc-b70e1837340d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc025521e1dc4c91ab50a8718a87754f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:21:56.147116 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2492ed8-0632-40ab-9ddc-b70e1837340d service glance] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:21:56.147724 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2492ed8-0632-40ab-9ddc-b70e1837340d service glance] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:21:56.148096 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2492ed8-0632-40ab-9ddc-b70e1837340d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:21:56.165145 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2492ed8-0632-40ab-9ddc-b70e1837340d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:21:56.167735 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2492ed8-0632-40ab-9ddc-b70e1837340d service glance] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:21:56.184077 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1025/2036] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:21:56 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:22:02.097158 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8579d4d-401d-4e95-8d19-74c4cb42fdde None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:02.097158 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-f8579d4d-401d-4e95-8d19-74c4cb42fdde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:22:02.185599 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8579d4d-401d-4e95-8d19-74c4cb42fdde None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:02.190616 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964f04ff-fdc2-47a6-a8f2-2c6479462e9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:02.191838 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964f04ff-fdc2-47a6-a8f2-2c6479462e9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:02.192138 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964f04ff-fdc2-47a6-a8f2-2c6479462e9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:02.192436 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964f04ff-fdc2-47a6-a8f2-2c6479462e9d admin admin] PATH_INFO: `/v3/users/e91d3b6d368d4ada956e63c0faf2d09b` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:02.193700 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964f04ff-fdc2-47a6-a8f2-2c6479462e9d admin admin] RBAC: Authorizing `identity:delete_user(user_id=e91d3b6d368d4ada956e63c0faf2d09b)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:02.195677 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964f04ff-fdc2-47a6-a8f2-2c6479462e9d admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:02.260807 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-964f04ff-fdc2-47a6-a8f2-2c6479462e9d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e91d3b6d368d4ada956e63c0faf2d09b'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:02.270057 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-964f04ff-fdc2-47a6-a8f2-2c6479462e9d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e91d3b6d368d4ada956e63c0faf2d09b'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:02.279588 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-964f04ff-fdc2-47a6-a8f2-2c6479462e9d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e91d3b6d368d4ada956e63c0faf2d09b'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:02.290529 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:INSERT=2,keystone:SELECT=89,keystone:DELETE=9 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:22:02.297978 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-964f04ff-fdc2-47a6-a8f2-2c6479462e9d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e91d3b6d368d4ada956e63c0faf2d09b'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:02.298956 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-964f04ff-fdc2-47a6-a8f2-2c6479462e9d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e91d3b6d368d4ada956e63c0faf2d09b'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:02.313844 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1012/2037] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 31 00:22:02 2022] DELETE /identity/v3/users/e91d3b6d368d4ada956e63c0faf2d09b => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:22:02.320793 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928ff32d-030c-40f0-a87c-48c39f0517e6 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:02.321601 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928ff32d-030c-40f0-a87c-48c39f0517e6 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:02.322265 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928ff32d-030c-40f0-a87c-48c39f0517e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:02.354240 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-928ff32d-030c-40f0-a87c-48c39f0517e6 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:22:02.356312 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-928ff32d-030c-40f0-a87c-48c39f0517e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:22:02.435696 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1026/2038] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:22:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:22:02.445355 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964f04ff-fdc2-47a6-a8f2-2c6479462e9d admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:02.447256 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-964f04ff-fdc2-47a6-a8f2-2c6479462e9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:22:02.534967 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964f04ff-fdc2-47a6-a8f2-2c6479462e9d admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:02.549984 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fbb806-c12b-4a91-ad62-8082c607554d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'daae792cd11d4c4ca7aae0558998aced', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:02.551125 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fbb806-c12b-4a91-ad62-8082c607554d service neutron] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:02.551611 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fbb806-c12b-4a91-ad62-8082c607554d service neutron] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:02.551981 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fbb806-c12b-4a91-ad62-8082c607554d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:02.563136 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fbb806-c12b-4a91-ad62-8082c607554d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:02.564685 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fbb806-c12b-4a91-ad62-8082c607554d service neutron] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:02.576481 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1013/2039] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:22:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 00:22:02.940083 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928ff32d-030c-40f0-a87c-48c39f0517e6 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:02.943406 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-928ff32d-030c-40f0-a87c-48c39f0517e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:22:02.965970 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928ff32d-030c-40f0-a87c-48c39f0517e6 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:02.974427 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea988347-2207-4d96-ac4c-05df62f77cf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:02.975787 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea988347-2207-4d96-ac4c-05df62f77cf4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:02.976334 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea988347-2207-4d96-ac4c-05df62f77cf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:02.976804 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea988347-2207-4d96-ac4c-05df62f77cf4 admin admin] PATH_INFO: `/v3/projects/87fb5fe2d3e84551aeb13c1999d9c7e5` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:02.979000 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea988347-2207-4d96-ac4c-05df62f77cf4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=87fb5fe2d3e84551aeb13c1999d9c7e5)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:02.987201 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea988347-2207-4d96-ac4c-05df62f77cf4 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:03.024392 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=94,keystone:DELETE=3,keystone:INSERT=3 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:22:03.072102 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-ea988347-2207-4d96-ac4c-05df62f77cf4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87fb5fe2d3e84551aeb13c1999d9c7e5', 'request_id': 'req-ea988347-2207-4d96-ac4c-05df62f77cf4'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:03.083621 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-ea988347-2207-4d96-ac4c-05df62f77cf4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87fb5fe2d3e84551aeb13c1999d9c7e5', 'request_id': 'req-ea988347-2207-4d96-ac4c-05df62f77cf4'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:03.093703 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-ea988347-2207-4d96-ac4c-05df62f77cf4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87fb5fe2d3e84551aeb13c1999d9c7e5', 'request_id': 'req-ea988347-2207-4d96-ac4c-05df62f77cf4'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:03.116659 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-ea988347-2207-4d96-ac4c-05df62f77cf4 admin admin] The token cache is being invalidate because project 87fb5fe2d3e84551aeb13c1999d9c7e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:22:03.117183 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-ea988347-2207-4d96-ac4c-05df62f77cf4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:03.118368 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-ea988347-2207-4d96-ac4c-05df62f77cf4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:03.121067 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1027/2040] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 31 00:22:02 2022] DELETE /identity/v3/projects/87fb5fe2d3e84551aeb13c1999d9c7e5 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:22:03.128409 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6336a0-03fc-4a29-8a31-a6677705e059 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:03.129177 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6336a0-03fc-4a29-8a31-a6677705e059 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:03.129177 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6336a0-03fc-4a29-8a31-a6677705e059 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:03.151480 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-0b6336a0-03fc-4a29-8a31-a6677705e059 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:22:03.152832 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-0b6336a0-03fc-4a29-8a31-a6677705e059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:22:03.248435 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1014/2041] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:22:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:22:03.257761 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd483c2d-870a-4346-8ecf-ba9dfe21c11c None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:03.258055 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd483c2d-870a-4346-8ecf-ba9dfe21c11c None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:03.258323 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd483c2d-870a-4346-8ecf-ba9dfe21c11c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:03.280826 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-bd483c2d-870a-4346-8ecf-ba9dfe21c11c None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:22:03.282005 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-bd483c2d-870a-4346-8ecf-ba9dfe21c11c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:22:03.291805 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1028/2042] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:22:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:22:03.296791 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6336a0-03fc-4a29-8a31-a6677705e059 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:03.308669 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6336a0-03fc-4a29-8a31-a6677705e059 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:03.313760 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5231832-5b43-47ad-813a-5ab2889995fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:03.314431 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5231832-5b43-47ad-813a-5ab2889995fe admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:03.314711 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5231832-5b43-47ad-813a-5ab2889995fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:03.314984 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5231832-5b43-47ad-813a-5ab2889995fe admin admin] PATH_INFO: `/v3/domains` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:03.315647 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5231832-5b43-47ad-813a-5ab2889995fe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:22:03.315955 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5231832-5b43-47ad-813a-5ab2889995fe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:03.317865 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5231832-5b43-47ad-813a-5ab2889995fe admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:03.336630 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1015/2043] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 31 00:22:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:22:03.341410 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd483c2d-870a-4346-8ecf-ba9dfe21c11c None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:03.352485 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd483c2d-870a-4346-8ecf-ba9dfe21c11c None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:03.358007 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5656a0-24cd-445b-aeb0-fec5a9bc3639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:03.358775 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5656a0-24cd-445b-aeb0-fec5a9bc3639 admin admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:03.359146 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5656a0-24cd-445b-aeb0-fec5a9bc3639 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:03.359557 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5656a0-24cd-445b-aeb0-fec5a9bc3639 admin admin] PATH_INFO: `/v3/projects` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:03.360528 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5656a0-24cd-445b-aeb0-fec5a9bc3639 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:03.362629 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5656a0-24cd-445b-aeb0-fec5a9bc3639 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:03.395141 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1029/2044] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 31 00:22:03 2022] POST /identity/v3/projects => generated 365 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:22:03.400464 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5231832-5b43-47ad-813a-5ab2889995fe admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:03.415329 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5231832-5b43-47ad-813a-5ab2889995fe admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:03.490684 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669423ff-ba25-4e47-9aed-34fdcea5b89c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:03.491850 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669423ff-ba25-4e47-9aed-34fdcea5b89c admin admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:03.492427 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669423ff-ba25-4e47-9aed-34fdcea5b89c admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:03.492950 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669423ff-ba25-4e47-9aed-34fdcea5b89c admin admin] PATH_INFO: `/v3/users` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:03.494011 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669423ff-ba25-4e47-9aed-34fdcea5b89c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:03.497844 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669423ff-ba25-4e47-9aed-34fdcea5b89c admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:03.532261 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1016/2045] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 31 00:22:03 2022] POST /identity/v3/users => generated 283 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:22:03.539574 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5656a0-24cd-445b-aeb0-fec5a9bc3639 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:03.557839 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5656a0-24cd-445b-aeb0-fec5a9bc3639 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:03.563263 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f21386-6b35-4242-8f2e-8377b5f231be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:03.564194 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f21386-6b35-4242-8f2e-8377b5f231be admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:03.564473 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f21386-6b35-4242-8f2e-8377b5f231be admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:03.564878 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f21386-6b35-4242-8f2e-8377b5f231be admin admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:03.565689 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f21386-6b35-4242-8f2e-8377b5f231be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:03.567482 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f21386-6b35-4242-8f2e-8377b5f231be admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:03.579792 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1030/2046] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 00:22:03 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:22:03.585477 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669423ff-ba25-4e47-9aed-34fdcea5b89c admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:03.597488 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669423ff-ba25-4e47-9aed-34fdcea5b89c admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:03.605197 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0aed5b-07cd-4ea4-a60b-0e905dfe5c5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:03.606358 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0aed5b-07cd-4ea4-a60b-0e905dfe5c5d admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:03.606812 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0aed5b-07cd-4ea4-a60b-0e905dfe5c5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:03.607260 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0aed5b-07cd-4ea4-a60b-0e905dfe5c5d admin admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:03.608490 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0aed5b-07cd-4ea4-a60b-0e905dfe5c5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:03.611478 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0aed5b-07cd-4ea4-a60b-0e905dfe5c5d admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:03.620993 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:22:03.633459 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1017/2047] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 00:22:03 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 00:22:03.637399 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f21386-6b35-4242-8f2e-8377b5f231be admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:03.649763 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f21386-6b35-4242-8f2e-8377b5f231be admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:03.655285 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44c9a54-7234-41df-b619-5f635764bb15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:03.655974 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44c9a54-7234-41df-b619-5f635764bb15 admin admin] REQUEST_METHOD: `PUT` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:03.656291 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44c9a54-7234-41df-b619-5f635764bb15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:03.656567 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44c9a54-7234-41df-b619-5f635764bb15 admin admin] PATH_INFO: `/v3/projects/97347bd6344d4d0e92dfeb62fb584dd5/users/3d4a168b98684598940d7ef0650f2e1d/roles/fdad79ffbcbb4fa380dc9cf7dd108618` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:03.677573 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44c9a54-7234-41df-b619-5f635764bb15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=97347bd6344d4d0e92dfeb62fb584dd5, user_id=3d4a168b98684598940d7ef0650f2e1d, role_id=fdad79ffbcbb4fa380dc9cf7dd108618)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:03.680649 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44c9a54-7234-41df-b619-5f635764bb15 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:03.697773 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1031/2048] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 00:22:03 2022] PUT /identity/v3/projects/97347bd6344d4d0e92dfeb62fb584dd5/users/3d4a168b98684598940d7ef0650f2e1d/roles/fdad79ffbcbb4fa380dc9cf7dd108618 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:22:03.712833 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36e25ca-66fb-402f-9fd2-e6a07304e60b None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:03.713282 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36e25ca-66fb-402f-9fd2-e6a07304e60b None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:03.713714 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36e25ca-66fb-402f-9fd2-e6a07304e60b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:03.758454 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-c36e25ca-66fb-402f-9fd2-e6a07304e60b None None] MFA Rules not processed for user `3d4a168b98684598940d7ef0650f2e1d`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:22:03.761502 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-c36e25ca-66fb-402f-9fd2-e6a07304e60b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:22:03.867679 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1018/2049] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:22:03 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:22:03.872968 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44c9a54-7234-41df-b619-5f635764bb15 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:03.964092 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44c9a54-7234-41df-b619-5f635764bb15 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:03.969470 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adb3d84-245b-4f32-92f2-a47003ad8209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:03.970055 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adb3d84-245b-4f32-92f2-a47003ad8209 admin admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:03.970356 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adb3d84-245b-4f32-92f2-a47003ad8209 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:03.970667 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adb3d84-245b-4f32-92f2-a47003ad8209 admin admin] PATH_INFO: `/v3/projects` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:03.971353 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adb3d84-245b-4f32-92f2-a47003ad8209 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:03.973612 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adb3d84-245b-4f32-92f2-a47003ad8209 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:04.016766 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1032/2050] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 31 00:22:03 2022] POST /identity/v3/projects => generated 365 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:22:04.025062 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36e25ca-66fb-402f-9fd2-e6a07304e60b None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:04.040762 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36e25ca-66fb-402f-9fd2-e6a07304e60b None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:04.114128 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed2cf2d-e500-4bd2-8899-462ed17e1854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:04.115142 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed2cf2d-e500-4bd2-8899-462ed17e1854 admin admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:04.115430 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed2cf2d-e500-4bd2-8899-462ed17e1854 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:04.115711 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed2cf2d-e500-4bd2-8899-462ed17e1854 admin admin] PATH_INFO: `/v3/users` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:04.116754 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed2cf2d-e500-4bd2-8899-462ed17e1854 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:04.118803 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed2cf2d-e500-4bd2-8899-462ed17e1854 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:04.151665 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1019/2051] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 31 00:22:04 2022] POST /identity/v3/users => generated 289 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:22:04.156875 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adb3d84-245b-4f32-92f2-a47003ad8209 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:04.173207 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adb3d84-245b-4f32-92f2-a47003ad8209 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:04.179903 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2445630-ce8d-4e6f-9c3c-e405b36e77b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:04.180587 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2445630-ce8d-4e6f-9c3c-e405b36e77b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:04.180929 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2445630-ce8d-4e6f-9c3c-e405b36e77b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:04.181173 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2445630-ce8d-4e6f-9c3c-e405b36e77b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:04.181836 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2445630-ce8d-4e6f-9c3c-e405b36e77b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:04.183527 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2445630-ce8d-4e6f-9c3c-e405b36e77b7 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:04.198927 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1033/2052] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 00:22:04 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:22:04.209215 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed2cf2d-e500-4bd2-8899-462ed17e1854 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:04.220380 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed2cf2d-e500-4bd2-8899-462ed17e1854 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:04.226084 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb09684-319a-44b0-8815-3d6b8ade83ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:04.226779 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb09684-319a-44b0-8815-3d6b8ade83ff admin admin] REQUEST_METHOD: `PUT` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:04.227059 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb09684-319a-44b0-8815-3d6b8ade83ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:04.227335 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb09684-319a-44b0-8815-3d6b8ade83ff admin admin] PATH_INFO: `/v3/projects/62b8b18f9ccc495c9d56ba98dfb8d850/users/6da3bf311fde4e9ebea4664ec949c4b5/roles/12f6817f9aaa4e2bb477095a6bed5d0f` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:04.246686 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb09684-319a-44b0-8815-3d6b8ade83ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=62b8b18f9ccc495c9d56ba98dfb8d850, user_id=6da3bf311fde4e9ebea4664ec949c4b5, role_id=12f6817f9aaa4e2bb477095a6bed5d0f)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:04.249520 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb09684-319a-44b0-8815-3d6b8ade83ff admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:04.266260 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1020/2053] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 00:22:04 2022] PUT /identity/v3/projects/62b8b18f9ccc495c9d56ba98dfb8d850/users/6da3bf311fde4e9ebea4664ec949c4b5/roles/12f6817f9aaa4e2bb477095a6bed5d0f => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:22:04.270880 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2445630-ce8d-4e6f-9c3c-e405b36e77b7 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:04.283615 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2445630-ce8d-4e6f-9c3c-e405b36e77b7 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:04.304790 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:22:04.387188 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03756ba-fabd-4ba4-aafa-55dbf122094a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:04.387932 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03756ba-fabd-4ba4-aafa-55dbf122094a admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:04.388103 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03756ba-fabd-4ba4-aafa-55dbf122094a admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:04.388372 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03756ba-fabd-4ba4-aafa-55dbf122094a admin admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:04.389027 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03756ba-fabd-4ba4-aafa-55dbf122094a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:04.390649 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03756ba-fabd-4ba4-aafa-55dbf122094a admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:04.403543 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1034/2054] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 00:22:04 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:22:04.408759 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb09684-319a-44b0-8815-3d6b8ade83ff admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:04.430262 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb09684-319a-44b0-8815-3d6b8ade83ff admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:04.437157 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d75143-d926-44ff-b642-b14903418b2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:04.437988 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d75143-d926-44ff-b642-b14903418b2a admin admin] REQUEST_METHOD: `PUT` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:04.438357 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d75143-d926-44ff-b642-b14903418b2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:04.438721 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d75143-d926-44ff-b642-b14903418b2a admin admin] PATH_INFO: `/v3/projects/62b8b18f9ccc495c9d56ba98dfb8d850/users/6da3bf311fde4e9ebea4664ec949c4b5/roles/12f6817f9aaa4e2bb477095a6bed5d0f` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:04.441202 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d75143-d926-44ff-b642-b14903418b2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=62b8b18f9ccc495c9d56ba98dfb8d850, user_id=6da3bf311fde4e9ebea4664ec949c4b5, role_id=12f6817f9aaa4e2bb477095a6bed5d0f)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:04.445291 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d75143-d926-44ff-b642-b14903418b2a admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:04.458224 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1021/2055] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 00:22:04 2022] PUT /identity/v3/projects/62b8b18f9ccc495c9d56ba98dfb8d850/users/6da3bf311fde4e9ebea4664ec949c4b5/roles/12f6817f9aaa4e2bb477095a6bed5d0f => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:22:04.472861 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e2b998-a0ce-4761-8480-8598b4b24667 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:04.473324 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e2b998-a0ce-4761-8480-8598b4b24667 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:04.473953 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e2b998-a0ce-4761-8480-8598b4b24667 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:04.525226 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-99e2b998-a0ce-4761-8480-8598b4b24667 None None] MFA Rules not processed for user `6da3bf311fde4e9ebea4664ec949c4b5`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:22:04.527279 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-99e2b998-a0ce-4761-8480-8598b4b24667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:22:04.639705 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1035/2056] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:22:04 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:22:04.653333 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d75143-d926-44ff-b642-b14903418b2a admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:04.655174 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-29d75143-d926-44ff-b642-b14903418b2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:22:04.716765 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:22:04.740919 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d75143-d926-44ff-b642-b14903418b2a admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:04.747478 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0778225a-69c6-4525-9aaa-7c55bdb1c126 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beecda6e9feb400288618745c784989f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:04.748633 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0778225a-69c6-4525-9aaa-7c55bdb1c126 service cinder] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:04.749121 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0778225a-69c6-4525-9aaa-7c55bdb1c126 service cinder] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:04.749581 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0778225a-69c6-4525-9aaa-7c55bdb1c126 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:04.773537 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0778225a-69c6-4525-9aaa-7c55bdb1c126 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:04.773537 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0778225a-69c6-4525-9aaa-7c55bdb1c126 service cinder] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:04.793489 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1022/2057] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:22:04 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 00:22:04.978851 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e2b998-a0ce-4761-8480-8598b4b24667 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:05.000102 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e2b998-a0ce-4761-8480-8598b4b24667 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:05.007954 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9828c1-44e5-4916-a680-46e98b96b5ff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beecda6e9feb400288618745c784989f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:05.009089 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9828c1-44e5-4916-a680-46e98b96b5ff service cinder] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:05.009380 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9828c1-44e5-4916-a680-46e98b96b5ff service cinder] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:05.009656 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9828c1-44e5-4916-a680-46e98b96b5ff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:05.114692 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9828c1-44e5-4916-a680-46e98b96b5ff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:05.116264 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9828c1-44e5-4916-a680-46e98b96b5ff service cinder] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:05.127774 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1036/2058] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:22:04 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 00:22:14.783265 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=7 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:22:15.123727 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=85 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:22:16.595410 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0778225a-69c6-4525-9aaa-7c55bdb1c126 service cinder] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:16.723066 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0778225a-69c6-4525-9aaa-7c55bdb1c126 service cinder] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:16.730327 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b65933-1bf6-45cf-aaf5-994ecdc631b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:16.731334 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b65933-1bf6-45cf-aaf5-994ecdc631b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:16.731719 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b65933-1bf6-45cf-aaf5-994ecdc631b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:16.732120 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b65933-1bf6-45cf-aaf5-994ecdc631b2 admin admin] PATH_INFO: `/v3/users/3d4a168b98684598940d7ef0650f2e1d` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:16.733737 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b65933-1bf6-45cf-aaf5-994ecdc631b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d4a168b98684598940d7ef0650f2e1d)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:16.736606 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b65933-1bf6-45cf-aaf5-994ecdc631b2 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:16.836137 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-27b65933-1bf6-45cf-aaf5-994ecdc631b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d4a168b98684598940d7ef0650f2e1d'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:16.870543 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-27b65933-1bf6-45cf-aaf5-994ecdc631b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d4a168b98684598940d7ef0650f2e1d'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:16.887453 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-27b65933-1bf6-45cf-aaf5-994ecdc631b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d4a168b98684598940d7ef0650f2e1d'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:16.921731 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-27b65933-1bf6-45cf-aaf5-994ecdc631b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d4a168b98684598940d7ef0650f2e1d'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:16.925782 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-27b65933-1bf6-45cf-aaf5-994ecdc631b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d4a168b98684598940d7ef0650f2e1d'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:16.940732 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1023/2059] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 31 00:22:16 2022] DELETE /identity/v3/users/3d4a168b98684598940d7ef0650f2e1d => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:22:16.950007 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251a5fcc-b7c7-42ec-898a-f38902a64c2c None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:16.950828 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251a5fcc-b7c7-42ec-898a-f38902a64c2c None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:16.950828 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251a5fcc-b7c7-42ec-898a-f38902a64c2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:16.975379 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-251a5fcc-b7c7-42ec-898a-f38902a64c2c None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:22:16.977695 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-251a5fcc-b7c7-42ec-898a-f38902a64c2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:22:17.111703 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1037/2060] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:22:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:22:17.129734 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b65933-1bf6-45cf-aaf5-994ecdc631b2 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:17.131963 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-27b65933-1bf6-45cf-aaf5-994ecdc631b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:22:17.240252 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b65933-1bf6-45cf-aaf5-994ecdc631b2 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:17.247830 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e1ce06-60f2-433c-90a6-be1c5648925c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'daae792cd11d4c4ca7aae0558998aced', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:17.249937 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e1ce06-60f2-433c-90a6-be1c5648925c service neutron] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:17.250296 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e1ce06-60f2-433c-90a6-be1c5648925c service neutron] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:17.251043 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e1ce06-60f2-433c-90a6-be1c5648925c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:17.275236 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e1ce06-60f2-433c-90a6-be1c5648925c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:17.282179 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e1ce06-60f2-433c-90a6-be1c5648925c service neutron] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:17.313134 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1024/2061] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:22:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:22:17.742198 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251a5fcc-b7c7-42ec-898a-f38902a64c2c None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:17.744485 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-251a5fcc-b7c7-42ec-898a-f38902a64c2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:22:17.759204 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251a5fcc-b7c7-42ec-898a-f38902a64c2c None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:17.765038 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3a3b6b-4ad5-4b20-9b51-2c3454df2d6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:17.765817 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3a3b6b-4ad5-4b20-9b51-2c3454df2d6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:17.766190 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3a3b6b-4ad5-4b20-9b51-2c3454df2d6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:17.766638 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3a3b6b-4ad5-4b20-9b51-2c3454df2d6e admin admin] PATH_INFO: `/v3/projects/97347bd6344d4d0e92dfeb62fb584dd5` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:17.768531 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3a3b6b-4ad5-4b20-9b51-2c3454df2d6e admin admin] RBAC: Authorizing `identity:delete_project(project_id=97347bd6344d4d0e92dfeb62fb584dd5)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:17.772006 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3a3b6b-4ad5-4b20-9b51-2c3454df2d6e admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:17.852921 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-ad3a3b6b-4ad5-4b20-9b51-2c3454df2d6e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97347bd6344d4d0e92dfeb62fb584dd5', 'request_id': 'req-ad3a3b6b-4ad5-4b20-9b51-2c3454df2d6e'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:17.859757 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-ad3a3b6b-4ad5-4b20-9b51-2c3454df2d6e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97347bd6344d4d0e92dfeb62fb584dd5', 'request_id': 'req-ad3a3b6b-4ad5-4b20-9b51-2c3454df2d6e'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:17.866477 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-ad3a3b6b-4ad5-4b20-9b51-2c3454df2d6e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97347bd6344d4d0e92dfeb62fb584dd5', 'request_id': 'req-ad3a3b6b-4ad5-4b20-9b51-2c3454df2d6e'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:17.882780 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-ad3a3b6b-4ad5-4b20-9b51-2c3454df2d6e admin admin] The token cache is being invalidate because project 97347bd6344d4d0e92dfeb62fb584dd5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:22:17.883122 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-ad3a3b6b-4ad5-4b20-9b51-2c3454df2d6e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:17.883940 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-ad3a3b6b-4ad5-4b20-9b51-2c3454df2d6e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:17.885838 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1038/2062] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 31 00:22:17 2022] DELETE /identity/v3/projects/97347bd6344d4d0e92dfeb62fb584dd5 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:22:17.890411 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e1ce06-60f2-433c-90a6-be1c5648925c service neutron] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:17.903151 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e1ce06-60f2-433c-90a6-be1c5648925c service neutron] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:17.924896 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:22:17.978634 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52abd21a-0692-48b6-b358-664e47b08f8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:17.979506 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52abd21a-0692-48b6-b358-664e47b08f8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:17.979930 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52abd21a-0692-48b6-b358-664e47b08f8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:17.980286 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52abd21a-0692-48b6-b358-664e47b08f8a admin admin] PATH_INFO: `/v3/users/6da3bf311fde4e9ebea4664ec949c4b5` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:17.985760 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52abd21a-0692-48b6-b358-664e47b08f8a admin admin] RBAC: Authorizing `identity:delete_user(user_id=6da3bf311fde4e9ebea4664ec949c4b5)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:17.990290 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52abd21a-0692-48b6-b358-664e47b08f8a admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:18.077536 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-52abd21a-0692-48b6-b358-664e47b08f8a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6da3bf311fde4e9ebea4664ec949c4b5'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:18.092866 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-52abd21a-0692-48b6-b358-664e47b08f8a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6da3bf311fde4e9ebea4664ec949c4b5'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:18.105946 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-52abd21a-0692-48b6-b358-664e47b08f8a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6da3bf311fde4e9ebea4664ec949c4b5'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:18.129352 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-52abd21a-0692-48b6-b358-664e47b08f8a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6da3bf311fde4e9ebea4664ec949c4b5'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:18.131218 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-52abd21a-0692-48b6-b358-664e47b08f8a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6da3bf311fde4e9ebea4664ec949c4b5'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:18.140785 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1025/2063] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 31 00:22:17 2022] DELETE /identity/v3/users/6da3bf311fde4e9ebea4664ec949c4b5 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:22:18.606908 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3a3b6b-4ad5-4b20-9b51-2c3454df2d6e admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:18.610737 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-ad3a3b6b-4ad5-4b20-9b51-2c3454df2d6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:22:18.636075 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3a3b6b-4ad5-4b20-9b51-2c3454df2d6e admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:18.769748 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa7b432-5e3b-4fa6-84e1-7fabed5dde44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:18.770788 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa7b432-5e3b-4fa6-84e1-7fabed5dde44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:18.771214 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa7b432-5e3b-4fa6-84e1-7fabed5dde44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:18.771624 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa7b432-5e3b-4fa6-84e1-7fabed5dde44 admin admin] PATH_INFO: `/v3/projects/62b8b18f9ccc495c9d56ba98dfb8d850` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:18.773219 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa7b432-5e3b-4fa6-84e1-7fabed5dde44 admin admin] RBAC: Authorizing `identity:delete_project(project_id=62b8b18f9ccc495c9d56ba98dfb8d850)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:18.781314 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa7b432-5e3b-4fa6-84e1-7fabed5dde44 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:18.829327 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:22:18.860502 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-2fa7b432-5e3b-4fa6-84e1-7fabed5dde44 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62b8b18f9ccc495c9d56ba98dfb8d850', 'request_id': 'req-2fa7b432-5e3b-4fa6-84e1-7fabed5dde44'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:18.871290 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-2fa7b432-5e3b-4fa6-84e1-7fabed5dde44 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62b8b18f9ccc495c9d56ba98dfb8d850', 'request_id': 'req-2fa7b432-5e3b-4fa6-84e1-7fabed5dde44'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:18.882507 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-2fa7b432-5e3b-4fa6-84e1-7fabed5dde44 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62b8b18f9ccc495c9d56ba98dfb8d850', 'request_id': 'req-2fa7b432-5e3b-4fa6-84e1-7fabed5dde44'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:18.912200 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-2fa7b432-5e3b-4fa6-84e1-7fabed5dde44 admin admin] The token cache is being invalidate because project 62b8b18f9ccc495c9d56ba98dfb8d850 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:22:18.912200 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-2fa7b432-5e3b-4fa6-84e1-7fabed5dde44 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:18.913015 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-2fa7b432-5e3b-4fa6-84e1-7fabed5dde44 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:18.914761 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1039/2064] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 31 00:22:18 2022] DELETE /identity/v3/projects/62b8b18f9ccc495c9d56ba98dfb8d850 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:22:18.923378 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f62c4b-de09-4045-bf87-580faf6faba8 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:18.924066 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f62c4b-de09-4045-bf87-580faf6faba8 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:18.924642 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f62c4b-de09-4045-bf87-580faf6faba8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:18.959915 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-91f62c4b-de09-4045-bf87-580faf6faba8 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:22:18.961459 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-91f62c4b-de09-4045-bf87-580faf6faba8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:22:19.056786 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1026/2065] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:22:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:22:19.074296 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d127f45-343b-48e5-9b3f-f29ea4943900 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:19.075261 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d127f45-343b-48e5-9b3f-f29ea4943900 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:19.076851 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d127f45-343b-48e5-9b3f-f29ea4943900 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:19.140684 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-6d127f45-343b-48e5-9b3f-f29ea4943900 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:22:19.142908 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-6d127f45-343b-48e5-9b3f-f29ea4943900 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:22:19.164242 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1040/2066] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:22:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:22:19.166668 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f62c4b-de09-4045-bf87-580faf6faba8 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:19.184466 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f62c4b-de09-4045-bf87-580faf6faba8 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:19.195245 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29424d10-442c-4e3a-936f-ac31a1231ceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:19.196354 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29424d10-442c-4e3a-936f-ac31a1231ceb admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:19.196679 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29424d10-442c-4e3a-936f-ac31a1231ceb admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:19.197131 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29424d10-442c-4e3a-936f-ac31a1231ceb admin admin] PATH_INFO: `/v3/domains` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:19.198269 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29424d10-442c-4e3a-936f-ac31a1231ceb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:22:19.198779 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29424d10-442c-4e3a-936f-ac31a1231ceb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:19.201566 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29424d10-442c-4e3a-936f-ac31a1231ceb admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:19.236231 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1027/2067] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 31 00:22:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:22:19.238517 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d127f45-343b-48e5-9b3f-f29ea4943900 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:19.261020 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d127f45-343b-48e5-9b3f-f29ea4943900 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:19.280238 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06920df9-af8c-4bd2-b35e-1ef7da2c7ad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:19.280972 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06920df9-af8c-4bd2-b35e-1ef7da2c7ad5 admin admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:19.281251 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06920df9-af8c-4bd2-b35e-1ef7da2c7ad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:19.281524 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06920df9-af8c-4bd2-b35e-1ef7da2c7ad5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:19.282208 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06920df9-af8c-4bd2-b35e-1ef7da2c7ad5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:19.285207 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06920df9-af8c-4bd2-b35e-1ef7da2c7ad5 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:19.334401 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1041/2068] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 31 00:22:19 2022] POST /identity/v3/projects => generated 369 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:22:19.339283 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29424d10-442c-4e3a-936f-ac31a1231ceb admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:19.360441 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29424d10-442c-4e3a-936f-ac31a1231ceb admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:19.399069 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:22:19.467698 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbe5409-6c2f-455a-8b52-ea4e7a06ab36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:19.468536 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbe5409-6c2f-455a-8b52-ea4e7a06ab36 admin admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:19.469004 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbe5409-6c2f-455a-8b52-ea4e7a06ab36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:19.469977 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbe5409-6c2f-455a-8b52-ea4e7a06ab36 admin admin] PATH_INFO: `/v3/users` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:19.471230 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbe5409-6c2f-455a-8b52-ea4e7a06ab36 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:19.474812 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbe5409-6c2f-455a-8b52-ea4e7a06ab36 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:19.529211 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1028/2069] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 31 00:22:19 2022] POST /identity/v3/users => generated 285 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:22:19.531949 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06920df9-af8c-4bd2-b35e-1ef7da2c7ad5 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:19.554381 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06920df9-af8c-4bd2-b35e-1ef7da2c7ad5 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:19.569255 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079ebaf8-de17-464a-a48c-7bb19957782f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:19.570370 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079ebaf8-de17-464a-a48c-7bb19957782f admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:19.571156 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079ebaf8-de17-464a-a48c-7bb19957782f admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:19.571826 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079ebaf8-de17-464a-a48c-7bb19957782f admin admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:19.573100 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079ebaf8-de17-464a-a48c-7bb19957782f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:19.576623 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079ebaf8-de17-464a-a48c-7bb19957782f admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:19.598046 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1042/2070] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 00:22:19 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:22:19.603304 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbe5409-6c2f-455a-8b52-ea4e7a06ab36 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:19.621113 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbe5409-6c2f-455a-8b52-ea4e7a06ab36 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:19.646654 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31078db6-086e-4af8-a045-4eaca1a89b09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:19.647530 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31078db6-086e-4af8-a045-4eaca1a89b09 admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:19.647907 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31078db6-086e-4af8-a045-4eaca1a89b09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:19.648354 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31078db6-086e-4af8-a045-4eaca1a89b09 admin admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:19.649120 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31078db6-086e-4af8-a045-4eaca1a89b09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:19.651785 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31078db6-086e-4af8-a045-4eaca1a89b09 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:19.672993 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1029/2071] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 00:22:19 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 00:22:19.674770 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079ebaf8-de17-464a-a48c-7bb19957782f admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:19.691067 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079ebaf8-de17-464a-a48c-7bb19957782f admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:19.697776 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d58c4c-0b84-4e47-8cae-9af985eacabf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:19.698540 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d58c4c-0b84-4e47-8cae-9af985eacabf admin admin] REQUEST_METHOD: `PUT` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:19.698888 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d58c4c-0b84-4e47-8cae-9af985eacabf admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:19.699167 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d58c4c-0b84-4e47-8cae-9af985eacabf admin admin] PATH_INFO: `/v3/projects/c8daff5f6b7045e6b8050eb3cc0c9537/users/9a198a908b864f8d946719b64b2ecec9/roles/fdad79ffbcbb4fa380dc9cf7dd108618` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:19.719426 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d58c4c-0b84-4e47-8cae-9af985eacabf admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8daff5f6b7045e6b8050eb3cc0c9537, user_id=9a198a908b864f8d946719b64b2ecec9, role_id=fdad79ffbcbb4fa380dc9cf7dd108618)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:19.724737 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d58c4c-0b84-4e47-8cae-9af985eacabf admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:19.744746 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1043/2072] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 00:22:19 2022] PUT /identity/v3/projects/c8daff5f6b7045e6b8050eb3cc0c9537/users/9a198a908b864f8d946719b64b2ecec9/roles/fdad79ffbcbb4fa380dc9cf7dd108618 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:22:19.763881 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f155afc0-f732-444a-b847-b7ac8ebc1084 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:19.764679 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f155afc0-f732-444a-b847-b7ac8ebc1084 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:19.765025 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f155afc0-f732-444a-b847-b7ac8ebc1084 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:19.805309 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-f155afc0-f732-444a-b847-b7ac8ebc1084 None None] MFA Rules not processed for user `9a198a908b864f8d946719b64b2ecec9`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:22:19.808023 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-f155afc0-f732-444a-b847-b7ac8ebc1084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:22:19.895840 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1030/2073] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:22:19 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:22:19.902065 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d58c4c-0b84-4e47-8cae-9af985eacabf admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:19.982660 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d58c4c-0b84-4e47-8cae-9af985eacabf admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:19.988659 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fa1ba4-1d0d-4ac6-8983-a9b387f9972d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:19.989354 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fa1ba4-1d0d-4ac6-8983-a9b387f9972d admin admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:19.989755 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fa1ba4-1d0d-4ac6-8983-a9b387f9972d admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:19.990189 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fa1ba4-1d0d-4ac6-8983-a9b387f9972d admin admin] PATH_INFO: `/v3/projects` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:19.990705 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fa1ba4-1d0d-4ac6-8983-a9b387f9972d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:19.993754 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fa1ba4-1d0d-4ac6-8983-a9b387f9972d admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:20.028086 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1044/2074] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 31 00:22:19 2022] POST /identity/v3/projects => generated 369 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:22:20.032753 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f155afc0-f732-444a-b847-b7ac8ebc1084 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:20.045712 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f155afc0-f732-444a-b847-b7ac8ebc1084 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:20.109990 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d8b4a5-a981-4a82-88c2-2168d1290f47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:20.110626 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d8b4a5-a981-4a82-88c2-2168d1290f47 admin admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:20.110907 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d8b4a5-a981-4a82-88c2-2168d1290f47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:20.111181 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d8b4a5-a981-4a82-88c2-2168d1290f47 admin admin] PATH_INFO: `/v3/users` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:20.111833 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d8b4a5-a981-4a82-88c2-2168d1290f47 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:20.114605 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d8b4a5-a981-4a82-88c2-2168d1290f47 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:20.139650 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1031/2075] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 31 00:22:20 2022] POST /identity/v3/users => generated 291 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:22:20.143847 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fa1ba4-1d0d-4ac6-8983-a9b387f9972d admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:20.155188 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fa1ba4-1d0d-4ac6-8983-a9b387f9972d admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:20.160059 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4699a1-e4b1-4a55-bb10-99e341337de4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:20.160744 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4699a1-e4b1-4a55-bb10-99e341337de4 admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:20.161040 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4699a1-e4b1-4a55-bb10-99e341337de4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:20.161307 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4699a1-e4b1-4a55-bb10-99e341337de4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:20.161999 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4699a1-e4b1-4a55-bb10-99e341337de4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:20.163693 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4699a1-e4b1-4a55-bb10-99e341337de4 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:20.176830 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1045/2076] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 00:22:20 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:22:20.181306 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d8b4a5-a981-4a82-88c2-2168d1290f47 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:20.193260 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d8b4a5-a981-4a82-88c2-2168d1290f47 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:20.198439 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0de8972-0da6-4707-ac24-e5ee13faadac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:20.199131 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0de8972-0da6-4707-ac24-e5ee13faadac admin admin] REQUEST_METHOD: `PUT` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:20.199414 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0de8972-0da6-4707-ac24-e5ee13faadac admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:20.199691 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0de8972-0da6-4707-ac24-e5ee13faadac admin admin] PATH_INFO: `/v3/projects/4f10b4dc4c78409cac2af0e5cdb25844/users/905a692c769e4d5bb431e7bd4620227e/roles/12f6817f9aaa4e2bb477095a6bed5d0f` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:20.217834 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0de8972-0da6-4707-ac24-e5ee13faadac admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f10b4dc4c78409cac2af0e5cdb25844, user_id=905a692c769e4d5bb431e7bd4620227e, role_id=12f6817f9aaa4e2bb477095a6bed5d0f)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:20.220655 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0de8972-0da6-4707-ac24-e5ee13faadac admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:20.236940 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1032/2077] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 00:22:20 2022] PUT /identity/v3/projects/4f10b4dc4c78409cac2af0e5cdb25844/users/905a692c769e4d5bb431e7bd4620227e/roles/12f6817f9aaa4e2bb477095a6bed5d0f => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:22:20.242049 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4699a1-e4b1-4a55-bb10-99e341337de4 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:20.253370 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4699a1-e4b1-4a55-bb10-99e341337de4 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:20.278005 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:22:20.322079 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1139ee1d-06e2-490a-b8d5-0516d7488a2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:20.322729 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1139ee1d-06e2-490a-b8d5-0516d7488a2e admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:20.323000 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1139ee1d-06e2-490a-b8d5-0516d7488a2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:20.323354 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1139ee1d-06e2-490a-b8d5-0516d7488a2e admin admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:20.324020 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1139ee1d-06e2-490a-b8d5-0516d7488a2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:20.325877 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1139ee1d-06e2-490a-b8d5-0516d7488a2e admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:20.338084 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1046/2078] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 00:22:20 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 00:22:20.342481 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0de8972-0da6-4707-ac24-e5ee13faadac admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:20.348958 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:22:20.356658 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0de8972-0da6-4707-ac24-e5ee13faadac admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:20.363759 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b8c8ea-bc7b-460e-b2c6-1b00dab910e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:20.364835 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b8c8ea-bc7b-460e-b2c6-1b00dab910e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:20.365520 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b8c8ea-bc7b-460e-b2c6-1b00dab910e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:20.365953 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b8c8ea-bc7b-460e-b2c6-1b00dab910e5 admin admin] PATH_INFO: `/v3/projects/4f10b4dc4c78409cac2af0e5cdb25844/users/905a692c769e4d5bb431e7bd4620227e/roles/12f6817f9aaa4e2bb477095a6bed5d0f` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:20.368845 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b8c8ea-bc7b-460e-b2c6-1b00dab910e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f10b4dc4c78409cac2af0e5cdb25844, user_id=905a692c769e4d5bb431e7bd4620227e, role_id=12f6817f9aaa4e2bb477095a6bed5d0f)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:20.373404 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b8c8ea-bc7b-460e-b2c6-1b00dab910e5 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:20.392013 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1033/2079] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 00:22:20 2022] PUT /identity/v3/projects/4f10b4dc4c78409cac2af0e5cdb25844/users/905a692c769e4d5bb431e7bd4620227e/roles/12f6817f9aaa4e2bb477095a6bed5d0f => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:22:20.413374 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7e467e-55b3-4fca-9e88-abbdee019943 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:20.413763 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7e467e-55b3-4fca-9e88-abbdee019943 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:20.414228 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7e467e-55b3-4fca-9e88-abbdee019943 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:20.465017 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-8a7e467e-55b3-4fca-9e88-abbdee019943 None None] MFA Rules not processed for user `905a692c769e4d5bb431e7bd4620227e`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:22:20.467233 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-8a7e467e-55b3-4fca-9e88-abbdee019943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:22:20.579426 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1047/2080] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:22:20 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:22:20.594611 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b8c8ea-bc7b-460e-b2c6-1b00dab910e5 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:20.597530 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-75b8c8ea-bc7b-460e-b2c6-1b00dab910e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:22:20.668514 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b8c8ea-bc7b-460e-b2c6-1b00dab910e5 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:20.672746 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1158154-6ea5-47f1-85c7-6d06247ae815 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beecda6e9feb400288618745c784989f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:20.673509 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1158154-6ea5-47f1-85c7-6d06247ae815 service cinder] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:20.673877 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1158154-6ea5-47f1-85c7-6d06247ae815 service cinder] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:20.674259 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1158154-6ea5-47f1-85c7-6d06247ae815 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:20.685487 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1158154-6ea5-47f1-85c7-6d06247ae815 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:20.686992 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1158154-6ea5-47f1-85c7-6d06247ae815 service cinder] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:20.697847 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1034/2081] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:22:20 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:22:22.445985 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7e467e-55b3-4fca-9e88-abbdee019943 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:22.559545 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7e467e-55b3-4fca-9e88-abbdee019943 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:22.564195 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65e36d6-4913-48db-9c19-a5387bfe7511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:22.564859 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65e36d6-4913-48db-9c19-a5387bfe7511 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:22.565137 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65e36d6-4913-48db-9c19-a5387bfe7511 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:22.565411 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65e36d6-4913-48db-9c19-a5387bfe7511 admin admin] PATH_INFO: `/v3/users/9a198a908b864f8d946719b64b2ecec9` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:22.567358 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65e36d6-4913-48db-9c19-a5387bfe7511 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a198a908b864f8d946719b64b2ecec9)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:22.569370 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65e36d6-4913-48db-9c19-a5387bfe7511 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:22.632584 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-f65e36d6-4913-48db-9c19-a5387bfe7511 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a198a908b864f8d946719b64b2ecec9'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:22.633978 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:22:22.642571 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-f65e36d6-4913-48db-9c19-a5387bfe7511 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a198a908b864f8d946719b64b2ecec9'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:22.652726 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-f65e36d6-4913-48db-9c19-a5387bfe7511 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a198a908b864f8d946719b64b2ecec9'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:22.653367 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-f65e36d6-4913-48db-9c19-a5387bfe7511 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a198a908b864f8d946719b64b2ecec9'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:22.669467 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-f65e36d6-4913-48db-9c19-a5387bfe7511 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a198a908b864f8d946719b64b2ecec9'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:22.676751 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1048/2082] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 31 00:22:22 2022] DELETE /identity/v3/users/9a198a908b864f8d946719b64b2ecec9 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:22:22.681670 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a982b9e2-fef0-4125-8b5f-fc9dbef167d2 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:22.682302 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a982b9e2-fef0-4125-8b5f-fc9dbef167d2 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:22.682414 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a982b9e2-fef0-4125-8b5f-fc9dbef167d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:22.704494 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-a982b9e2-fef0-4125-8b5f-fc9dbef167d2 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:22:22.705624 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-a982b9e2-fef0-4125-8b5f-fc9dbef167d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:22:22.795237 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1035/2083] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:22:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:22:22.807742 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65e36d6-4913-48db-9c19-a5387bfe7511 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:22.810922 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-f65e36d6-4913-48db-9c19-a5387bfe7511 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:22:22.888379 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65e36d6-4913-48db-9c19-a5387bfe7511 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:22.892719 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b904903-e590-4924-9512-83a04317fb49 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'daae792cd11d4c4ca7aae0558998aced', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:22.893357 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b904903-e590-4924-9512-83a04317fb49 service neutron] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:22.893638 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b904903-e590-4924-9512-83a04317fb49 service neutron] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:22.894989 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b904903-e590-4924-9512-83a04317fb49 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:22.904953 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b904903-e590-4924-9512-83a04317fb49 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:22.906426 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b904903-e590-4924-9512-83a04317fb49 service neutron] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:22.921726 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1049/2084] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:22:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 00:22:23.403115 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a982b9e2-fef0-4125-8b5f-fc9dbef167d2 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:23.404929 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-a982b9e2-fef0-4125-8b5f-fc9dbef167d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:22:23.427553 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a982b9e2-fef0-4125-8b5f-fc9dbef167d2 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:23.435324 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e7220a-b0eb-4997-9527-04223b34024e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:23.436393 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e7220a-b0eb-4997-9527-04223b34024e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:23.436886 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e7220a-b0eb-4997-9527-04223b34024e admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:23.437390 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e7220a-b0eb-4997-9527-04223b34024e admin admin] PATH_INFO: `/v3/projects/c8daff5f6b7045e6b8050eb3cc0c9537` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:23.439311 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e7220a-b0eb-4997-9527-04223b34024e admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8daff5f6b7045e6b8050eb3cc0c9537)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:23.442815 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e7220a-b0eb-4997-9527-04223b34024e admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:23.521393 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-73e7220a-b0eb-4997-9527-04223b34024e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8daff5f6b7045e6b8050eb3cc0c9537', 'request_id': 'req-73e7220a-b0eb-4997-9527-04223b34024e'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:23.533875 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-73e7220a-b0eb-4997-9527-04223b34024e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8daff5f6b7045e6b8050eb3cc0c9537', 'request_id': 'req-73e7220a-b0eb-4997-9527-04223b34024e'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:23.545111 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-73e7220a-b0eb-4997-9527-04223b34024e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8daff5f6b7045e6b8050eb3cc0c9537', 'request_id': 'req-73e7220a-b0eb-4997-9527-04223b34024e'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:23.563721 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-73e7220a-b0eb-4997-9527-04223b34024e admin admin] The token cache is being invalidate because project c8daff5f6b7045e6b8050eb3cc0c9537 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81523) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:22:23.564038 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-73e7220a-b0eb-4997-9527-04223b34024e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:23.564961 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-73e7220a-b0eb-4997-9527-04223b34024e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:23.567869 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1036/2085] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 31 00:22:23 2022] DELETE /identity/v3/projects/c8daff5f6b7045e6b8050eb3cc0c9537 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:22:23.572433 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b904903-e590-4924-9512-83a04317fb49 service neutron] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:23.584900 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b904903-e590-4924-9512-83a04317fb49 service neutron] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:23.691112 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7dcb21-c3a9-40df-943f-5d5185e14e09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:23.692180 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7dcb21-c3a9-40df-943f-5d5185e14e09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:23.692657 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7dcb21-c3a9-40df-943f-5d5185e14e09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:23.693118 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7dcb21-c3a9-40df-943f-5d5185e14e09 admin admin] PATH_INFO: `/v3/users/905a692c769e4d5bb431e7bd4620227e` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:23.695077 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7dcb21-c3a9-40df-943f-5d5185e14e09 admin admin] RBAC: Authorizing `identity:delete_user(user_id=905a692c769e4d5bb431e7bd4620227e)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:23.698770 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7dcb21-c3a9-40df-943f-5d5185e14e09 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:23.771048 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-ba7dcb21-c3a9-40df-943f-5d5185e14e09 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '905a692c769e4d5bb431e7bd4620227e'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:23.782233 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-ba7dcb21-c3a9-40df-943f-5d5185e14e09 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '905a692c769e4d5bb431e7bd4620227e'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:23.792406 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-ba7dcb21-c3a9-40df-943f-5d5185e14e09 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '905a692c769e4d5bb431e7bd4620227e'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:23.793157 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-ba7dcb21-c3a9-40df-943f-5d5185e14e09 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '905a692c769e4d5bb431e7bd4620227e'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:23.799978 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=86,keystone:INSERT=2,keystone:DELETE=12 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:22:23.812549 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-ba7dcb21-c3a9-40df-943f-5d5185e14e09 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '905a692c769e4d5bb431e7bd4620227e'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:23.820545 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1050/2086] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 31 00:22:23 2022] DELETE /identity/v3/users/905a692c769e4d5bb431e7bd4620227e => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:22:24.185871 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e7220a-b0eb-4997-9527-04223b34024e admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:24.188034 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-73e7220a-b0eb-4997-9527-04223b34024e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:22:24.211541 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e7220a-b0eb-4997-9527-04223b34024e admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:24.233747 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:22:24.314226 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ead132a-ef73-4f01-8615-a725e50f2196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:24.315429 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ead132a-ef73-4f01-8615-a725e50f2196 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:24.315998 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ead132a-ef73-4f01-8615-a725e50f2196 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:24.316680 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ead132a-ef73-4f01-8615-a725e50f2196 admin admin] PATH_INFO: `/v3/projects/4f10b4dc4c78409cac2af0e5cdb25844` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:24.318482 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ead132a-ef73-4f01-8615-a725e50f2196 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f10b4dc4c78409cac2af0e5cdb25844)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:24.322983 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ead132a-ef73-4f01-8615-a725e50f2196 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:24.418570 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-9ead132a-ef73-4f01-8615-a725e50f2196 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f10b4dc4c78409cac2af0e5cdb25844', 'request_id': 'req-9ead132a-ef73-4f01-8615-a725e50f2196'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:24.427528 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-9ead132a-ef73-4f01-8615-a725e50f2196 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f10b4dc4c78409cac2af0e5cdb25844', 'request_id': 'req-9ead132a-ef73-4f01-8615-a725e50f2196'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:24.437006 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-9ead132a-ef73-4f01-8615-a725e50f2196 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f10b4dc4c78409cac2af0e5cdb25844', 'request_id': 'req-9ead132a-ef73-4f01-8615-a725e50f2196'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:24.455824 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-9ead132a-ef73-4f01-8615-a725e50f2196 admin admin] The token cache is being invalidate because project 4f10b4dc4c78409cac2af0e5cdb25844 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81523) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:22:24.456101 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-9ead132a-ef73-4f01-8615-a725e50f2196 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:24.457312 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-9ead132a-ef73-4f01-8615-a725e50f2196 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:24.459630 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1037/2087] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 31 00:22:24 2022] DELETE /identity/v3/projects/4f10b4dc4c78409cac2af0e5cdb25844 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:22:24.465198 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12cedc4-e388-41c7-9bb4-9b0c38dea9c4 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:24.465510 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12cedc4-e388-41c7-9bb4-9b0c38dea9c4 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:24.465822 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12cedc4-e388-41c7-9bb4-9b0c38dea9c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:24.506740 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-c12cedc4-e388-41c7-9bb4-9b0c38dea9c4 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:22:24.509758 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-c12cedc4-e388-41c7-9bb4-9b0c38dea9c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:22:24.608456 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1051/2088] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:22:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:22:24.622118 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed850cd7-d121-4150-a05a-b6d84810a6d0 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:24.622534 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed850cd7-d121-4150-a05a-b6d84810a6d0 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:24.622875 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed850cd7-d121-4150-a05a-b6d84810a6d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:24.649995 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-ed850cd7-d121-4150-a05a-b6d84810a6d0 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:22:24.651424 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-ed850cd7-d121-4150-a05a-b6d84810a6d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:22:24.670243 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1038/2089] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:22:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:22:24.677300 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12cedc4-e388-41c7-9bb4-9b0c38dea9c4 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:24.699202 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12cedc4-e388-41c7-9bb4-9b0c38dea9c4 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:24.705694 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f959f0dd-c17f-47d2-bc30-ff8001baebec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:24.706546 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f959f0dd-c17f-47d2-bc30-ff8001baebec admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:24.707001 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f959f0dd-c17f-47d2-bc30-ff8001baebec admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:24.707706 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f959f0dd-c17f-47d2-bc30-ff8001baebec admin admin] PATH_INFO: `/v3/domains` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:24.708551 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f959f0dd-c17f-47d2-bc30-ff8001baebec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:22:24.709208 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f959f0dd-c17f-47d2-bc30-ff8001baebec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:24.711426 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f959f0dd-c17f-47d2-bc30-ff8001baebec admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:24.738596 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1052/2090] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 31 00:22:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:22:24.745677 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed850cd7-d121-4150-a05a-b6d84810a6d0 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:24.766693 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed850cd7-d121-4150-a05a-b6d84810a6d0 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:24.776302 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9762df66-5f3e-4ff2-96c6-238b942f223c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:24.777384 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9762df66-5f3e-4ff2-96c6-238b942f223c admin admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:24.777847 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9762df66-5f3e-4ff2-96c6-238b942f223c admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:24.778430 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9762df66-5f3e-4ff2-96c6-238b942f223c admin admin] PATH_INFO: `/v3/projects` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:24.779460 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9762df66-5f3e-4ff2-96c6-238b942f223c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:24.783325 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9762df66-5f3e-4ff2-96c6-238b942f223c admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:24.840462 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1039/2091] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 31 00:22:24 2022] POST /identity/v3/projects => generated 385 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:22:24.842052 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f959f0dd-c17f-47d2-bc30-ff8001baebec admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:24.854769 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f959f0dd-c17f-47d2-bc30-ff8001baebec admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:24.937594 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddc067b-b94e-499f-b96e-cddc7a3bad13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:24.938406 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddc067b-b94e-499f-b96e-cddc7a3bad13 admin admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:24.938845 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddc067b-b94e-499f-b96e-cddc7a3bad13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:24.939250 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddc067b-b94e-499f-b96e-cddc7a3bad13 admin admin] PATH_INFO: `/v3/users` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:24.940065 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddc067b-b94e-499f-b96e-cddc7a3bad13 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:24.943140 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddc067b-b94e-499f-b96e-cddc7a3bad13 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:24.981380 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1053/2092] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 31 00:22:24 2022] POST /identity/v3/users => generated 293 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:22:24.982689 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9762df66-5f3e-4ff2-96c6-238b942f223c admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:24.996460 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9762df66-5f3e-4ff2-96c6-238b942f223c admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:25.001569 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470ccf21-5459-4b95-a932-c29b55095c61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:25.002208 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470ccf21-5459-4b95-a932-c29b55095c61 admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:25.002487 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470ccf21-5459-4b95-a932-c29b55095c61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:25.002758 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470ccf21-5459-4b95-a932-c29b55095c61 admin admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:25.003656 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470ccf21-5459-4b95-a932-c29b55095c61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:25.005358 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470ccf21-5459-4b95-a932-c29b55095c61 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:25.023370 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1040/2093] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 00:22:24 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 00:22:25.028340 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddc067b-b94e-499f-b96e-cddc7a3bad13 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:25.039733 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddc067b-b94e-499f-b96e-cddc7a3bad13 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:25.044645 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2e9309-dc5a-4d87-a54b-62562cd28779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:25.045276 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2e9309-dc5a-4d87-a54b-62562cd28779 admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:25.045558 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2e9309-dc5a-4d87-a54b-62562cd28779 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:25.045825 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2e9309-dc5a-4d87-a54b-62562cd28779 admin admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:25.046511 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2e9309-dc5a-4d87-a54b-62562cd28779 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:25.048213 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2e9309-dc5a-4d87-a54b-62562cd28779 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:25.060335 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1054/2094] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 00:22:25 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:22:25.065225 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470ccf21-5459-4b95-a932-c29b55095c61 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:25.077065 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470ccf21-5459-4b95-a932-c29b55095c61 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:25.082260 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7425272c-d268-43ae-ab98-83981487ef39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:25.083054 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7425272c-d268-43ae-ab98-83981487ef39 admin admin] REQUEST_METHOD: `PUT` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:25.083335 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7425272c-d268-43ae-ab98-83981487ef39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:25.083611 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7425272c-d268-43ae-ab98-83981487ef39 admin admin] PATH_INFO: `/v3/projects/5fba9bc7f7df41fe9a8d13201915e2ab/users/ebc15fb48b4246e89fba58b74830d7ce/roles/fdad79ffbcbb4fa380dc9cf7dd108618` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:25.103527 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7425272c-d268-43ae-ab98-83981487ef39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5fba9bc7f7df41fe9a8d13201915e2ab, user_id=ebc15fb48b4246e89fba58b74830d7ce, role_id=fdad79ffbcbb4fa380dc9cf7dd108618)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:25.106332 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7425272c-d268-43ae-ab98-83981487ef39 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:25.122989 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1041/2095] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 00:22:25 2022] PUT /identity/v3/projects/5fba9bc7f7df41fe9a8d13201915e2ab/users/ebc15fb48b4246e89fba58b74830d7ce/roles/fdad79ffbcbb4fa380dc9cf7dd108618 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:22:25.134987 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23035132-6670-4d6f-9398-2c31f7fef555 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:25.135357 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23035132-6670-4d6f-9398-2c31f7fef555 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:25.135636 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23035132-6670-4d6f-9398-2c31f7fef555 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:25.169113 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-23035132-6670-4d6f-9398-2c31f7fef555 None None] MFA Rules not processed for user `ebc15fb48b4246e89fba58b74830d7ce`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:22:25.170255 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-23035132-6670-4d6f-9398-2c31f7fef555 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:22:25.222646 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:22:25.267978 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1055/2096] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:22:25 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:22:25.275178 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7425272c-d268-43ae-ab98-83981487ef39 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:25.337335 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:22:25.358531 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7425272c-d268-43ae-ab98-83981487ef39 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:25.365157 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e3b1ac-3f96-4955-9a7f-58fe0dfd048f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:25.365821 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e3b1ac-3f96-4955-9a7f-58fe0dfd048f admin admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:25.366098 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e3b1ac-3f96-4955-9a7f-58fe0dfd048f admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:25.366416 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e3b1ac-3f96-4955-9a7f-58fe0dfd048f admin admin] PATH_INFO: `/v3/projects` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:25.367107 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e3b1ac-3f96-4955-9a7f-58fe0dfd048f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:25.369160 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e3b1ac-3f96-4955-9a7f-58fe0dfd048f admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:25.406771 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1042/2097] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 31 00:22:25 2022] POST /identity/v3/projects => generated 387 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:22:25.408563 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23035132-6670-4d6f-9398-2c31f7fef555 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:25.422631 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23035132-6670-4d6f-9398-2c31f7fef555 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:25.495706 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a34be3d-6d8f-480b-b293-931369d90aa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:25.496372 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a34be3d-6d8f-480b-b293-931369d90aa0 admin admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:25.496652 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a34be3d-6d8f-480b-b293-931369d90aa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:25.496920 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a34be3d-6d8f-480b-b293-931369d90aa0 admin admin] PATH_INFO: `/v3/users` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:25.497569 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a34be3d-6d8f-480b-b293-931369d90aa0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:25.499549 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a34be3d-6d8f-480b-b293-931369d90aa0 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:25.527273 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1056/2098] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 31 00:22:25 2022] POST /identity/v3/users => generated 300 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:22:25.533015 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e3b1ac-3f96-4955-9a7f-58fe0dfd048f admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:25.544792 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e3b1ac-3f96-4955-9a7f-58fe0dfd048f admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:25.549886 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec35cda-ee95-4cb5-8fe6-3589f8455321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:25.551122 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec35cda-ee95-4cb5-8fe6-3589f8455321 admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:25.551387 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec35cda-ee95-4cb5-8fe6-3589f8455321 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:25.551740 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec35cda-ee95-4cb5-8fe6-3589f8455321 admin admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:25.552556 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec35cda-ee95-4cb5-8fe6-3589f8455321 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:25.554224 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec35cda-ee95-4cb5-8fe6-3589f8455321 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:25.570323 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1043/2099] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 00:22:25 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 00:22:25.571852 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a34be3d-6d8f-480b-b293-931369d90aa0 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:25.582668 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a34be3d-6d8f-480b-b293-931369d90aa0 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:25.587693 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93623e47-592e-4926-a985-ee50d7eb940a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:25.588503 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93623e47-592e-4926-a985-ee50d7eb940a admin admin] REQUEST_METHOD: `PUT` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:25.588847 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93623e47-592e-4926-a985-ee50d7eb940a admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:25.589192 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93623e47-592e-4926-a985-ee50d7eb940a admin admin] PATH_INFO: `/v3/projects/3fe12740c4454a3380671f502b495bba/users/5bf18857117c40599f74ce6fcddf5e6f/roles/12f6817f9aaa4e2bb477095a6bed5d0f` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:25.607239 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93623e47-592e-4926-a985-ee50d7eb940a admin admin] RBAC: Authorizing `identity:create_grant(project_id=3fe12740c4454a3380671f502b495bba, user_id=5bf18857117c40599f74ce6fcddf5e6f, role_id=12f6817f9aaa4e2bb477095a6bed5d0f)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:25.610007 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93623e47-592e-4926-a985-ee50d7eb940a admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:25.638237 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1057/2100] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 00:22:25 2022] PUT /identity/v3/projects/3fe12740c4454a3380671f502b495bba/users/5bf18857117c40599f74ce6fcddf5e6f/roles/12f6817f9aaa4e2bb477095a6bed5d0f => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:22:25.644031 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec35cda-ee95-4cb5-8fe6-3589f8455321 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:25.658745 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec35cda-ee95-4cb5-8fe6-3589f8455321 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:25.740122 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ca08fd-d076-4317-95fb-a598309a39fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:25.740800 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ca08fd-d076-4317-95fb-a598309a39fd admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:25.741077 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ca08fd-d076-4317-95fb-a598309a39fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:25.741345 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ca08fd-d076-4317-95fb-a598309a39fd admin admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:25.742016 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ca08fd-d076-4317-95fb-a598309a39fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:25.743663 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ca08fd-d076-4317-95fb-a598309a39fd admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:25.760134 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1044/2101] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 00:22:25 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:22:25.766893 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93623e47-592e-4926-a985-ee50d7eb940a admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:25.785745 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93623e47-592e-4926-a985-ee50d7eb940a admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:25.794135 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f00f3e-1ce4-4e4f-b4fb-e84e69437c3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:25.795223 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f00f3e-1ce4-4e4f-b4fb-e84e69437c3f admin admin] REQUEST_METHOD: `PUT` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:25.795717 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f00f3e-1ce4-4e4f-b4fb-e84e69437c3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:25.796243 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f00f3e-1ce4-4e4f-b4fb-e84e69437c3f admin admin] PATH_INFO: `/v3/projects/3fe12740c4454a3380671f502b495bba/users/5bf18857117c40599f74ce6fcddf5e6f/roles/12f6817f9aaa4e2bb477095a6bed5d0f` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:25.800091 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f00f3e-1ce4-4e4f-b4fb-e84e69437c3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=3fe12740c4454a3380671f502b495bba, user_id=5bf18857117c40599f74ce6fcddf5e6f, role_id=12f6817f9aaa4e2bb477095a6bed5d0f)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:25.806395 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f00f3e-1ce4-4e4f-b4fb-e84e69437c3f admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:25.826474 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1058/2102] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 00:22:25 2022] PUT /identity/v3/projects/3fe12740c4454a3380671f502b495bba/users/5bf18857117c40599f74ce6fcddf5e6f/roles/12f6817f9aaa4e2bb477095a6bed5d0f => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:22:25.846823 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6b61fc-7347-46e5-bb81-07149ce350db None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:25.848213 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6b61fc-7347-46e5-bb81-07149ce350db None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:25.848604 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6b61fc-7347-46e5-bb81-07149ce350db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:25.887352 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-cc6b61fc-7347-46e5-bb81-07149ce350db None None] MFA Rules not processed for user `5bf18857117c40599f74ce6fcddf5e6f`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:22:25.888725 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-cc6b61fc-7347-46e5-bb81-07149ce350db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:22:26.011001 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1045/2103] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:22:25 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:22:26.033879 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f00f3e-1ce4-4e4f-b4fb-e84e69437c3f admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:26.038693 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-47f00f3e-1ce4-4e4f-b4fb-e84e69437c3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:22:26.135456 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f00f3e-1ce4-4e4f-b4fb-e84e69437c3f admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:26.139255 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c49c57f-8ccf-478f-b92f-68e002b9cac0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beecda6e9feb400288618745c784989f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:26.139900 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c49c57f-8ccf-478f-b92f-68e002b9cac0 service cinder] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:26.140198 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c49c57f-8ccf-478f-b92f-68e002b9cac0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:26.140483 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c49c57f-8ccf-478f-b92f-68e002b9cac0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:26.152371 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c49c57f-8ccf-478f-b92f-68e002b9cac0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:26.153867 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c49c57f-8ccf-478f-b92f-68e002b9cac0 service cinder] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:26.165422 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1059/2104] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:22:26 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:22:27.356585 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6b61fc-7347-46e5-bb81-07149ce350db None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:27.406722 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:22:27.435330 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6b61fc-7347-46e5-bb81-07149ce350db None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:27.440029 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afebf5a5-3f9c-491a-90f2-33732df2090f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:27.441122 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afebf5a5-3f9c-491a-90f2-33732df2090f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:27.441415 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afebf5a5-3f9c-491a-90f2-33732df2090f admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:27.441754 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afebf5a5-3f9c-491a-90f2-33732df2090f admin admin] PATH_INFO: `/v3/users/ebc15fb48b4246e89fba58b74830d7ce` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:27.442964 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afebf5a5-3f9c-491a-90f2-33732df2090f admin admin] RBAC: Authorizing `identity:delete_user(user_id=ebc15fb48b4246e89fba58b74830d7ce)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:27.444966 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afebf5a5-3f9c-491a-90f2-33732df2090f admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:27.509288 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-afebf5a5-3f9c-491a-90f2-33732df2090f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ebc15fb48b4246e89fba58b74830d7ce'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:27.523342 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-afebf5a5-3f9c-491a-90f2-33732df2090f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ebc15fb48b4246e89fba58b74830d7ce'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:27.537913 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-afebf5a5-3f9c-491a-90f2-33732df2090f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ebc15fb48b4246e89fba58b74830d7ce'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:27.562845 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-afebf5a5-3f9c-491a-90f2-33732df2090f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ebc15fb48b4246e89fba58b74830d7ce'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:27.564029 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-afebf5a5-3f9c-491a-90f2-33732df2090f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ebc15fb48b4246e89fba58b74830d7ce'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:27.576065 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1046/2105] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 31 00:22:27 2022] DELETE /identity/v3/users/ebc15fb48b4246e89fba58b74830d7ce => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:22:27.584134 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c67c32b-a8d4-458c-a933-6128890d7685 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:27.584833 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c67c32b-a8d4-458c-a933-6128890d7685 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:27.585129 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c67c32b-a8d4-458c-a933-6128890d7685 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:27.620070 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-9c67c32b-a8d4-458c-a933-6128890d7685 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:22:27.622611 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-9c67c32b-a8d4-458c-a933-6128890d7685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:22:27.686727 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:22:27.733354 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1060/2106] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:22:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:22:27.744407 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afebf5a5-3f9c-491a-90f2-33732df2090f admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:27.745795 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-afebf5a5-3f9c-491a-90f2-33732df2090f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:22:27.814545 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afebf5a5-3f9c-491a-90f2-33732df2090f admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:27.818508 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84ef14e-b39b-4454-99f3-ab939f1c23ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'daae792cd11d4c4ca7aae0558998aced', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:27.819220 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84ef14e-b39b-4454-99f3-ab939f1c23ba service neutron] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:27.819591 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84ef14e-b39b-4454-99f3-ab939f1c23ba service neutron] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:27.819937 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84ef14e-b39b-4454-99f3-ab939f1c23ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:27.830095 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84ef14e-b39b-4454-99f3-ab939f1c23ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:27.832069 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84ef14e-b39b-4454-99f3-ab939f1c23ba service neutron] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:27.844095 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1047/2107] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:22:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 00:22:28.328397 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c67c32b-a8d4-458c-a933-6128890d7685 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:28.329919 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-9c67c32b-a8d4-458c-a933-6128890d7685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:22:28.347584 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c67c32b-a8d4-458c-a933-6128890d7685 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:28.355253 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d66736-8a25-443d-8ae9-c27f25f5b187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:28.356592 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d66736-8a25-443d-8ae9-c27f25f5b187 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:28.357236 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d66736-8a25-443d-8ae9-c27f25f5b187 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:28.357625 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d66736-8a25-443d-8ae9-c27f25f5b187 admin admin] PATH_INFO: `/v3/projects/5fba9bc7f7df41fe9a8d13201915e2ab` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:28.359291 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d66736-8a25-443d-8ae9-c27f25f5b187 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5fba9bc7f7df41fe9a8d13201915e2ab)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:28.361461 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d66736-8a25-443d-8ae9-c27f25f5b187 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:28.450689 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-f5d66736-8a25-443d-8ae9-c27f25f5b187 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5fba9bc7f7df41fe9a8d13201915e2ab', 'request_id': 'req-f5d66736-8a25-443d-8ae9-c27f25f5b187'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:28.464801 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-f5d66736-8a25-443d-8ae9-c27f25f5b187 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5fba9bc7f7df41fe9a8d13201915e2ab', 'request_id': 'req-f5d66736-8a25-443d-8ae9-c27f25f5b187'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:28.480455 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-f5d66736-8a25-443d-8ae9-c27f25f5b187 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5fba9bc7f7df41fe9a8d13201915e2ab', 'request_id': 'req-f5d66736-8a25-443d-8ae9-c27f25f5b187'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:28.506002 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-f5d66736-8a25-443d-8ae9-c27f25f5b187 admin admin] The token cache is being invalidate because project 5fba9bc7f7df41fe9a8d13201915e2ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:22:28.506556 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-f5d66736-8a25-443d-8ae9-c27f25f5b187 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:28.507678 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-f5d66736-8a25-443d-8ae9-c27f25f5b187 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:28.510366 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1061/2108] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 31 00:22:28 2022] DELETE /identity/v3/projects/5fba9bc7f7df41fe9a8d13201915e2ab => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:22:28.514594 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84ef14e-b39b-4454-99f3-ab939f1c23ba service neutron] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:28.532014 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84ef14e-b39b-4454-99f3-ab939f1c23ba service neutron] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:28.631773 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3817499c-9782-44bc-8114-022194c8f43d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:28.632465 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3817499c-9782-44bc-8114-022194c8f43d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:28.632743 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3817499c-9782-44bc-8114-022194c8f43d admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:28.633015 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3817499c-9782-44bc-8114-022194c8f43d admin admin] PATH_INFO: `/v3/users/5bf18857117c40599f74ce6fcddf5e6f` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:28.634225 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3817499c-9782-44bc-8114-022194c8f43d admin admin] RBAC: Authorizing `identity:delete_user(user_id=5bf18857117c40599f74ce6fcddf5e6f)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:28.636185 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3817499c-9782-44bc-8114-022194c8f43d admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:28.638114 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:22:28.699229 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-3817499c-9782-44bc-8114-022194c8f43d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5bf18857117c40599f74ce6fcddf5e6f'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:28.708116 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-3817499c-9782-44bc-8114-022194c8f43d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5bf18857117c40599f74ce6fcddf5e6f'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:28.718882 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-3817499c-9782-44bc-8114-022194c8f43d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5bf18857117c40599f74ce6fcddf5e6f'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:28.738503 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-3817499c-9782-44bc-8114-022194c8f43d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5bf18857117c40599f74ce6fcddf5e6f'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:28.739749 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-3817499c-9782-44bc-8114-022194c8f43d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5bf18857117c40599f74ce6fcddf5e6f'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:28.749642 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1048/2109] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 31 00:22:28 2022] DELETE /identity/v3/users/5bf18857117c40599f74ce6fcddf5e6f => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:22:29.134641 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d66736-8a25-443d-8ae9-c27f25f5b187 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:29.136801 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-f5d66736-8a25-443d-8ae9-c27f25f5b187 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:22:29.158123 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d66736-8a25-443d-8ae9-c27f25f5b187 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:29.233123 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7792e6-9555-42c9-9af3-5af807b6ca38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:29.233798 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7792e6-9555-42c9-9af3-5af807b6ca38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:29.234070 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7792e6-9555-42c9-9af3-5af807b6ca38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:29.234348 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7792e6-9555-42c9-9af3-5af807b6ca38 admin admin] PATH_INFO: `/v3/projects/3fe12740c4454a3380671f502b495bba` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:29.235621 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7792e6-9555-42c9-9af3-5af807b6ca38 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3fe12740c4454a3380671f502b495bba)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:29.238173 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7792e6-9555-42c9-9af3-5af807b6ca38 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:29.301040 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-6e7792e6-9555-42c9-9af3-5af807b6ca38 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3fe12740c4454a3380671f502b495bba', 'request_id': 'req-6e7792e6-9555-42c9-9af3-5af807b6ca38'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:29.309728 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-6e7792e6-9555-42c9-9af3-5af807b6ca38 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3fe12740c4454a3380671f502b495bba', 'request_id': 'req-6e7792e6-9555-42c9-9af3-5af807b6ca38'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:29.318859 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-6e7792e6-9555-42c9-9af3-5af807b6ca38 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3fe12740c4454a3380671f502b495bba', 'request_id': 'req-6e7792e6-9555-42c9-9af3-5af807b6ca38'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:29.321110 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:22:29.342900 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-6e7792e6-9555-42c9-9af3-5af807b6ca38 admin admin] The token cache is being invalidate because project 3fe12740c4454a3380671f502b495bba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:22:29.343323 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-6e7792e6-9555-42c9-9af3-5af807b6ca38 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:29.344207 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-6e7792e6-9555-42c9-9af3-5af807b6ca38 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:29.345874 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1062/2110] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 31 00:22:29 2022] DELETE /identity/v3/projects/3fe12740c4454a3380671f502b495bba => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:22:29.353760 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b8d064-a28a-4705-909c-e614a03a00a1 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:29.354270 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b8d064-a28a-4705-909c-e614a03a00a1 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:29.354765 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b8d064-a28a-4705-909c-e614a03a00a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:29.390552 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-87b8d064-a28a-4705-909c-e614a03a00a1 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:22:29.392615 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-87b8d064-a28a-4705-909c-e614a03a00a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:22:29.482301 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1049/2111] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:22:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:22:29.491403 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904f2e87-3c23-4229-bb1f-1cc8a7e7580c None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:29.491878 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904f2e87-3c23-4229-bb1f-1cc8a7e7580c None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:29.492344 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904f2e87-3c23-4229-bb1f-1cc8a7e7580c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:29.516333 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-904f2e87-3c23-4229-bb1f-1cc8a7e7580c None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:22:29.517766 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-904f2e87-3c23-4229-bb1f-1cc8a7e7580c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:22:29.527575 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1063/2112] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:22:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:22:29.532351 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b8d064-a28a-4705-909c-e614a03a00a1 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:29.547793 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b8d064-a28a-4705-909c-e614a03a00a1 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:29.556990 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4c4279-179c-4bb7-b9a2-17814aaa8b2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:29.558080 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4c4279-179c-4bb7-b9a2-17814aaa8b2d admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:29.558581 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4c4279-179c-4bb7-b9a2-17814aaa8b2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:29.559109 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4c4279-179c-4bb7-b9a2-17814aaa8b2d admin admin] PATH_INFO: `/v3/domains` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:29.560386 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4c4279-179c-4bb7-b9a2-17814aaa8b2d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:22:29.560954 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4c4279-179c-4bb7-b9a2-17814aaa8b2d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:29.564357 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4c4279-179c-4bb7-b9a2-17814aaa8b2d admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:29.592268 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1050/2113] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 31 00:22:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:22:29.595058 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904f2e87-3c23-4229-bb1f-1cc8a7e7580c None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:29.614486 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904f2e87-3c23-4229-bb1f-1cc8a7e7580c None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:29.622587 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dc4f2f-514c-4d95-954c-7489b076a562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:29.623640 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dc4f2f-514c-4d95-954c-7489b076a562 admin admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:29.624686 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dc4f2f-514c-4d95-954c-7489b076a562 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:29.624686 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dc4f2f-514c-4d95-954c-7489b076a562 admin admin] PATH_INFO: `/v3/projects` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:29.625839 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dc4f2f-514c-4d95-954c-7489b076a562 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:29.629901 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dc4f2f-514c-4d95-954c-7489b076a562 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:29.682338 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1064/2114] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 31 00:22:29 2022] POST /identity/v3/projects => generated 375 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:22:29.687575 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4c4279-179c-4bb7-b9a2-17814aaa8b2d admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:29.701521 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4c4279-179c-4bb7-b9a2-17814aaa8b2d admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:29.782674 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a4c247-00b4-473f-9af0-50bac184218a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:29.783685 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a4c247-00b4-473f-9af0-50bac184218a admin admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:29.784181 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a4c247-00b4-473f-9af0-50bac184218a admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:29.785537 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a4c247-00b4-473f-9af0-50bac184218a admin admin] PATH_INFO: `/v3/users` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:29.786651 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a4c247-00b4-473f-9af0-50bac184218a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:29.790384 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a4c247-00b4-473f-9af0-50bac184218a admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:29.805260 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:22:29.820887 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1051/2115] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 31 00:22:29 2022] POST /identity/v3/users => generated 288 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:22:29.826743 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dc4f2f-514c-4d95-954c-7489b076a562 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:29.841396 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dc4f2f-514c-4d95-954c-7489b076a562 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:29.848373 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e82747a-deb9-4aff-801d-de9e77a2271a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:29.849251 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e82747a-deb9-4aff-801d-de9e77a2271a admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:29.849736 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e82747a-deb9-4aff-801d-de9e77a2271a admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:29.850200 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e82747a-deb9-4aff-801d-de9e77a2271a admin admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:29.851232 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e82747a-deb9-4aff-801d-de9e77a2271a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:29.853104 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e82747a-deb9-4aff-801d-de9e77a2271a admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:29.870783 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1065/2116] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 00:22:29 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:22:29.875004 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a4c247-00b4-473f-9af0-50bac184218a admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:29.886144 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a4c247-00b4-473f-9af0-50bac184218a admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:29.891901 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a940a0f-de2f-4c43-a3c2-ff9435beecc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:29.892505 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a940a0f-de2f-4c43-a3c2-ff9435beecc3 admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:29.892768 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a940a0f-de2f-4c43-a3c2-ff9435beecc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:29.893036 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a940a0f-de2f-4c43-a3c2-ff9435beecc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:29.894605 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a940a0f-de2f-4c43-a3c2-ff9435beecc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:29.896404 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a940a0f-de2f-4c43-a3c2-ff9435beecc3 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:29.910426 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1052/2117] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 00:22:29 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:22:29.915183 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e82747a-deb9-4aff-801d-de9e77a2271a admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:29.927517 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e82747a-deb9-4aff-801d-de9e77a2271a admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:29.932889 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8fb75c-1c45-41ba-a710-a7904dbd531f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:29.933576 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8fb75c-1c45-41ba-a710-a7904dbd531f admin admin] REQUEST_METHOD: `PUT` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:29.933856 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8fb75c-1c45-41ba-a710-a7904dbd531f admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:29.934132 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8fb75c-1c45-41ba-a710-a7904dbd531f admin admin] PATH_INFO: `/v3/projects/361756cc4abe42c3994f6a92bcc0508d/users/5175aafb9c0549438513bb4f1e11309d/roles/fdad79ffbcbb4fa380dc9cf7dd108618` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:29.953092 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8fb75c-1c45-41ba-a710-a7904dbd531f admin admin] RBAC: Authorizing `identity:create_grant(project_id=361756cc4abe42c3994f6a92bcc0508d, user_id=5175aafb9c0549438513bb4f1e11309d, role_id=fdad79ffbcbb4fa380dc9cf7dd108618)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:29.955799 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8fb75c-1c45-41ba-a710-a7904dbd531f admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:29.973587 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1066/2118] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 00:22:29 2022] PUT /identity/v3/projects/361756cc4abe42c3994f6a92bcc0508d/users/5175aafb9c0549438513bb4f1e11309d/roles/fdad79ffbcbb4fa380dc9cf7dd108618 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:22:29.985481 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e3ee4a-a9c5-4b9d-ada3-f894dddaafbe None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:29.986032 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e3ee4a-a9c5-4b9d-ada3-f894dddaafbe None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:29.986542 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e3ee4a-a9c5-4b9d-ada3-f894dddaafbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:30.024992 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-20e3ee4a-a9c5-4b9d-ada3-f894dddaafbe None None] MFA Rules not processed for user `5175aafb9c0549438513bb4f1e11309d`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:22:30.026262 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-20e3ee4a-a9c5-4b9d-ada3-f894dddaafbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:22:30.104476 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1053/2119] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:22:29 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:22:30.109565 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8fb75c-1c45-41ba-a710-a7904dbd531f admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:30.185655 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8fb75c-1c45-41ba-a710-a7904dbd531f admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:30.191200 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2741bcdc-e033-4c96-b5bf-cbc278e4cb88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:30.192204 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2741bcdc-e033-4c96-b5bf-cbc278e4cb88 admin admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:30.192503 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2741bcdc-e033-4c96-b5bf-cbc278e4cb88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:30.192781 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2741bcdc-e033-4c96-b5bf-cbc278e4cb88 admin admin] PATH_INFO: `/v3/projects` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:30.193438 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2741bcdc-e033-4c96-b5bf-cbc278e4cb88 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:30.195407 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2741bcdc-e033-4c96-b5bf-cbc278e4cb88 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:30.227544 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1067/2120] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 31 00:22:30 2022] POST /identity/v3/projects => generated 375 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:22:30.233855 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e3ee4a-a9c5-4b9d-ada3-f894dddaafbe None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:30.249188 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e3ee4a-a9c5-4b9d-ada3-f894dddaafbe None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:30.321764 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f37c43c-c486-44dd-a72f-46c2c247119e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:30.322390 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f37c43c-c486-44dd-a72f-46c2c247119e admin admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:30.322669 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f37c43c-c486-44dd-a72f-46c2c247119e admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:30.322939 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f37c43c-c486-44dd-a72f-46c2c247119e admin admin] PATH_INFO: `/v3/users` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:30.323603 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f37c43c-c486-44dd-a72f-46c2c247119e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:30.325647 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f37c43c-c486-44dd-a72f-46c2c247119e admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:30.351694 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1054/2121] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 31 00:22:30 2022] POST /identity/v3/users => generated 294 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:22:30.356880 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2741bcdc-e033-4c96-b5bf-cbc278e4cb88 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:30.375051 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2741bcdc-e033-4c96-b5bf-cbc278e4cb88 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:30.382815 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859cee7e-2a70-4631-b20f-635f6513dbb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:30.383981 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859cee7e-2a70-4631-b20f-635f6513dbb2 admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:30.384518 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859cee7e-2a70-4631-b20f-635f6513dbb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:30.385001 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859cee7e-2a70-4631-b20f-635f6513dbb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:30.386153 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859cee7e-2a70-4631-b20f-635f6513dbb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:30.389316 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859cee7e-2a70-4631-b20f-635f6513dbb2 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:30.406998 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1068/2122] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 00:22:30 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:22:30.412581 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f37c43c-c486-44dd-a72f-46c2c247119e admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:30.423406 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f37c43c-c486-44dd-a72f-46c2c247119e admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:30.429642 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffd0c85-f3f6-4d39-8d81-43d24a57c365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:30.430327 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffd0c85-f3f6-4d39-8d81-43d24a57c365 admin admin] REQUEST_METHOD: `PUT` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:30.430604 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffd0c85-f3f6-4d39-8d81-43d24a57c365 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:30.430880 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffd0c85-f3f6-4d39-8d81-43d24a57c365 admin admin] PATH_INFO: `/v3/projects/4ba8c9b487474f6db34d5097c656b05b/users/fa2fa30220fa41188371d0fb1cb5bfb6/roles/12f6817f9aaa4e2bb477095a6bed5d0f` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:30.449116 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffd0c85-f3f6-4d39-8d81-43d24a57c365 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ba8c9b487474f6db34d5097c656b05b, user_id=fa2fa30220fa41188371d0fb1cb5bfb6, role_id=12f6817f9aaa4e2bb477095a6bed5d0f)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:30.451853 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffd0c85-f3f6-4d39-8d81-43d24a57c365 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:30.468101 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1055/2123] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 00:22:30 2022] PUT /identity/v3/projects/4ba8c9b487474f6db34d5097c656b05b/users/fa2fa30220fa41188371d0fb1cb5bfb6/roles/12f6817f9aaa4e2bb477095a6bed5d0f => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:22:30.473872 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859cee7e-2a70-4631-b20f-635f6513dbb2 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:30.491371 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859cee7e-2a70-4631-b20f-635f6513dbb2 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:30.589990 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc7d61a-a0a8-48d9-9623-701d34bddb44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:30.590686 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc7d61a-a0a8-48d9-9623-701d34bddb44 admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:30.591012 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc7d61a-a0a8-48d9-9623-701d34bddb44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:30.591360 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc7d61a-a0a8-48d9-9623-701d34bddb44 admin admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:30.592127 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc7d61a-a0a8-48d9-9623-701d34bddb44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:30.594108 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc7d61a-a0a8-48d9-9623-701d34bddb44 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:30.597672 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:INSERT=4,keystone:DELETE=1,keystone:SELECT=95 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:22:30.608683 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1069/2124] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 00:22:30 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:22:30.613124 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffd0c85-f3f6-4d39-8d81-43d24a57c365 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:30.624468 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffd0c85-f3f6-4d39-8d81-43d24a57c365 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:30.629818 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33c4a5c-11e4-40b3-b0fb-ade1f16720a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:30.630509 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33c4a5c-11e4-40b3-b0fb-ade1f16720a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:30.630789 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33c4a5c-11e4-40b3-b0fb-ade1f16720a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:30.631067 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33c4a5c-11e4-40b3-b0fb-ade1f16720a7 admin admin] PATH_INFO: `/v3/projects/4ba8c9b487474f6db34d5097c656b05b/users/fa2fa30220fa41188371d0fb1cb5bfb6/roles/12f6817f9aaa4e2bb477095a6bed5d0f` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:30.633122 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33c4a5c-11e4-40b3-b0fb-ade1f16720a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ba8c9b487474f6db34d5097c656b05b, user_id=fa2fa30220fa41188371d0fb1cb5bfb6, role_id=12f6817f9aaa4e2bb477095a6bed5d0f)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:30.635862 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33c4a5c-11e4-40b3-b0fb-ade1f16720a7 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:30.648551 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1056/2125] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 00:22:30 2022] PUT /identity/v3/projects/4ba8c9b487474f6db34d5097c656b05b/users/fa2fa30220fa41188371d0fb1cb5bfb6/roles/12f6817f9aaa4e2bb477095a6bed5d0f => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:22:30.662230 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d6d477-5df1-4d60-ba56-49d4141023a3 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:30.662702 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d6d477-5df1-4d60-ba56-49d4141023a3 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:30.663203 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d6d477-5df1-4d60-ba56-49d4141023a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:30.713970 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-b4d6d477-5df1-4d60-ba56-49d4141023a3 None None] MFA Rules not processed for user `fa2fa30220fa41188371d0fb1cb5bfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:22:30.715789 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-b4d6d477-5df1-4d60-ba56-49d4141023a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:22:30.817875 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1070/2126] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:22:30 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:22:30.829428 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33c4a5c-11e4-40b3-b0fb-ade1f16720a7 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:30.831966 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-f33c4a5c-11e4-40b3-b0fb-ade1f16720a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:22:30.871621 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:22:30.916475 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33c4a5c-11e4-40b3-b0fb-ade1f16720a7 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:30.922951 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8350b8a-629f-466b-9329-d11c0feb3d1c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beecda6e9feb400288618745c784989f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:30.924358 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8350b8a-629f-466b-9329-d11c0feb3d1c service cinder] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:30.924793 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8350b8a-629f-466b-9329-d11c0feb3d1c service cinder] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:30.925561 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8350b8a-629f-466b-9329-d11c0feb3d1c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:31.045404 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8350b8a-629f-466b-9329-d11c0feb3d1c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:31.047593 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8350b8a-629f-466b-9329-d11c0feb3d1c service cinder] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:31.065095 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1057/2127] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:22:30 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 00:22:34.887605 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d6d477-5df1-4d60-ba56-49d4141023a3 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:35.028427 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d6d477-5df1-4d60-ba56-49d4141023a3 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:35.041441 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a156a0e2-82b3-4b82-966d-a24b5d5c0d05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:35.042792 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a156a0e2-82b3-4b82-966d-a24b5d5c0d05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:35.043288 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a156a0e2-82b3-4b82-966d-a24b5d5c0d05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:35.043829 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a156a0e2-82b3-4b82-966d-a24b5d5c0d05 admin admin] PATH_INFO: `/v3/users/5175aafb9c0549438513bb4f1e11309d` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:35.046348 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a156a0e2-82b3-4b82-966d-a24b5d5c0d05 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5175aafb9c0549438513bb4f1e11309d)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:35.050463 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a156a0e2-82b3-4b82-966d-a24b5d5c0d05 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:35.191380 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-a156a0e2-82b3-4b82-966d-a24b5d5c0d05 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5175aafb9c0549438513bb4f1e11309d'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:35.226079 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-a156a0e2-82b3-4b82-966d-a24b5d5c0d05 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5175aafb9c0549438513bb4f1e11309d'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:35.245750 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-a156a0e2-82b3-4b82-966d-a24b5d5c0d05 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5175aafb9c0549438513bb4f1e11309d'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:35.247290 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-a156a0e2-82b3-4b82-966d-a24b5d5c0d05 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5175aafb9c0549438513bb4f1e11309d'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:35.292120 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-a156a0e2-82b3-4b82-966d-a24b5d5c0d05 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5175aafb9c0549438513bb4f1e11309d'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:35.343118 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1071/2128] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 31 00:22:34 2022] DELETE /identity/v3/users/5175aafb9c0549438513bb4f1e11309d => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:22:35.350201 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a84b97-5007-41a1-abfd-e21e47c8540f None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:35.350201 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a84b97-5007-41a1-abfd-e21e47c8540f None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:35.351008 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a84b97-5007-41a1-abfd-e21e47c8540f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:35.403845 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-26a84b97-5007-41a1-abfd-e21e47c8540f None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:22:35.406144 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-26a84b97-5007-41a1-abfd-e21e47c8540f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:22:35.517792 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1058/2129] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:22:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:22:35.545429 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a156a0e2-82b3-4b82-966d-a24b5d5c0d05 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:35.547492 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-a156a0e2-82b3-4b82-966d-a24b5d5c0d05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:22:35.561723 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:22:35.691687 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a156a0e2-82b3-4b82-966d-a24b5d5c0d05 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:35.696584 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d4f8b7-b337-4483-a94c-885d55c24fd5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'daae792cd11d4c4ca7aae0558998aced', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:35.697292 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d4f8b7-b337-4483-a94c-885d55c24fd5 service neutron] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:35.697559 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d4f8b7-b337-4483-a94c-885d55c24fd5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:35.698019 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d4f8b7-b337-4483-a94c-885d55c24fd5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:35.710992 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d4f8b7-b337-4483-a94c-885d55c24fd5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:35.712701 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d4f8b7-b337-4483-a94c-885d55c24fd5 service neutron] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:35.726592 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1072/2130] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:22:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:22:36.226859 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a84b97-5007-41a1-abfd-e21e47c8540f None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:36.227954 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-26a84b97-5007-41a1-abfd-e21e47c8540f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:22:36.248595 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a84b97-5007-41a1-abfd-e21e47c8540f None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:36.275564 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d95bd0-a53f-4ee4-8e84-ae854da7a27b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:36.277321 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d95bd0-a53f-4ee4-8e84-ae854da7a27b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:36.278290 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d95bd0-a53f-4ee4-8e84-ae854da7a27b admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:36.278582 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d95bd0-a53f-4ee4-8e84-ae854da7a27b admin admin] PATH_INFO: `/v3/projects/361756cc4abe42c3994f6a92bcc0508d` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:36.293916 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d95bd0-a53f-4ee4-8e84-ae854da7a27b admin admin] RBAC: Authorizing `identity:delete_project(project_id=361756cc4abe42c3994f6a92bcc0508d)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:36.293916 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d95bd0-a53f-4ee4-8e84-ae854da7a27b admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:36.374566 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-01d95bd0-a53f-4ee4-8e84-ae854da7a27b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '361756cc4abe42c3994f6a92bcc0508d', 'request_id': 'req-01d95bd0-a53f-4ee4-8e84-ae854da7a27b'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:36.384236 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-01d95bd0-a53f-4ee4-8e84-ae854da7a27b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '361756cc4abe42c3994f6a92bcc0508d', 'request_id': 'req-01d95bd0-a53f-4ee4-8e84-ae854da7a27b'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:36.391187 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-01d95bd0-a53f-4ee4-8e84-ae854da7a27b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '361756cc4abe42c3994f6a92bcc0508d', 'request_id': 'req-01d95bd0-a53f-4ee4-8e84-ae854da7a27b'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:36.411038 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-01d95bd0-a53f-4ee4-8e84-ae854da7a27b admin admin] The token cache is being invalidate because project 361756cc4abe42c3994f6a92bcc0508d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81523) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:22:36.411474 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-01d95bd0-a53f-4ee4-8e84-ae854da7a27b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:36.412315 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-01d95bd0-a53f-4ee4-8e84-ae854da7a27b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:36.414032 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1059/2131] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 31 00:22:36 2022] DELETE /identity/v3/projects/361756cc4abe42c3994f6a92bcc0508d => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:22:36.418570 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d4f8b7-b337-4483-a94c-885d55c24fd5 service neutron] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:36.434678 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d4f8b7-b337-4483-a94c-885d55c24fd5 service neutron] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:36.552545 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051ef8cb-9b9d-484a-83b0-a8d2e255a037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:36.553579 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051ef8cb-9b9d-484a-83b0-a8d2e255a037 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:36.554045 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051ef8cb-9b9d-484a-83b0-a8d2e255a037 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:36.554497 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051ef8cb-9b9d-484a-83b0-a8d2e255a037 admin admin] PATH_INFO: `/v3/users/fa2fa30220fa41188371d0fb1cb5bfb6` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:36.556468 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051ef8cb-9b9d-484a-83b0-a8d2e255a037 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa2fa30220fa41188371d0fb1cb5bfb6)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:36.559692 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051ef8cb-9b9d-484a-83b0-a8d2e255a037 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:36.644082 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-051ef8cb-9b9d-484a-83b0-a8d2e255a037 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa2fa30220fa41188371d0fb1cb5bfb6'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:36.657775 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-051ef8cb-9b9d-484a-83b0-a8d2e255a037 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa2fa30220fa41188371d0fb1cb5bfb6'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:36.674135 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-051ef8cb-9b9d-484a-83b0-a8d2e255a037 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa2fa30220fa41188371d0fb1cb5bfb6'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:36.675852 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-051ef8cb-9b9d-484a-83b0-a8d2e255a037 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa2fa30220fa41188371d0fb1cb5bfb6'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:36.697641 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-051ef8cb-9b9d-484a-83b0-a8d2e255a037 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa2fa30220fa41188371d0fb1cb5bfb6'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:36.706758 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1073/2132] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 31 00:22:36 2022] DELETE /identity/v3/users/fa2fa30220fa41188371d0fb1cb5bfb6 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:22:37.147287 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d95bd0-a53f-4ee4-8e84-ae854da7a27b admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:37.148940 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-01d95bd0-a53f-4ee4-8e84-ae854da7a27b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:22:37.171802 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:22:37.182542 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d95bd0-a53f-4ee4-8e84-ae854da7a27b admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:37.265269 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69439af6-810e-4736-84fb-706c16f5244d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:37.265976 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69439af6-810e-4736-84fb-706c16f5244d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:37.266363 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69439af6-810e-4736-84fb-706c16f5244d admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:37.266745 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69439af6-810e-4736-84fb-706c16f5244d admin admin] PATH_INFO: `/v3/projects/4ba8c9b487474f6db34d5097c656b05b` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:37.268326 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69439af6-810e-4736-84fb-706c16f5244d admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ba8c9b487474f6db34d5097c656b05b)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:37.271666 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69439af6-810e-4736-84fb-706c16f5244d admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:37.365573 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-69439af6-810e-4736-84fb-706c16f5244d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ba8c9b487474f6db34d5097c656b05b', 'request_id': 'req-69439af6-810e-4736-84fb-706c16f5244d'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:37.377153 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-69439af6-810e-4736-84fb-706c16f5244d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ba8c9b487474f6db34d5097c656b05b', 'request_id': 'req-69439af6-810e-4736-84fb-706c16f5244d'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:37.388947 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-69439af6-810e-4736-84fb-706c16f5244d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ba8c9b487474f6db34d5097c656b05b', 'request_id': 'req-69439af6-810e-4736-84fb-706c16f5244d'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:37.413282 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-69439af6-810e-4736-84fb-706c16f5244d admin admin] The token cache is being invalidate because project 4ba8c9b487474f6db34d5097c656b05b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81523) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:22:37.414814 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-69439af6-810e-4736-84fb-706c16f5244d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:37.415727 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-69439af6-810e-4736-84fb-706c16f5244d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:37.418108 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1060/2133] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 31 00:22:37 2022] DELETE /identity/v3/projects/4ba8c9b487474f6db34d5097c656b05b => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:22:37.424090 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b448c0f-d98b-42dc-abba-79aebd844829 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:37.426213 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b448c0f-d98b-42dc-abba-79aebd844829 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:37.426608 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b448c0f-d98b-42dc-abba-79aebd844829 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:37.449513 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-2b448c0f-d98b-42dc-abba-79aebd844829 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:22:37.450883 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-2b448c0f-d98b-42dc-abba-79aebd844829 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:22:37.476450 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:22:37.543922 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1074/2134] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:22:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:22:37.546451 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f86760-298a-4a06-bd84-7773401c3434 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:37.546703 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f86760-298a-4a06-bd84-7773401c3434 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:37.548131 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f86760-298a-4a06-bd84-7773401c3434 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:37.586015 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-49f86760-298a-4a06-bd84-7773401c3434 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:22:37.588291 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-49f86760-298a-4a06-bd84-7773401c3434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:22:37.605355 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1061/2135] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:22:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:22:37.609740 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b448c0f-d98b-42dc-abba-79aebd844829 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:37.621341 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b448c0f-d98b-42dc-abba-79aebd844829 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:37.628777 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f2fb21-9851-4c02-8b36-48c4360d0b59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:37.629096 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f2fb21-9851-4c02-8b36-48c4360d0b59 admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:37.629420 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f2fb21-9851-4c02-8b36-48c4360d0b59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:37.629820 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f2fb21-9851-4c02-8b36-48c4360d0b59 admin admin] PATH_INFO: `/v3/domains` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:37.630399 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f2fb21-9851-4c02-8b36-48c4360d0b59 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:22:37.630706 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f2fb21-9851-4c02-8b36-48c4360d0b59 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:37.632757 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f2fb21-9851-4c02-8b36-48c4360d0b59 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:37.651540 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1075/2136] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 31 00:22:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:22:37.655656 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f86760-298a-4a06-bd84-7773401c3434 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:37.672243 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f86760-298a-4a06-bd84-7773401c3434 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:37.678950 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0cc318-85a3-4944-b6fc-7f842a9ba8eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:37.679884 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0cc318-85a3-4944-b6fc-7f842a9ba8eb admin admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:37.680215 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0cc318-85a3-4944-b6fc-7f842a9ba8eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:37.680680 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0cc318-85a3-4944-b6fc-7f842a9ba8eb admin admin] PATH_INFO: `/v3/projects` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:37.681496 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0cc318-85a3-4944-b6fc-7f842a9ba8eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:37.683606 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0cc318-85a3-4944-b6fc-7f842a9ba8eb admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:37.727552 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1062/2137] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 31 00:22:37 2022] POST /identity/v3/projects => generated 365 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:22:37.734148 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f2fb21-9851-4c02-8b36-48c4360d0b59 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:37.753795 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f2fb21-9851-4c02-8b36-48c4360d0b59 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:37.846035 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e1ee6f-da1f-49de-879f-0de6fe0083d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:37.847662 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e1ee6f-da1f-49de-879f-0de6fe0083d7 admin admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:37.848129 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e1ee6f-da1f-49de-879f-0de6fe0083d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:37.848603 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e1ee6f-da1f-49de-879f-0de6fe0083d7 admin admin] PATH_INFO: `/v3/users` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:37.849685 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e1ee6f-da1f-49de-879f-0de6fe0083d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:37.853548 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e1ee6f-da1f-49de-879f-0de6fe0083d7 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:37.887192 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1076/2138] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 31 00:22:37 2022] POST /identity/v3/users => generated 283 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:22:37.891898 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0cc318-85a3-4944-b6fc-7f842a9ba8eb admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:37.903511 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0cc318-85a3-4944-b6fc-7f842a9ba8eb admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:37.908560 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c227745-6bff-498f-848c-87e30f45b213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:37.909932 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c227745-6bff-498f-848c-87e30f45b213 admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:37.910383 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c227745-6bff-498f-848c-87e30f45b213 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:37.910702 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c227745-6bff-498f-848c-87e30f45b213 admin admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:37.911475 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c227745-6bff-498f-848c-87e30f45b213 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:37.913279 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c227745-6bff-498f-848c-87e30f45b213 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:37.926692 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1063/2139] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 00:22:37 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:22:37.931741 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e1ee6f-da1f-49de-879f-0de6fe0083d7 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:37.942949 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e1ee6f-da1f-49de-879f-0de6fe0083d7 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:37.948491 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cc26eb-9cda-47b6-a79c-fd0fe615e317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:37.949126 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cc26eb-9cda-47b6-a79c-fd0fe615e317 admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:37.949403 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cc26eb-9cda-47b6-a79c-fd0fe615e317 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:37.949672 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cc26eb-9cda-47b6-a79c-fd0fe615e317 admin admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:37.950322 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cc26eb-9cda-47b6-a79c-fd0fe615e317 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:37.951937 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cc26eb-9cda-47b6-a79c-fd0fe615e317 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:37.965768 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1077/2140] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 00:22:37 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:22:37.970412 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c227745-6bff-498f-848c-87e30f45b213 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:37.982968 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c227745-6bff-498f-848c-87e30f45b213 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:37.992383 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95da026b-ab86-4dd1-a7d9-3c35318f4713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:37.993209 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95da026b-ab86-4dd1-a7d9-3c35318f4713 admin admin] REQUEST_METHOD: `PUT` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:37.993677 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95da026b-ab86-4dd1-a7d9-3c35318f4713 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:37.994049 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95da026b-ab86-4dd1-a7d9-3c35318f4713 admin admin] PATH_INFO: `/v3/projects/02ad30ceb65e4c38a3d96cd84d94ba6d/users/1850c34efbf54f5589e2f215f4099bad/roles/fdad79ffbcbb4fa380dc9cf7dd108618` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:38.017983 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95da026b-ab86-4dd1-a7d9-3c35318f4713 admin admin] RBAC: Authorizing `identity:create_grant(project_id=02ad30ceb65e4c38a3d96cd84d94ba6d, user_id=1850c34efbf54f5589e2f215f4099bad, role_id=fdad79ffbcbb4fa380dc9cf7dd108618)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:38.024639 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95da026b-ab86-4dd1-a7d9-3c35318f4713 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:38.050629 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1064/2141] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 00:22:37 2022] PUT /identity/v3/projects/02ad30ceb65e4c38a3d96cd84d94ba6d/users/1850c34efbf54f5589e2f215f4099bad/roles/fdad79ffbcbb4fa380dc9cf7dd108618 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:22:38.062998 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d41bbd0-824e-4697-9e9b-0b4b97687ddf None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:38.063421 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d41bbd0-824e-4697-9e9b-0b4b97687ddf None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:38.063832 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d41bbd0-824e-4697-9e9b-0b4b97687ddf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:38.100996 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-9d41bbd0-824e-4697-9e9b-0b4b97687ddf None None] MFA Rules not processed for user `1850c34efbf54f5589e2f215f4099bad`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:22:38.102358 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-9d41bbd0-824e-4697-9e9b-0b4b97687ddf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:22:38.188376 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1078/2142] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:22:38 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:22:38.201409 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95da026b-ab86-4dd1-a7d9-3c35318f4713 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:38.204232 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-95da026b-ab86-4dd1-a7d9-3c35318f4713 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:22:38.272283 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:22:38.314511 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95da026b-ab86-4dd1-a7d9-3c35318f4713 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:38.321388 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e7954d-20c8-440e-8407-47488f4b9149 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beecda6e9feb400288618745c784989f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:38.322389 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e7954d-20c8-440e-8407-47488f4b9149 service cinder] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:38.322878 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e7954d-20c8-440e-8407-47488f4b9149 service cinder] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:38.323379 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e7954d-20c8-440e-8407-47488f4b9149 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:38.340025 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e7954d-20c8-440e-8407-47488f4b9149 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:38.343403 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e7954d-20c8-440e-8407-47488f4b9149 service cinder] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:38.358436 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1065/2143] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:22:38 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:22:41.036036 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d41bbd0-824e-4697-9e9b-0b4b97687ddf None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:41.037949 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-9d41bbd0-824e-4697-9e9b-0b4b97687ddf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:22:41.075145 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:22:41.178896 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d41bbd0-824e-4697-9e9b-0b4b97687ddf None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:41.192967 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ec260d-9ab9-4944-9cb8-540937ed7ee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:41.194152 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ec260d-9ab9-4944-9cb8-540937ed7ee5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:41.194703 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ec260d-9ab9-4944-9cb8-540937ed7ee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:41.195600 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ec260d-9ab9-4944-9cb8-540937ed7ee5 admin admin] PATH_INFO: `/v3/users/b5de6d1ff4cc47ee90b25d974856b81e` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:41.199504 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ec260d-9ab9-4944-9cb8-540937ed7ee5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5de6d1ff4cc47ee90b25d974856b81e)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:41.204077 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ec260d-9ab9-4944-9cb8-540937ed7ee5 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:41.330515 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-95ec260d-9ab9-4944-9cb8-540937ed7ee5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5de6d1ff4cc47ee90b25d974856b81e'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:41.363129 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-95ec260d-9ab9-4944-9cb8-540937ed7ee5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5de6d1ff4cc47ee90b25d974856b81e'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:41.385525 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-95ec260d-9ab9-4944-9cb8-540937ed7ee5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5de6d1ff4cc47ee90b25d974856b81e'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:41.387465 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-95ec260d-9ab9-4944-9cb8-540937ed7ee5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5de6d1ff4cc47ee90b25d974856b81e'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:41.426330 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-95ec260d-9ab9-4944-9cb8-540937ed7ee5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5de6d1ff4cc47ee90b25d974856b81e'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:41.452786 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1079/2144] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 31 00:22:41 2022] DELETE /identity/v3/users/b5de6d1ff4cc47ee90b25d974856b81e => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:22:41.453586 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6b9cf1-68e8-4396-9ccc-99f7fe26d2cc None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:41.454337 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6b9cf1-68e8-4396-9ccc-99f7fe26d2cc None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:41.454493 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6b9cf1-68e8-4396-9ccc-99f7fe26d2cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:41.509858 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-2d6b9cf1-68e8-4396-9ccc-99f7fe26d2cc None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:22:41.511411 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-2d6b9cf1-68e8-4396-9ccc-99f7fe26d2cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:22:41.603889 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1066/2145] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:22:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:22:41.611196 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ec260d-9ab9-4944-9cb8-540937ed7ee5 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:41.613682 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-95ec260d-9ab9-4944-9cb8-540937ed7ee5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:22:41.744622 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ec260d-9ab9-4944-9cb8-540937ed7ee5 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:41.754560 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb42fa05-93ac-4e2a-92e0-d23f667e58b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'daae792cd11d4c4ca7aae0558998aced', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:41.755808 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb42fa05-93ac-4e2a-92e0-d23f667e58b8 service neutron] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:41.757886 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb42fa05-93ac-4e2a-92e0-d23f667e58b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:41.758492 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb42fa05-93ac-4e2a-92e0-d23f667e58b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:41.790839 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb42fa05-93ac-4e2a-92e0-d23f667e58b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:41.792957 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb42fa05-93ac-4e2a-92e0-d23f667e58b8 service neutron] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:41.810568 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1080/2146] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:22:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:22:42.248075 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6b9cf1-68e8-4396-9ccc-99f7fe26d2cc None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:42.250257 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-2d6b9cf1-68e8-4396-9ccc-99f7fe26d2cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:22:42.270528 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6b9cf1-68e8-4396-9ccc-99f7fe26d2cc None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:42.278719 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ec3af5-baf8-499c-bfdd-f6c51b853bed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:42.279388 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ec3af5-baf8-499c-bfdd-f6c51b853bed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:42.279670 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ec3af5-baf8-499c-bfdd-f6c51b853bed admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:42.279947 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ec3af5-baf8-499c-bfdd-f6c51b853bed admin admin] PATH_INFO: `/v3/projects/075279c216eb43b2a3a0d12dbd14cf63` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:42.281824 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ec3af5-baf8-499c-bfdd-f6c51b853bed admin admin] RBAC: Authorizing `identity:delete_project(project_id=075279c216eb43b2a3a0d12dbd14cf63)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:42.286577 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ec3af5-baf8-499c-bfdd-f6c51b853bed admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:42.343499 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-e0ec3af5-baf8-499c-bfdd-f6c51b853bed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '075279c216eb43b2a3a0d12dbd14cf63', 'request_id': 'req-e0ec3af5-baf8-499c-bfdd-f6c51b853bed'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:42.351098 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-e0ec3af5-baf8-499c-bfdd-f6c51b853bed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '075279c216eb43b2a3a0d12dbd14cf63', 'request_id': 'req-e0ec3af5-baf8-499c-bfdd-f6c51b853bed'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:42.357658 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-e0ec3af5-baf8-499c-bfdd-f6c51b853bed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '075279c216eb43b2a3a0d12dbd14cf63', 'request_id': 'req-e0ec3af5-baf8-499c-bfdd-f6c51b853bed'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:42.372891 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-e0ec3af5-baf8-499c-bfdd-f6c51b853bed admin admin] The token cache is being invalidate because project 075279c216eb43b2a3a0d12dbd14cf63 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81523) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:22:42.373177 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-e0ec3af5-baf8-499c-bfdd-f6c51b853bed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:42.373835 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-e0ec3af5-baf8-499c-bfdd-f6c51b853bed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:42.375562 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1067/2147] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 31 00:22:42 2022] DELETE /identity/v3/projects/075279c216eb43b2a3a0d12dbd14cf63 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:22:42.381476 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeef4bf-b3d7-47b2-88d4-0841bbb7a545 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:42.382022 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeef4bf-b3d7-47b2-88d4-0841bbb7a545 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:42.382147 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeef4bf-b3d7-47b2-88d4-0841bbb7a545 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:42.404015 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-adeef4bf-b3d7-47b2-88d4-0841bbb7a545 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:22:42.405305 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-adeef4bf-b3d7-47b2-88d4-0841bbb7a545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:22:42.453051 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:22:42.481975 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1081/2148] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:22:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:22:42.490584 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ee038a-bd41-4341-857b-046e94d7aa41 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:42.491163 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ee038a-bd41-4341-857b-046e94d7aa41 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:42.491163 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ee038a-bd41-4341-857b-046e94d7aa41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:42.520504 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-33ee038a-bd41-4341-857b-046e94d7aa41 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:22:42.522846 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-33ee038a-bd41-4341-857b-046e94d7aa41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:22:42.542901 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1068/2149] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:22:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:22:42.544450 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adeef4bf-b3d7-47b2-88d4-0841bbb7a545 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:42.559191 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adeef4bf-b3d7-47b2-88d4-0841bbb7a545 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:42.567283 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4397ab-f961-426f-8654-a8476abcc29f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:42.568137 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4397ab-f961-426f-8654-a8476abcc29f admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:42.568594 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4397ab-f961-426f-8654-a8476abcc29f admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:42.569044 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4397ab-f961-426f-8654-a8476abcc29f admin admin] PATH_INFO: `/v3/domains` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:42.579648 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4397ab-f961-426f-8654-a8476abcc29f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:22:42.579648 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4397ab-f961-426f-8654-a8476abcc29f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:42.579648 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4397ab-f961-426f-8654-a8476abcc29f admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:42.590194 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1082/2150] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 31 00:22:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:22:42.594698 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ee038a-bd41-4341-857b-046e94d7aa41 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:42.607156 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ee038a-bd41-4341-857b-046e94d7aa41 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:42.612471 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e37cf8-8531-4806-9601-0bdf4603fc5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:42.613148 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e37cf8-8531-4806-9601-0bdf4603fc5a admin admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:42.613427 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e37cf8-8531-4806-9601-0bdf4603fc5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:42.613794 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e37cf8-8531-4806-9601-0bdf4603fc5a admin admin] PATH_INFO: `/v3/projects` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:42.614477 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e37cf8-8531-4806-9601-0bdf4603fc5a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:42.617688 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e37cf8-8531-4806-9601-0bdf4603fc5a admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:42.661088 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1069/2151] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 31 00:22:42 2022] POST /identity/v3/projects => generated 375 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:22:42.666080 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4397ab-f961-426f-8654-a8476abcc29f admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:42.684101 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4397ab-f961-426f-8654-a8476abcc29f admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:42.814998 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd87f42-8cf4-4255-9b12-d6bf4a8dde5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:42.816649 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd87f42-8cf4-4255-9b12-d6bf4a8dde5a admin admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:42.817069 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd87f42-8cf4-4255-9b12-d6bf4a8dde5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:42.817482 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd87f42-8cf4-4255-9b12-d6bf4a8dde5a admin admin] PATH_INFO: `/v3/users` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:42.818284 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd87f42-8cf4-4255-9b12-d6bf4a8dde5a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:42.820480 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd87f42-8cf4-4255-9b12-d6bf4a8dde5a admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:42.871066 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1083/2152] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 31 00:22:42 2022] POST /identity/v3/users => generated 288 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:22:42.873980 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e37cf8-8531-4806-9601-0bdf4603fc5a admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:42.899767 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e37cf8-8531-4806-9601-0bdf4603fc5a admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:42.913466 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36a86e6-f16c-4d23-b306-b25f360af03e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:42.914570 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36a86e6-f16c-4d23-b306-b25f360af03e admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:42.915071 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36a86e6-f16c-4d23-b306-b25f360af03e admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:42.915599 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36a86e6-f16c-4d23-b306-b25f360af03e admin admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:42.916837 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36a86e6-f16c-4d23-b306-b25f360af03e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:42.919795 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36a86e6-f16c-4d23-b306-b25f360af03e admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:42.934471 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1070/2153] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 00:22:42 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:22:42.939451 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd87f42-8cf4-4255-9b12-d6bf4a8dde5a admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:42.959026 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd87f42-8cf4-4255-9b12-d6bf4a8dde5a admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:42.967648 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e23cc3-84fd-4323-bee4-fcf1b72d4242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:42.968842 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e23cc3-84fd-4323-bee4-fcf1b72d4242 admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:42.969235 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e23cc3-84fd-4323-bee4-fcf1b72d4242 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:42.970039 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e23cc3-84fd-4323-bee4-fcf1b72d4242 admin admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:42.971266 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e23cc3-84fd-4323-bee4-fcf1b72d4242 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:42.974455 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e23cc3-84fd-4323-bee4-fcf1b72d4242 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:42.994415 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1084/2154] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 00:22:42 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:22:43.000348 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36a86e6-f16c-4d23-b306-b25f360af03e admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:43.014915 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36a86e6-f16c-4d23-b306-b25f360af03e admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:43.021150 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6644612-be9f-4ba3-bfe1-c82a121595ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:43.022366 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6644612-be9f-4ba3-bfe1-c82a121595ea admin admin] REQUEST_METHOD: `PUT` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:43.022855 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6644612-be9f-4ba3-bfe1-c82a121595ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:43.023350 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6644612-be9f-4ba3-bfe1-c82a121595ea admin admin] PATH_INFO: `/v3/projects/8d6c9b5895b147c6a9a4a67867fe5940/users/4b2e6211135247608a6a3a6dbadc2912/roles/fdad79ffbcbb4fa380dc9cf7dd108618` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:43.053747 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6644612-be9f-4ba3-bfe1-c82a121595ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d6c9b5895b147c6a9a4a67867fe5940, user_id=4b2e6211135247608a6a3a6dbadc2912, role_id=fdad79ffbcbb4fa380dc9cf7dd108618)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:43.057517 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6644612-be9f-4ba3-bfe1-c82a121595ea admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:43.061721 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:22:43.092518 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1071/2155] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 00:22:42 2022] PUT /identity/v3/projects/8d6c9b5895b147c6a9a4a67867fe5940/users/4b2e6211135247608a6a3a6dbadc2912/roles/fdad79ffbcbb4fa380dc9cf7dd108618 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:22:43.099385 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1629a48-3b92-417f-b73d-c0e74e689a5f None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:43.099814 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1629a48-3b92-417f-b73d-c0e74e689a5f None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:43.100241 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1629a48-3b92-417f-b73d-c0e74e689a5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:43.146730 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-d1629a48-3b92-417f-b73d-c0e74e689a5f None None] MFA Rules not processed for user `4b2e6211135247608a6a3a6dbadc2912`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:22:43.148874 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-d1629a48-3b92-417f-b73d-c0e74e689a5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:22:43.250968 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1085/2156] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:22:43 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:22:43.266241 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6644612-be9f-4ba3-bfe1-c82a121595ea admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:43.269120 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-e6644612-be9f-4ba3-bfe1-c82a121595ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:22:43.363718 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6644612-be9f-4ba3-bfe1-c82a121595ea admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:43.368606 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b67cb4-9feb-445f-b270-53ecfb543c69 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beecda6e9feb400288618745c784989f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:43.369245 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b67cb4-9feb-445f-b270-53ecfb543c69 service cinder] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:43.369550 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b67cb4-9feb-445f-b270-53ecfb543c69 service cinder] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:43.369826 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b67cb4-9feb-445f-b270-53ecfb543c69 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:43.380458 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b67cb4-9feb-445f-b270-53ecfb543c69 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:43.381857 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b67cb4-9feb-445f-b270-53ecfb543c69 service cinder] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:43.392392 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1072/2157] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:22:43 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:22:46.187001 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1629a48-3b92-417f-b73d-c0e74e689a5f None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:46.189218 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-d1629a48-3b92-417f-b73d-c0e74e689a5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:22:46.303390 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:22:46.357252 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1629a48-3b92-417f-b73d-c0e74e689a5f None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:46.363091 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a22fb2-3ca2-43be-929e-5d8caa851f69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:46.364044 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a22fb2-3ca2-43be-929e-5d8caa851f69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:46.364367 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a22fb2-3ca2-43be-929e-5d8caa851f69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:46.364646 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a22fb2-3ca2-43be-929e-5d8caa851f69 admin admin] PATH_INFO: `/v3/users/23b8a48086e141948da4703ad299f671` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:46.366129 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a22fb2-3ca2-43be-929e-5d8caa851f69 admin admin] RBAC: Authorizing `identity:delete_user(user_id=23b8a48086e141948da4703ad299f671)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:46.368134 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a22fb2-3ca2-43be-929e-5d8caa851f69 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:46.459483 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-83a22fb2-3ca2-43be-929e-5d8caa851f69 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23b8a48086e141948da4703ad299f671'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:46.471624 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-83a22fb2-3ca2-43be-929e-5d8caa851f69 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23b8a48086e141948da4703ad299f671'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:46.489402 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-83a22fb2-3ca2-43be-929e-5d8caa851f69 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23b8a48086e141948da4703ad299f671'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:46.490145 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-83a22fb2-3ca2-43be-929e-5d8caa851f69 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23b8a48086e141948da4703ad299f671'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:46.512416 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-83a22fb2-3ca2-43be-929e-5d8caa851f69 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23b8a48086e141948da4703ad299f671'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:46.525703 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1086/2158] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 31 00:22:46 2022] DELETE /identity/v3/users/23b8a48086e141948da4703ad299f671 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:22:46.530906 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811f5813-6aac-4974-9d60-c3cd49451a22 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:46.532642 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811f5813-6aac-4974-9d60-c3cd49451a22 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:46.533367 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811f5813-6aac-4974-9d60-c3cd49451a22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:46.566899 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-811f5813-6aac-4974-9d60-c3cd49451a22 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:22:46.568555 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-811f5813-6aac-4974-9d60-c3cd49451a22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:22:46.683718 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1073/2159] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:22:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:22:46.702465 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a22fb2-3ca2-43be-929e-5d8caa851f69 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:46.704124 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-83a22fb2-3ca2-43be-929e-5d8caa851f69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:22:46.797437 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a22fb2-3ca2-43be-929e-5d8caa851f69 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:46.802473 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9651a02c-bf25-46ad-a3c6-48e73b1a7b24 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'daae792cd11d4c4ca7aae0558998aced', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:46.802969 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9651a02c-bf25-46ad-a3c6-48e73b1a7b24 service neutron] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:46.803409 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9651a02c-bf25-46ad-a3c6-48e73b1a7b24 service neutron] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:46.803699 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9651a02c-bf25-46ad-a3c6-48e73b1a7b24 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:46.816475 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9651a02c-bf25-46ad-a3c6-48e73b1a7b24 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:46.818177 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9651a02c-bf25-46ad-a3c6-48e73b1a7b24 service neutron] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:46.834887 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1087/2160] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:22:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 00:22:47.926166 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811f5813-6aac-4974-9d60-c3cd49451a22 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:47.931814 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-811f5813-6aac-4974-9d60-c3cd49451a22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:22:47.962877 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811f5813-6aac-4974-9d60-c3cd49451a22 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:47.975113 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff95869f-b8db-4138-8b17-4252acc32095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:47.976300 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff95869f-b8db-4138-8b17-4252acc32095 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:47.976887 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff95869f-b8db-4138-8b17-4252acc32095 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:47.977414 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff95869f-b8db-4138-8b17-4252acc32095 admin admin] PATH_INFO: `/v3/projects/b7806f1130cb456399af33f7b72d21aa` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:47.979547 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff95869f-b8db-4138-8b17-4252acc32095 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7806f1130cb456399af33f7b72d21aa)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:47.983870 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff95869f-b8db-4138-8b17-4252acc32095 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:48.083409 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-ff95869f-b8db-4138-8b17-4252acc32095 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7806f1130cb456399af33f7b72d21aa', 'request_id': 'req-ff95869f-b8db-4138-8b17-4252acc32095'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:48.092652 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-ff95869f-b8db-4138-8b17-4252acc32095 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7806f1130cb456399af33f7b72d21aa', 'request_id': 'req-ff95869f-b8db-4138-8b17-4252acc32095'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:48.102082 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-ff95869f-b8db-4138-8b17-4252acc32095 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7806f1130cb456399af33f7b72d21aa', 'request_id': 'req-ff95869f-b8db-4138-8b17-4252acc32095'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:48.131314 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-ff95869f-b8db-4138-8b17-4252acc32095 admin admin] The token cache is being invalidate because project b7806f1130cb456399af33f7b72d21aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81523) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:22:48.131844 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-ff95869f-b8db-4138-8b17-4252acc32095 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:48.133232 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-ff95869f-b8db-4138-8b17-4252acc32095 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:48.138755 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1074/2161] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 31 00:22:47 2022] DELETE /identity/v3/projects/b7806f1130cb456399af33f7b72d21aa => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:22:48.146434 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d6858c-28d4-4426-bec0-7e084b536937 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:48.147274 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d6858c-28d4-4426-bec0-7e084b536937 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:48.147274 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d6858c-28d4-4426-bec0-7e084b536937 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:48.173270 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-b2d6858c-28d4-4426-bec0-7e084b536937 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:22:48.174495 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-b2d6858c-28d4-4426-bec0-7e084b536937 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:22:48.263013 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:22:48.288644 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1088/2162] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:22:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:22:48.291739 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9774c2c1-7de1-4ad7-953b-d6cecd04e6e0 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:48.292113 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9774c2c1-7de1-4ad7-953b-d6cecd04e6e0 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:48.292486 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9774c2c1-7de1-4ad7-953b-d6cecd04e6e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:48.316443 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-9774c2c1-7de1-4ad7-953b-d6cecd04e6e0 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:22:48.318637 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-9774c2c1-7de1-4ad7-953b-d6cecd04e6e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:22:48.336008 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1075/2163] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:22:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:22:48.337908 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d6858c-28d4-4426-bec0-7e084b536937 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:48.352216 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d6858c-28d4-4426-bec0-7e084b536937 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:48.358086 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2a02db-df37-4c0e-b48a-4b3b6ebd2186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:48.359184 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2a02db-df37-4c0e-b48a-4b3b6ebd2186 admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:48.359595 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2a02db-df37-4c0e-b48a-4b3b6ebd2186 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:48.359982 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2a02db-df37-4c0e-b48a-4b3b6ebd2186 admin admin] PATH_INFO: `/v3/domains` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:48.360903 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2a02db-df37-4c0e-b48a-4b3b6ebd2186 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:22:48.361307 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2a02db-df37-4c0e-b48a-4b3b6ebd2186 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:48.364325 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2a02db-df37-4c0e-b48a-4b3b6ebd2186 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:48.383383 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1089/2164] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 31 00:22:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:22:48.389058 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9774c2c1-7de1-4ad7-953b-d6cecd04e6e0 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:48.400996 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9774c2c1-7de1-4ad7-953b-d6cecd04e6e0 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:48.406837 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1155f0a-f073-44bc-887b-31ce60f9d102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:48.407670 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1155f0a-f073-44bc-887b-31ce60f9d102 admin admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:48.408002 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1155f0a-f073-44bc-887b-31ce60f9d102 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:48.408396 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1155f0a-f073-44bc-887b-31ce60f9d102 admin admin] PATH_INFO: `/v3/projects` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:48.409838 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1155f0a-f073-44bc-887b-31ce60f9d102 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:48.412115 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1155f0a-f073-44bc-887b-31ce60f9d102 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:48.427979 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:INSERT=2,keystone:SELECT=91,keystone:DELETE=7 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:22:48.452740 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1076/2165] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 31 00:22:48 2022] POST /identity/v3/projects => generated 381 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:22:48.460273 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2a02db-df37-4c0e-b48a-4b3b6ebd2186 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:48.473649 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2a02db-df37-4c0e-b48a-4b3b6ebd2186 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:48.563659 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ca3a63-0c35-4f2c-9df1-17c88a5aa9b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:48.564465 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ca3a63-0c35-4f2c-9df1-17c88a5aa9b5 admin admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:48.564900 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ca3a63-0c35-4f2c-9df1-17c88a5aa9b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:48.565309 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ca3a63-0c35-4f2c-9df1-17c88a5aa9b5 admin admin] PATH_INFO: `/v3/users` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:48.566163 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ca3a63-0c35-4f2c-9df1-17c88a5aa9b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:48.569073 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ca3a63-0c35-4f2c-9df1-17c88a5aa9b5 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:48.609638 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1090/2166] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 31 00:22:48 2022] POST /identity/v3/users => generated 291 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:22:48.616111 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1155f0a-f073-44bc-887b-31ce60f9d102 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:48.638288 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1155f0a-f073-44bc-887b-31ce60f9d102 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:48.647584 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5486453e-c439-4dbd-b06e-8f75f0afd93f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:48.648126 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5486453e-c439-4dbd-b06e-8f75f0afd93f admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:48.648634 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5486453e-c439-4dbd-b06e-8f75f0afd93f admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:48.649092 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5486453e-c439-4dbd-b06e-8f75f0afd93f admin admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:48.652227 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5486453e-c439-4dbd-b06e-8f75f0afd93f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:48.654001 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5486453e-c439-4dbd-b06e-8f75f0afd93f admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:48.675970 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1077/2167] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 00:22:48 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 00:22:48.682107 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ca3a63-0c35-4f2c-9df1-17c88a5aa9b5 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:48.702607 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ca3a63-0c35-4f2c-9df1-17c88a5aa9b5 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:48.713908 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6833992a-158a-4694-83f4-a22759547c81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:48.715226 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6833992a-158a-4694-83f4-a22759547c81 admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:48.715888 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6833992a-158a-4694-83f4-a22759547c81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:48.716583 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6833992a-158a-4694-83f4-a22759547c81 admin admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:48.717952 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6833992a-158a-4694-83f4-a22759547c81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:48.722336 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6833992a-158a-4694-83f4-a22759547c81 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:48.741761 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1091/2168] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 00:22:48 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:22:48.747020 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5486453e-c439-4dbd-b06e-8f75f0afd93f admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:48.761973 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5486453e-c439-4dbd-b06e-8f75f0afd93f admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:48.769477 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0788e13-8ce3-4287-8785-ec066f658178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:48.770579 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0788e13-8ce3-4287-8785-ec066f658178 admin admin] REQUEST_METHOD: `PUT` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:48.771054 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0788e13-8ce3-4287-8785-ec066f658178 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:48.771518 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0788e13-8ce3-4287-8785-ec066f658178 admin admin] PATH_INFO: `/v3/projects/29f449e37cc6482eaca34671c7541c4b/users/c9dd5782e5f84ed68282cdda78ce909f/roles/fdad79ffbcbb4fa380dc9cf7dd108618` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:48.800569 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0788e13-8ce3-4287-8785-ec066f658178 admin admin] RBAC: Authorizing `identity:create_grant(project_id=29f449e37cc6482eaca34671c7541c4b, user_id=c9dd5782e5f84ed68282cdda78ce909f, role_id=fdad79ffbcbb4fa380dc9cf7dd108618)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:48.803550 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0788e13-8ce3-4287-8785-ec066f658178 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:48.828708 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1078/2169] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 00:22:48 2022] PUT /identity/v3/projects/29f449e37cc6482eaca34671c7541c4b/users/c9dd5782e5f84ed68282cdda78ce909f/roles/fdad79ffbcbb4fa380dc9cf7dd108618 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:22:48.832399 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9379eaaa-6afa-4621-a892-25e8b0fe598a None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:48.832972 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9379eaaa-6afa-4621-a892-25e8b0fe598a None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:48.833535 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9379eaaa-6afa-4621-a892-25e8b0fe598a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:48.869792 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-9379eaaa-6afa-4621-a892-25e8b0fe598a None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:22:48.871802 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-9379eaaa-6afa-4621-a892-25e8b0fe598a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:22:49.058305 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1092/2170] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:22:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:22:49.086754 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0788e13-8ce3-4287-8785-ec066f658178 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:49.089792 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-e0788e13-8ce3-4287-8785-ec066f658178 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:22:49.195467 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0788e13-8ce3-4287-8785-ec066f658178 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:49.201834 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a421e3-eee2-4784-a3ab-ed91831a41d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'daae792cd11d4c4ca7aae0558998aced', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:49.203036 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a421e3-eee2-4784-a3ab-ed91831a41d9 service neutron] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:49.203504 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a421e3-eee2-4784-a3ab-ed91831a41d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:49.203994 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a421e3-eee2-4784-a3ab-ed91831a41d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:49.218822 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a421e3-eee2-4784-a3ab-ed91831a41d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:49.221161 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a421e3-eee2-4784-a3ab-ed91831a41d9 service neutron] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:49.238123 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1079/2171] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:22:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 00:22:50.504773 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342e9930-8d8c-4e4f-a974-f9520a4835c0 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:50.504773 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342e9930-8d8c-4e4f-a974-f9520a4835c0 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:50.504773 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342e9930-8d8c-4e4f-a974-f9520a4835c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:50.571586 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-342e9930-8d8c-4e4f-a974-f9520a4835c0 None None] MFA Rules not processed for user `c9dd5782e5f84ed68282cdda78ce909f`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:22:50.576458 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-342e9930-8d8c-4e4f-a974-f9520a4835c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:22:50.737304 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:22:50.765581 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1093/2172] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:22:50 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:22:50.785044 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a421e3-eee2-4784-a3ab-ed91831a41d9 service neutron] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:50.796218 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-81a421e3-eee2-4784-a3ab-ed91831a41d9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:22:50.944006 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a421e3-eee2-4784-a3ab-ed91831a41d9 service neutron] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:50.952706 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a166c5-b3b4-4278-86e0-59a4602c2083 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beecda6e9feb400288618745c784989f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:50.954139 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a166c5-b3b4-4278-86e0-59a4602c2083 service cinder] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:50.954619 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a166c5-b3b4-4278-86e0-59a4602c2083 service cinder] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:50.955101 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a166c5-b3b4-4278-86e0-59a4602c2083 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:50.970984 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a166c5-b3b4-4278-86e0-59a4602c2083 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:50.974392 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a166c5-b3b4-4278-86e0-59a4602c2083 service cinder] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:51.002283 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1080/2173] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:22:50 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:22:52.641052 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ad3978-d151-44e1-bc30-78bdbe0b09f0 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:52.641752 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ad3978-d151-44e1-bc30-78bdbe0b09f0 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:52.641896 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ad3978-d151-44e1-bc30-78bdbe0b09f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:52.675318 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-c6ad3978-d151-44e1-bc30-78bdbe0b09f0 None None] MFA Rules not processed for user `c9dd5782e5f84ed68282cdda78ce909f`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:22:52.677607 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-c6ad3978-d151-44e1-bc30-78bdbe0b09f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:22:52.703531 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1094/2174] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:22:52 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:22:56.049229 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a166c5-b3b4-4278-86e0-59a4602c2083 service cinder] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:56.051977 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-a3a166c5-b3b4-4278-86e0-59a4602c2083 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:22:56.089144 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a166c5-b3b4-4278-86e0-59a4602c2083 service cinder] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:56.102946 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4be8215-0a7d-48d8-b3d4-59ea406c0702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:56.104120 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4be8215-0a7d-48d8-b3d4-59ea406c0702 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:56.104969 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4be8215-0a7d-48d8-b3d4-59ea406c0702 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:56.105869 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4be8215-0a7d-48d8-b3d4-59ea406c0702 admin admin] PATH_INFO: `/v3/users/4b2e6211135247608a6a3a6dbadc2912` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:56.108639 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4be8215-0a7d-48d8-b3d4-59ea406c0702 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b2e6211135247608a6a3a6dbadc2912)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:56.113819 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4be8215-0a7d-48d8-b3d4-59ea406c0702 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:56.245486 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-c4be8215-0a7d-48d8-b3d4-59ea406c0702 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b2e6211135247608a6a3a6dbadc2912'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:56.275968 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-c4be8215-0a7d-48d8-b3d4-59ea406c0702 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b2e6211135247608a6a3a6dbadc2912'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:56.278293 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:22:56.289925 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-c4be8215-0a7d-48d8-b3d4-59ea406c0702 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b2e6211135247608a6a3a6dbadc2912'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:56.317704 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-c4be8215-0a7d-48d8-b3d4-59ea406c0702 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b2e6211135247608a6a3a6dbadc2912'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:56.318681 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-c4be8215-0a7d-48d8-b3d4-59ea406c0702 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b2e6211135247608a6a3a6dbadc2912'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:56.333841 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1081/2175] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 31 00:22:56 2022] DELETE /identity/v3/users/4b2e6211135247608a6a3a6dbadc2912 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:22:56.340855 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7053cf8e-6b45-47da-9a27-e1caa5628721 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:56.341750 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7053cf8e-6b45-47da-9a27-e1caa5628721 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:56.341750 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7053cf8e-6b45-47da-9a27-e1caa5628721 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:56.375775 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-7053cf8e-6b45-47da-9a27-e1caa5628721 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:22:56.380230 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-7053cf8e-6b45-47da-9a27-e1caa5628721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:22:56.610212 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1095/2176] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:22:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:22:56.621189 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4be8215-0a7d-48d8-b3d4-59ea406c0702 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:56.624198 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-c4be8215-0a7d-48d8-b3d4-59ea406c0702 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:22:56.788237 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4be8215-0a7d-48d8-b3d4-59ea406c0702 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:56.806167 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955785d4-9a90-4161-a839-9460e8d5d92e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'daae792cd11d4c4ca7aae0558998aced', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:56.807244 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955785d4-9a90-4161-a839-9460e8d5d92e service neutron] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:56.807783 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955785d4-9a90-4161-a839-9460e8d5d92e service neutron] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:56.808332 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955785d4-9a90-4161-a839-9460e8d5d92e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:56.830530 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955785d4-9a90-4161-a839-9460e8d5d92e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:56.835247 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955785d4-9a90-4161-a839-9460e8d5d92e service neutron] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:56.870759 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1082/2177] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:22:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:22:57.008423 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a1ed88-f69f-4a42-97c9-7f3fa581e4b5 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:57.008423 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a1ed88-f69f-4a42-97c9-7f3fa581e4b5 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:57.008423 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a1ed88-f69f-4a42-97c9-7f3fa581e4b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:57.067389 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-01a1ed88-f69f-4a42-97c9-7f3fa581e4b5 None None] MFA Rules not processed for user `f8ffd2d3c0c141118a7a9a5696c383e1`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:22:57.069682 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-01a1ed88-f69f-4a42-97c9-7f3fa581e4b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:22:57.186126 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1096/2178] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:22:57 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:22:57.421873 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955785d4-9a90-4161-a839-9460e8d5d92e service neutron] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:57.425393 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-955785d4-9a90-4161-a839-9460e8d5d92e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:22:57.452840 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955785d4-9a90-4161-a839-9460e8d5d92e service neutron] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:57.459287 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb45f2e2-a171-4ac3-80ae-c53872612a00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:57.460512 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb45f2e2-a171-4ac3-80ae-c53872612a00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:57.461245 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb45f2e2-a171-4ac3-80ae-c53872612a00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:57.462030 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb45f2e2-a171-4ac3-80ae-c53872612a00 admin admin] PATH_INFO: `/v3/projects/8d6c9b5895b147c6a9a4a67867fe5940` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:57.464211 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb45f2e2-a171-4ac3-80ae-c53872612a00 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d6c9b5895b147c6a9a4a67867fe5940)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:57.468143 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb45f2e2-a171-4ac3-80ae-c53872612a00 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:57.588862 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-cb45f2e2-a171-4ac3-80ae-c53872612a00 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d6c9b5895b147c6a9a4a67867fe5940', 'request_id': 'req-cb45f2e2-a171-4ac3-80ae-c53872612a00'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:57.602117 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-cb45f2e2-a171-4ac3-80ae-c53872612a00 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d6c9b5895b147c6a9a4a67867fe5940', 'request_id': 'req-cb45f2e2-a171-4ac3-80ae-c53872612a00'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:57.610469 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-cb45f2e2-a171-4ac3-80ae-c53872612a00 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d6c9b5895b147c6a9a4a67867fe5940', 'request_id': 'req-cb45f2e2-a171-4ac3-80ae-c53872612a00'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:57.628590 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-cb45f2e2-a171-4ac3-80ae-c53872612a00 admin admin] The token cache is being invalidate because project 8d6c9b5895b147c6a9a4a67867fe5940 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81523) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:22:57.628590 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-cb45f2e2-a171-4ac3-80ae-c53872612a00 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:57.629814 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-cb45f2e2-a171-4ac3-80ae-c53872612a00 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:22:57.632454 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1083/2179] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 31 00:22:57 2022] DELETE /identity/v3/projects/8d6c9b5895b147c6a9a4a67867fe5940 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:22:57.637732 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d33258-26d7-4c9b-8e89-e90dbd4c00ba None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:57.638527 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d33258-26d7-4c9b-8e89-e90dbd4c00ba None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:57.638527 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d33258-26d7-4c9b-8e89-e90dbd4c00ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:57.663495 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-a5d33258-26d7-4c9b-8e89-e90dbd4c00ba None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:22:57.664775 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-a5d33258-26d7-4c9b-8e89-e90dbd4c00ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:22:57.791030 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1097/2180] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:22:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:22:57.801691 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5938e35e-541e-475f-9605-b48929b9ef8e None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:57.802201 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5938e35e-541e-475f-9605-b48929b9ef8e None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:57.802689 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5938e35e-541e-475f-9605-b48929b9ef8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:57.843036 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-5938e35e-541e-475f-9605-b48929b9ef8e None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:22:57.845669 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-5938e35e-541e-475f-9605-b48929b9ef8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:22:57.868933 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1084/2181] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:22:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:22:57.870462 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d33258-26d7-4c9b-8e89-e90dbd4c00ba None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:57.912487 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d33258-26d7-4c9b-8e89-e90dbd4c00ba None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:57.935561 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef19635-764c-4788-bc7e-406d56d104f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:57.936783 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef19635-764c-4788-bc7e-406d56d104f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:57.937342 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef19635-764c-4788-bc7e-406d56d104f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:57.937901 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef19635-764c-4788-bc7e-406d56d104f5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:57.939216 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef19635-764c-4788-bc7e-406d56d104f5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:22:57.939818 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef19635-764c-4788-bc7e-406d56d104f5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:57.943699 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef19635-764c-4788-bc7e-406d56d104f5 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:57.972351 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1098/2182] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 31 00:22:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:22:57.976203 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5938e35e-541e-475f-9605-b48929b9ef8e None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:58.006859 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5938e35e-541e-475f-9605-b48929b9ef8e None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:58.014032 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4243f0d5-5d67-4041-a4e4-184bd4239ebd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:58.014817 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4243f0d5-5d67-4041-a4e4-184bd4239ebd admin admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:58.015301 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4243f0d5-5d67-4041-a4e4-184bd4239ebd admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:58.015708 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4243f0d5-5d67-4041-a4e4-184bd4239ebd admin admin] PATH_INFO: `/v3/projects` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:58.016686 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4243f0d5-5d67-4041-a4e4-184bd4239ebd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:58.020099 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4243f0d5-5d67-4041-a4e4-184bd4239ebd admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:58.072628 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1085/2183] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 31 00:22:57 2022] POST /identity/v3/projects => generated 373 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:22:58.078571 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef19635-764c-4788-bc7e-406d56d104f5 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:58.101090 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef19635-764c-4788-bc7e-406d56d104f5 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:58.142935 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:22:58.217517 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2460ee5b-8b32-4b6e-84bc-2a3d20c32cc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:58.217517 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2460ee5b-8b32-4b6e-84bc-2a3d20c32cc4 admin admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:58.217517 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2460ee5b-8b32-4b6e-84bc-2a3d20c32cc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:58.218150 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2460ee5b-8b32-4b6e-84bc-2a3d20c32cc4 admin admin] PATH_INFO: `/v3/users` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:58.218585 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2460ee5b-8b32-4b6e-84bc-2a3d20c32cc4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:58.221858 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2460ee5b-8b32-4b6e-84bc-2a3d20c32cc4 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:58.264262 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1099/2184] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 31 00:22:58 2022] POST /identity/v3/users => generated 287 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:22:58.271491 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4243f0d5-5d67-4041-a4e4-184bd4239ebd admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:58.290644 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4243f0d5-5d67-4041-a4e4-184bd4239ebd admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:58.329104 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32fc991-a27f-4682-8504-ddf73b24ff90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:58.330134 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32fc991-a27f-4682-8504-ddf73b24ff90 admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:58.330644 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32fc991-a27f-4682-8504-ddf73b24ff90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:58.331100 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32fc991-a27f-4682-8504-ddf73b24ff90 admin admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:58.335417 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32fc991-a27f-4682-8504-ddf73b24ff90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:58.339315 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32fc991-a27f-4682-8504-ddf73b24ff90 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:58.372881 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1086/2185] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 00:22:58 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 00:22:58.375856 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2460ee5b-8b32-4b6e-84bc-2a3d20c32cc4 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:58.417384 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2460ee5b-8b32-4b6e-84bc-2a3d20c32cc4 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:58.441844 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800d1a59-60db-4697-8e7d-500f30be2453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:58.443080 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800d1a59-60db-4697-8e7d-500f30be2453 admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:58.443573 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800d1a59-60db-4697-8e7d-500f30be2453 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:58.444056 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800d1a59-60db-4697-8e7d-500f30be2453 admin admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:58.445295 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800d1a59-60db-4697-8e7d-500f30be2453 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:58.452778 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800d1a59-60db-4697-8e7d-500f30be2453 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:58.478538 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1100/2186] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 00:22:58 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 00:22:58.483827 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32fc991-a27f-4682-8504-ddf73b24ff90 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:58.503727 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32fc991-a27f-4682-8504-ddf73b24ff90 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:58.513506 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e7089a-44ee-4844-810f-43da46d5d9c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:58.515087 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e7089a-44ee-4844-810f-43da46d5d9c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:58.516271 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e7089a-44ee-4844-810f-43da46d5d9c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:58.517008 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e7089a-44ee-4844-810f-43da46d5d9c4 admin admin] PATH_INFO: `/v3/projects/9e164298f9d449498f1c7b4c06a839be/users/46a26318c91b4976970c88d3c967ca10/roles/fdad79ffbcbb4fa380dc9cf7dd108618` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:58.552412 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e7089a-44ee-4844-810f-43da46d5d9c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e164298f9d449498f1c7b4c06a839be, user_id=46a26318c91b4976970c88d3c967ca10, role_id=fdad79ffbcbb4fa380dc9cf7dd108618)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:58.558516 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e7089a-44ee-4844-810f-43da46d5d9c4 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:58.566669 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:INSERT=4,keystone:DELETE=10,keystone:SELECT=86 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:22:58.605206 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1087/2187] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 00:22:58 2022] PUT /identity/v3/projects/9e164298f9d449498f1c7b4c06a839be/users/46a26318c91b4976970c88d3c967ca10/roles/fdad79ffbcbb4fa380dc9cf7dd108618 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:22:58.622909 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed3e6ac-a80c-42be-a954-4b74f5c34ffd None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:58.622909 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed3e6ac-a80c-42be-a954-4b74f5c34ffd None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:58.622909 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed3e6ac-a80c-42be-a954-4b74f5c34ffd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:58.680933 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-6ed3e6ac-a80c-42be-a954-4b74f5c34ffd None None] MFA Rules not processed for user `46a26318c91b4976970c88d3c967ca10`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:22:58.683063 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-6ed3e6ac-a80c-42be-a954-4b74f5c34ffd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:22:58.888591 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1101/2188] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:22:58 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:22:58.910975 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e7089a-44ee-4844-810f-43da46d5d9c4 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:58.912879 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-b3e7089a-44ee-4844-810f-43da46d5d9c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:22:58.993221 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e7089a-44ee-4844-810f-43da46d5d9c4 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:58.998706 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd322ca8-a1c9-4983-905e-00cfdef8d17a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beecda6e9feb400288618745c784989f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:58.998706 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd322ca8-a1c9-4983-905e-00cfdef8d17a service cinder] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:58.998706 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd322ca8-a1c9-4983-905e-00cfdef8d17a service cinder] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:58.998706 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd322ca8-a1c9-4983-905e-00cfdef8d17a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:59.010050 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd322ca8-a1c9-4983-905e-00cfdef8d17a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:59.012526 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd322ca8-a1c9-4983-905e-00cfdef8d17a service cinder] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:59.032405 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1088/2189] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:22:58 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:22:59.259519 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b915d77-acff-4c05-afaf-58c7922c0038 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:59.259938 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b915d77-acff-4c05-afaf-58c7922c0038 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:59.260485 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b915d77-acff-4c05-afaf-58c7922c0038 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:59.306729 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-7b915d77-acff-4c05-afaf-58c7922c0038 None None] MFA Rules not processed for user `601aa9e547aa4d42bef6753b26f48eaa`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:22:59.309888 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-7b915d77-acff-4c05-afaf-58c7922c0038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:22:59.423875 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1102/2190] 10.222.0.47 () {58 vars in 1009 bytes} [Wed Aug 31 00:22:59 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:22:59.487006 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd322ca8-a1c9-4983-905e-00cfdef8d17a service cinder] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:22:59.488913 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-fd322ca8-a1c9-4983-905e-00cfdef8d17a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:22:59.586369 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd322ca8-a1c9-4983-905e-00cfdef8d17a service cinder] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:22:59.595189 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccd5c7e-958a-466a-b4e5-554dc24ef0c4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffbfbf19509645f49dbf9566e447c8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:22:59.595936 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccd5c7e-958a-466a-b4e5-554dc24ef0c4 service swift] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:22:59.597048 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccd5c7e-958a-466a-b4e5-554dc24ef0c4 service swift] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:22:59.597721 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccd5c7e-958a-466a-b4e5-554dc24ef0c4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:22:59.609139 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccd5c7e-958a-466a-b4e5-554dc24ef0c4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:22:59.610994 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccd5c7e-958a-466a-b4e5-554dc24ef0c4 service swift] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:22:59.625211 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1089/2191] 10.222.0.47 () {60 vars in 1384 bytes} [Wed Aug 31 00:22:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 31 00:23:00.880058 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572e2b6f-7b77-4885-816d-85f57e7b311e None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:23:00.881016 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572e2b6f-7b77-4885-816d-85f57e7b311e None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:23:00.881793 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572e2b6f-7b77-4885-816d-85f57e7b311e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:23:00.990893 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-572e2b6f-7b77-4885-816d-85f57e7b311e None None] MFA Rules not processed for user `46a26318c91b4976970c88d3c967ca10`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:23:00.994190 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-572e2b6f-7b77-4885-816d-85f57e7b311e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:23:01.024458 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1103/2192] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:23:00 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:23:08.363728 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18d49fe-ecd3-4b42-8e8b-194bd8ccb0ae None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:23:08.364745 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18d49fe-ecd3-4b42-8e8b-194bd8ccb0ae None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:23:08.365019 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18d49fe-ecd3-4b42-8e8b-194bd8ccb0ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:23:08.411721 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-d18d49fe-ecd3-4b42-8e8b-194bd8ccb0ae None None] MFA Rules not processed for user `b3da9d7af0fd4c1d99973e6b277b16d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:23:08.414296 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-d18d49fe-ecd3-4b42-8e8b-194bd8ccb0ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:23:08.666825 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1090/2193] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:23:08 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:23:10.962648 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=84,keystone:INSERT=3 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:23:15.464583 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572e2b6f-7b77-4885-816d-85f57e7b311e None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:23:15.466317 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-572e2b6f-7b77-4885-816d-85f57e7b311e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:23:15.571074 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572e2b6f-7b77-4885-816d-85f57e7b311e None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:23:15.576469 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efcfbcc-507c-4cf3-bfca-9ab9c272e648 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f76e01e32264ff7a6a7740ffa0a207d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:23:15.577237 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efcfbcc-507c-4cf3-bfca-9ab9c272e648 service placement] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:23:15.577597 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efcfbcc-507c-4cf3-bfca-9ab9c272e648 service placement] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:23:15.577873 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efcfbcc-507c-4cf3-bfca-9ab9c272e648 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:23:15.579875 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-6efcfbcc-507c-4cf3-bfca-9ab9c272e648 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:23:15.597308 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efcfbcc-507c-4cf3-bfca-9ab9c272e648 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:23:15.599426 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efcfbcc-507c-4cf3-bfca-9ab9c272e648 service placement] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:23:15.610722 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1104/2194] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:23:15 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:23:18.636023 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=85 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:23:22.774472 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18d49fe-ecd3-4b42-8e8b-194bd8ccb0ae None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:23:22.776881 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-d18d49fe-ecd3-4b42-8e8b-194bd8ccb0ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:23:22.948466 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18d49fe-ecd3-4b42-8e8b-194bd8ccb0ae None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:23:22.954484 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33d72fc-ff81-4fda-b7e8-b48fa1fff998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:23:22.955979 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33d72fc-ff81-4fda-b7e8-b48fa1fff998 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:23:22.956316 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33d72fc-ff81-4fda-b7e8-b48fa1fff998 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:23:22.956458 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33d72fc-ff81-4fda-b7e8-b48fa1fff998 admin admin] PATH_INFO: `/v3/users/1850c34efbf54f5589e2f215f4099bad` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:23:22.957788 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33d72fc-ff81-4fda-b7e8-b48fa1fff998 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1850c34efbf54f5589e2f215f4099bad)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:23:22.960499 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33d72fc-ff81-4fda-b7e8-b48fa1fff998 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:23:23.047645 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-f33d72fc-ff81-4fda-b7e8-b48fa1fff998 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1850c34efbf54f5589e2f215f4099bad'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:23:23.070248 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-f33d72fc-ff81-4fda-b7e8-b48fa1fff998 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1850c34efbf54f5589e2f215f4099bad'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:23:23.081142 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-f33d72fc-ff81-4fda-b7e8-b48fa1fff998 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1850c34efbf54f5589e2f215f4099bad'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:23:23.141755 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-f33d72fc-ff81-4fda-b7e8-b48fa1fff998 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1850c34efbf54f5589e2f215f4099bad'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:23:23.144416 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-f33d72fc-ff81-4fda-b7e8-b48fa1fff998 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1850c34efbf54f5589e2f215f4099bad'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:23:23.163457 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1091/2195] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 31 00:23:22 2022] DELETE /identity/v3/users/1850c34efbf54f5589e2f215f4099bad => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:23:23.166309 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669addc3-3a15-4f52-bab9-8ea807e564a1 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:23:23.167777 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669addc3-3a15-4f52-bab9-8ea807e564a1 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:23:23.168585 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669addc3-3a15-4f52-bab9-8ea807e564a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:23:23.205859 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-669addc3-3a15-4f52-bab9-8ea807e564a1 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:23:23.207562 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-669addc3-3a15-4f52-bab9-8ea807e564a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:23:23.404111 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1105/2196] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:23:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:23:23.417536 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33d72fc-ff81-4fda-b7e8-b48fa1fff998 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:23:23.420082 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-f33d72fc-ff81-4fda-b7e8-b48fa1fff998 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:23:23.572836 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33d72fc-ff81-4fda-b7e8-b48fa1fff998 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:23:23.584700 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241dd319-bcd3-4c6e-8fc3-c346413ea63b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'daae792cd11d4c4ca7aae0558998aced', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:23:23.586054 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241dd319-bcd3-4c6e-8fc3-c346413ea63b service neutron] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:23:23.586526 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241dd319-bcd3-4c6e-8fc3-c346413ea63b service neutron] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:23:23.586986 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241dd319-bcd3-4c6e-8fc3-c346413ea63b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:23:23.612884 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241dd319-bcd3-4c6e-8fc3-c346413ea63b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:23:23.615921 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241dd319-bcd3-4c6e-8fc3-c346413ea63b service neutron] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:23:23.641557 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1092/2197] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:23:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 00:23:24.866681 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669addc3-3a15-4f52-bab9-8ea807e564a1 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:23:24.870902 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-669addc3-3a15-4f52-bab9-8ea807e564a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:23:24.910922 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669addc3-3a15-4f52-bab9-8ea807e564a1 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:23:24.925676 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9c9172-c46e-4c42-aca1-79aee073e350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:23:24.927628 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9c9172-c46e-4c42-aca1-79aee073e350 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:23:24.929540 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9c9172-c46e-4c42-aca1-79aee073e350 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:23:24.930593 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9c9172-c46e-4c42-aca1-79aee073e350 admin admin] PATH_INFO: `/v3/projects/02ad30ceb65e4c38a3d96cd84d94ba6d` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:23:24.934639 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9c9172-c46e-4c42-aca1-79aee073e350 admin admin] RBAC: Authorizing `identity:delete_project(project_id=02ad30ceb65e4c38a3d96cd84d94ba6d)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:23:24.942653 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9c9172-c46e-4c42-aca1-79aee073e350 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:23:25.092566 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-5f9c9172-c46e-4c42-aca1-79aee073e350 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02ad30ceb65e4c38a3d96cd84d94ba6d', 'request_id': 'req-5f9c9172-c46e-4c42-aca1-79aee073e350'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:23:25.117341 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-5f9c9172-c46e-4c42-aca1-79aee073e350 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02ad30ceb65e4c38a3d96cd84d94ba6d', 'request_id': 'req-5f9c9172-c46e-4c42-aca1-79aee073e350'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:23:25.158456 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-5f9c9172-c46e-4c42-aca1-79aee073e350 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02ad30ceb65e4c38a3d96cd84d94ba6d', 'request_id': 'req-5f9c9172-c46e-4c42-aca1-79aee073e350'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:23:25.227233 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-5f9c9172-c46e-4c42-aca1-79aee073e350 admin admin] The token cache is being invalidate because project 02ad30ceb65e4c38a3d96cd84d94ba6d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:23:25.228272 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-5f9c9172-c46e-4c42-aca1-79aee073e350 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:23:25.230479 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-5f9c9172-c46e-4c42-aca1-79aee073e350 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:23:25.233934 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1106/2198] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 31 00:23:24 2022] DELETE /identity/v3/projects/02ad30ceb65e4c38a3d96cd84d94ba6d => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:23:25.243545 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a698380c-c2fb-4706-ba77-228e97567b90 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:23:25.245722 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a698380c-c2fb-4706-ba77-228e97567b90 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:23:25.245722 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a698380c-c2fb-4706-ba77-228e97567b90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:23:25.312045 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-a698380c-c2fb-4706-ba77-228e97567b90 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:23:25.317388 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-a698380c-c2fb-4706-ba77-228e97567b90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:23:25.396450 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:23:25.498366 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1093/2199] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:23:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:23:25.508885 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f6dd92-540b-47ab-9cb1-8b001ece9a35 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:23:25.509556 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f6dd92-540b-47ab-9cb1-8b001ece9a35 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:23:25.510950 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f6dd92-540b-47ab-9cb1-8b001ece9a35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:23:25.562184 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-00f6dd92-540b-47ab-9cb1-8b001ece9a35 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:23:25.567479 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-00f6dd92-540b-47ab-9cb1-8b001ece9a35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:23:25.592241 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1107/2200] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:23:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:23:25.594915 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a698380c-c2fb-4706-ba77-228e97567b90 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:23:25.608450 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a698380c-c2fb-4706-ba77-228e97567b90 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:23:25.614919 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab65705d-2f3f-4626-ab15-e5075f3925a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:23:25.615606 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab65705d-2f3f-4626-ab15-e5075f3925a1 admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:23:25.615933 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab65705d-2f3f-4626-ab15-e5075f3925a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:23:25.616264 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab65705d-2f3f-4626-ab15-e5075f3925a1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:23:25.617170 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab65705d-2f3f-4626-ab15-e5075f3925a1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:23:25.617478 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab65705d-2f3f-4626-ab15-e5075f3925a1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:23:25.619270 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab65705d-2f3f-4626-ab15-e5075f3925a1 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:23:25.656193 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1094/2201] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 31 00:23:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:23:25.657965 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f6dd92-540b-47ab-9cb1-8b001ece9a35 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:23:25.671652 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f6dd92-540b-47ab-9cb1-8b001ece9a35 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:23:25.685621 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c68bf1-ff4e-4c6f-a7d0-fe3381d73f11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:23:25.686845 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c68bf1-ff4e-4c6f-a7d0-fe3381d73f11 admin admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:23:25.687461 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c68bf1-ff4e-4c6f-a7d0-fe3381d73f11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:23:25.688043 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c68bf1-ff4e-4c6f-a7d0-fe3381d73f11 admin admin] PATH_INFO: `/v3/projects` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:23:25.690651 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c68bf1-ff4e-4c6f-a7d0-fe3381d73f11 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:23:25.694542 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c68bf1-ff4e-4c6f-a7d0-fe3381d73f11 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:23:25.706695 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:23:25.776966 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1108/2202] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 31 00:23:25 2022] POST /identity/v3/projects => generated 373 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:23:25.778533 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab65705d-2f3f-4626-ab15-e5075f3925a1 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:23:25.791482 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab65705d-2f3f-4626-ab15-e5075f3925a1 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:23:25.872924 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201c2254-8b58-4804-8351-a11a3d6ef397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:23:25.873568 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201c2254-8b58-4804-8351-a11a3d6ef397 admin admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:23:25.873854 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201c2254-8b58-4804-8351-a11a3d6ef397 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:23:25.874121 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201c2254-8b58-4804-8351-a11a3d6ef397 admin admin] PATH_INFO: `/v3/users` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:23:25.874785 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201c2254-8b58-4804-8351-a11a3d6ef397 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:23:25.877407 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201c2254-8b58-4804-8351-a11a3d6ef397 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:23:25.903759 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1095/2203] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 31 00:23:25 2022] POST /identity/v3/users => generated 287 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:23:25.909754 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c68bf1-ff4e-4c6f-a7d0-fe3381d73f11 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:23:25.933444 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c68bf1-ff4e-4c6f-a7d0-fe3381d73f11 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:23:25.943664 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e992d53e-8314-4521-a73b-a79b6b86c927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:23:25.945287 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e992d53e-8314-4521-a73b-a79b6b86c927 admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:23:25.946044 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e992d53e-8314-4521-a73b-a79b6b86c927 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:23:25.946787 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e992d53e-8314-4521-a73b-a79b6b86c927 admin admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:23:25.948300 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e992d53e-8314-4521-a73b-a79b6b86c927 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:23:25.951921 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e992d53e-8314-4521-a73b-a79b6b86c927 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:23:25.995191 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1109/2204] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 00:23:25 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 00:23:25.998741 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201c2254-8b58-4804-8351-a11a3d6ef397 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:23:26.013270 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201c2254-8b58-4804-8351-a11a3d6ef397 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:23:26.019535 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb932fbd-0f4b-43bf-bb06-d703b1e0aea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:23:26.020198 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb932fbd-0f4b-43bf-bb06-d703b1e0aea0 admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:23:26.020487 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb932fbd-0f4b-43bf-bb06-d703b1e0aea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:23:26.020757 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb932fbd-0f4b-43bf-bb06-d703b1e0aea0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:23:26.021442 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb932fbd-0f4b-43bf-bb06-d703b1e0aea0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:23:26.024267 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb932fbd-0f4b-43bf-bb06-d703b1e0aea0 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:23:26.039418 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1096/2205] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 00:23:25 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:23:26.044770 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e992d53e-8314-4521-a73b-a79b6b86c927 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:23:26.067812 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e992d53e-8314-4521-a73b-a79b6b86c927 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:23:26.073356 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb19443-a27e-45a3-9199-82d04a4d16fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:23:26.073953 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb19443-a27e-45a3-9199-82d04a4d16fb admin admin] REQUEST_METHOD: `PUT` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:23:26.074229 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb19443-a27e-45a3-9199-82d04a4d16fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:23:26.074664 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb19443-a27e-45a3-9199-82d04a4d16fb admin admin] PATH_INFO: `/v3/projects/81666ce8589a4e45ac7f5f9e6e6cc9a3/users/213a798609294cb3ab6e0312ddbb1024/roles/fdad79ffbcbb4fa380dc9cf7dd108618` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:23:26.095102 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb19443-a27e-45a3-9199-82d04a4d16fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=81666ce8589a4e45ac7f5f9e6e6cc9a3, user_id=213a798609294cb3ab6e0312ddbb1024, role_id=fdad79ffbcbb4fa380dc9cf7dd108618)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:23:26.098786 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb19443-a27e-45a3-9199-82d04a4d16fb admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:23:26.137509 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1110/2206] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 00:23:26 2022] PUT /identity/v3/projects/81666ce8589a4e45ac7f5f9e6e6cc9a3/users/213a798609294cb3ab6e0312ddbb1024/roles/fdad79ffbcbb4fa380dc9cf7dd108618 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:23:26.141828 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb4518f-d159-453c-b98a-d218ad27402d None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:23:26.142297 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb4518f-d159-453c-b98a-d218ad27402d None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:23:26.142572 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb4518f-d159-453c-b98a-d218ad27402d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:23:26.188942 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-8bb4518f-d159-453c-b98a-d218ad27402d None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:23:26.191287 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-8bb4518f-d159-453c-b98a-d218ad27402d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:23:26.309729 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1097/2207] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:23:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:23:26.323680 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb19443-a27e-45a3-9199-82d04a4d16fb admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:23:26.326996 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-9eb19443-a27e-45a3-9199-82d04a4d16fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:23:26.426615 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb19443-a27e-45a3-9199-82d04a4d16fb admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:23:26.432843 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1ced1a-cb14-4585-914e-62f5dcfe8fa8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'daae792cd11d4c4ca7aae0558998aced', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:23:26.433620 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1ced1a-cb14-4585-914e-62f5dcfe8fa8 service neutron] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:23:26.433939 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1ced1a-cb14-4585-914e-62f5dcfe8fa8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:23:26.434322 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1ced1a-cb14-4585-914e-62f5dcfe8fa8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:23:26.460453 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1ced1a-cb14-4585-914e-62f5dcfe8fa8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:23:26.471082 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1ced1a-cb14-4585-914e-62f5dcfe8fa8 service neutron] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:23:26.488628 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1111/2208] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:23:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 00:23:29.040588 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96a5bbe-92e6-4ca3-86c9-7609d714bdd7 None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:23:29.041179 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96a5bbe-92e6-4ca3-86c9-7609d714bdd7 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:23:29.044419 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96a5bbe-92e6-4ca3-86c9-7609d714bdd7 None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:23:29.060486 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1098/2209] 10.222.0.47 () {54 vars in 921 bytes} [Wed Aug 31 00:23:29 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:23:29.063214 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8361959f-71ad-4636-93e4-21a6d458d227 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:23:29.063814 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8361959f-71ad-4636-93e4-21a6d458d227 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:23:29.065040 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8361959f-71ad-4636-93e4-21a6d458d227 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:23:29.122194 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-8361959f-71ad-4636-93e4-21a6d458d227 None None] MFA Rules not processed for user `9ea002bf49c248dbae7147665fa10fd1`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:23:29.123738 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-8361959f-71ad-4636-93e4-21a6d458d227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:23:29.256347 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1112/2210] 10.222.0.47 () {58 vars in 1018 bytes} [Wed Aug 31 00:23:29 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:23:29.270106 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96a5bbe-92e6-4ca3-86c9-7609d714bdd7 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:23:29.272426 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-c96a5bbe-92e6-4ca3-86c9-7609d714bdd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:23:29.336880 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:23:29.413507 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96a5bbe-92e6-4ca3-86c9-7609d714bdd7 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:23:29.431559 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cf34ae-d3d3-4974-abb9-3d94b1e3febd service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc025521e1dc4c91ab50a8718a87754f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:23:29.433388 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cf34ae-d3d3-4974-abb9-3d94b1e3febd service glance] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:23:29.433906 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cf34ae-d3d3-4974-abb9-3d94b1e3febd service glance] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:23:29.434453 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cf34ae-d3d3-4974-abb9-3d94b1e3febd service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:23:29.462996 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cf34ae-d3d3-4974-abb9-3d94b1e3febd service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:23:29.467799 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cf34ae-d3d3-4974-abb9-3d94b1e3febd service glance] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:23:29.518173 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1099/2211] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:23:29 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 00:23:29.679573 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09ff0a4-e780-43ef-ac08-8362cdc0ff89 None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:23:29.679911 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09ff0a4-e780-43ef-ac08-8362cdc0ff89 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:23:29.680334 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09ff0a4-e780-43ef-ac08-8362cdc0ff89 None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:23:29.681739 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1113/2212] 10.222.0.47 () {54 vars in 921 bytes} [Wed Aug 31 00:23:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:23:29.693902 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17611be1-4f81-4a65-b35a-af79534442e2 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:23:29.694887 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17611be1-4f81-4a65-b35a-af79534442e2 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:23:29.695616 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17611be1-4f81-4a65-b35a-af79534442e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:23:29.737067 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-17611be1-4f81-4a65-b35a-af79534442e2 None None] MFA Rules not processed for user `daae792cd11d4c4ca7aae0558998aced`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:23:29.738732 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-17611be1-4f81-4a65-b35a-af79534442e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:23:29.752842 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1100/2213] 10.222.0.47 () {58 vars in 1018 bytes} [Wed Aug 31 00:23:29 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:23:29.775921 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09ff0a4-e780-43ef-ac08-8362cdc0ff89 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:23:29.779606 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-c09ff0a4-e780-43ef-ac08-8362cdc0ff89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:23:29.799666 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09ff0a4-e780-43ef-ac08-8362cdc0ff89 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:23:29.803786 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300dc67e-ea84-4450-a419-80d30c496641 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'daae792cd11d4c4ca7aae0558998aced', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:23:29.804735 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300dc67e-ea84-4450-a419-80d30c496641 service neutron] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:23:29.805016 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300dc67e-ea84-4450-a419-80d30c496641 service neutron] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:23:29.805338 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300dc67e-ea84-4450-a419-80d30c496641 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:23:29.814318 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300dc67e-ea84-4450-a419-80d30c496641 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:23:29.815548 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300dc67e-ea84-4450-a419-80d30c496641 service neutron] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:23:29.831252 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1114/2214] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:23:29 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:23:29.978845 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0140a77-751e-4428-ba0c-4996546fc778 None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:23:29.979718 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0140a77-751e-4428-ba0c-4996546fc778 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:23:29.980438 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0140a77-751e-4428-ba0c-4996546fc778 None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:23:29.983803 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1101/2215] 10.222.0.47 () {54 vars in 921 bytes} [Wed Aug 31 00:23:29 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:23:29.993654 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f7dfc9-c197-407b-94ac-c3168cf3ee7e None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:23:29.994019 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f7dfc9-c197-407b-94ac-c3168cf3ee7e None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:23:29.994343 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f7dfc9-c197-407b-94ac-c3168cf3ee7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:23:30.042287 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-53f7dfc9-c197-407b-94ac-c3168cf3ee7e None None] MFA Rules not processed for user `9ea002bf49c248dbae7147665fa10fd1`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:23:30.044514 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-53f7dfc9-c197-407b-94ac-c3168cf3ee7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:23:30.066884 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1115/2216] 10.222.0.47 () {58 vars in 1018 bytes} [Wed Aug 31 00:23:29 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:23:30.092976 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0140a77-751e-4428-ba0c-4996546fc778 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:23:30.143713 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0140a77-751e-4428-ba0c-4996546fc778 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:23:30.162258 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9168de4-64ec-4015-a9a9-45a1d2e69c68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'daae792cd11d4c4ca7aae0558998aced', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:23:30.163354 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9168de4-64ec-4015-a9a9-45a1d2e69c68 service neutron] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:23:30.163862 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9168de4-64ec-4015-a9a9-45a1d2e69c68 service neutron] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:23:30.164418 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9168de4-64ec-4015-a9a9-45a1d2e69c68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:23:30.212579 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9168de4-64ec-4015-a9a9-45a1d2e69c68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:23:30.219639 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9168de4-64ec-4015-a9a9-45a1d2e69c68 service neutron] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:23:30.270970 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1102/2217] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:23:30 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 00:23:34.397867 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471737d0-4ade-4d47-879c-438012046eec None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:23:34.398727 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471737d0-4ade-4d47-879c-438012046eec None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:23:34.398727 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471737d0-4ade-4d47-879c-438012046eec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:23:34.459044 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-471737d0-4ade-4d47-879c-438012046eec None None] MFA Rules not processed for user `213a798609294cb3ab6e0312ddbb1024`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:23:34.461327 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-471737d0-4ade-4d47-879c-438012046eec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:23:34.490117 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:23:34.676672 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1116/2218] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:23:34 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:23:34.682906 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9168de4-64ec-4015-a9a9-45a1d2e69c68 service neutron] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:23:34.718810 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9168de4-64ec-4015-a9a9-45a1d2e69c68 service neutron] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:23:34.729390 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ae6c38-9f5d-4f49-9015-f686fec2a060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:23:34.730402 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ae6c38-9f5d-4f49-9015-f686fec2a060 admin admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:23:34.731110 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ae6c38-9f5d-4f49-9015-f686fec2a060 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:23:34.731707 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ae6c38-9f5d-4f49-9015-f686fec2a060 admin admin] PATH_INFO: `/v3/projects` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:23:34.733186 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ae6c38-9f5d-4f49-9015-f686fec2a060 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:23:34.738600 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ae6c38-9f5d-4f49-9015-f686fec2a060 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:23:34.800240 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1103/2219] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 31 00:23:34 2022] POST /identity/v3/projects => generated 373 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:23:34.804687 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471737d0-4ade-4d47-879c-438012046eec None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:23:34.819195 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471737d0-4ade-4d47-879c-438012046eec None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:23:34.898861 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167fa62a-464a-49d8-941b-d29fe9cbea41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:23:34.899804 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167fa62a-464a-49d8-941b-d29fe9cbea41 admin admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:23:34.900087 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167fa62a-464a-49d8-941b-d29fe9cbea41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:23:34.900403 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167fa62a-464a-49d8-941b-d29fe9cbea41 admin admin] PATH_INFO: `/v3/users` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:23:34.901052 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167fa62a-464a-49d8-941b-d29fe9cbea41 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:23:34.903368 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167fa62a-464a-49d8-941b-d29fe9cbea41 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:23:34.934669 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1117/2220] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 31 00:23:34 2022] POST /identity/v3/users => generated 293 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:23:34.941334 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ae6c38-9f5d-4f49-9015-f686fec2a060 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:23:34.960120 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ae6c38-9f5d-4f49-9015-f686fec2a060 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:23:34.966027 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a70cbcf-67f0-4866-b27e-840d60218919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:23:34.966660 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a70cbcf-67f0-4866-b27e-840d60218919 admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:23:34.966934 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a70cbcf-67f0-4866-b27e-840d60218919 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:23:34.967418 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a70cbcf-67f0-4866-b27e-840d60218919 admin admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:23:34.968336 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a70cbcf-67f0-4866-b27e-840d60218919 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:23:34.971100 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a70cbcf-67f0-4866-b27e-840d60218919 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:23:34.999539 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1104/2221] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 00:23:34 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 00:23:35.007023 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167fa62a-464a-49d8-941b-d29fe9cbea41 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:23:35.025363 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167fa62a-464a-49d8-941b-d29fe9cbea41 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:23:35.035710 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b184eb34-00b6-4e52-88d9-97e2b17e1136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:23:35.036905 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b184eb34-00b6-4e52-88d9-97e2b17e1136 admin admin] REQUEST_METHOD: `PUT` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:23:35.037404 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b184eb34-00b6-4e52-88d9-97e2b17e1136 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:23:35.037907 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b184eb34-00b6-4e52-88d9-97e2b17e1136 admin admin] PATH_INFO: `/v3/projects/4b9380f45f99496883e536272ce068b6/users/d43f2608ef11430a8655d3ba5ffa6f8b/roles/12f6817f9aaa4e2bb477095a6bed5d0f` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:23:35.071958 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b184eb34-00b6-4e52-88d9-97e2b17e1136 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b9380f45f99496883e536272ce068b6, user_id=d43f2608ef11430a8655d3ba5ffa6f8b, role_id=12f6817f9aaa4e2bb477095a6bed5d0f)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:23:35.071958 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b184eb34-00b6-4e52-88d9-97e2b17e1136 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:23:35.102123 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1118/2222] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 00:23:35 2022] PUT /identity/v3/projects/4b9380f45f99496883e536272ce068b6/users/d43f2608ef11430a8655d3ba5ffa6f8b/roles/12f6817f9aaa4e2bb477095a6bed5d0f => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:23:35.108036 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a70cbcf-67f0-4866-b27e-840d60218919 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:23:35.135198 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a70cbcf-67f0-4866-b27e-840d60218919 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:23:35.323990 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541d1e3d-715e-45d6-83c9-efd240b7e713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:23:35.326925 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541d1e3d-715e-45d6-83c9-efd240b7e713 admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:23:35.327773 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541d1e3d-715e-45d6-83c9-efd240b7e713 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:23:35.328621 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541d1e3d-715e-45d6-83c9-efd240b7e713 admin admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:23:35.331424 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541d1e3d-715e-45d6-83c9-efd240b7e713 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:23:35.335081 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541d1e3d-715e-45d6-83c9-efd240b7e713 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:23:35.364137 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1105/2223] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 00:23:35 2022] GET /identity/v3/roles => generated 1420 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:23:35.371930 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b184eb34-00b6-4e52-88d9-97e2b17e1136 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:23:35.403016 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b184eb34-00b6-4e52-88d9-97e2b17e1136 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:23:35.416263 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9748dd5-d28a-40cf-a328-54b8cc2727a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:23:35.417564 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9748dd5-d28a-40cf-a328-54b8cc2727a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:23:35.418218 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9748dd5-d28a-40cf-a328-54b8cc2727a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:23:35.418685 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9748dd5-d28a-40cf-a328-54b8cc2727a3 admin admin] PATH_INFO: `/v3/projects/4b9380f45f99496883e536272ce068b6/users/d43f2608ef11430a8655d3ba5ffa6f8b/roles/12f6817f9aaa4e2bb477095a6bed5d0f` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:23:35.422870 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9748dd5-d28a-40cf-a328-54b8cc2727a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b9380f45f99496883e536272ce068b6, user_id=d43f2608ef11430a8655d3ba5ffa6f8b, role_id=12f6817f9aaa4e2bb477095a6bed5d0f)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:23:35.429588 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9748dd5-d28a-40cf-a328-54b8cc2727a3 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:23:35.471902 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1119/2224] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 00:23:35 2022] PUT /identity/v3/projects/4b9380f45f99496883e536272ce068b6/users/d43f2608ef11430a8655d3ba5ffa6f8b/roles/12f6817f9aaa4e2bb477095a6bed5d0f => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:23:42.609457 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4c167d-80ea-42b2-8a9d-1e2a578f67ab None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:23:42.612889 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4c167d-80ea-42b2-8a9d-1e2a578f67ab None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:23:42.614083 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4c167d-80ea-42b2-8a9d-1e2a578f67ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:23:42.653547 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-9b4c167d-80ea-42b2-8a9d-1e2a578f67ab None None] MFA Rules not processed for user `601aa9e547aa4d42bef6753b26f48eaa`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:23:42.655871 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-9b4c167d-80ea-42b2-8a9d-1e2a578f67ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:23:42.799512 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1106/2225] 10.222.0.47 () {58 vars in 1009 bytes} [Wed Aug 31 00:23:42 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:23:42.826352 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9748dd5-d28a-40cf-a328-54b8cc2727a3 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:23:42.829254 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-e9748dd5-d28a-40cf-a328-54b8cc2727a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:23:43.070454 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9748dd5-d28a-40cf-a328-54b8cc2727a3 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:23:43.081377 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9966b52-aac4-4cf5-95f8-f2c9f4e7562b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffbfbf19509645f49dbf9566e447c8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:23:43.082529 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9966b52-aac4-4cf5-95f8-f2c9f4e7562b service swift] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:23:43.082801 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9966b52-aac4-4cf5-95f8-f2c9f4e7562b service swift] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:23:43.083602 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9966b52-aac4-4cf5-95f8-f2c9f4e7562b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:23:43.100640 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:23:43.102768 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9966b52-aac4-4cf5-95f8-f2c9f4e7562b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:23:43.106382 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9966b52-aac4-4cf5-95f8-f2c9f4e7562b service swift] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:23:43.123313 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1120/2226] 10.222.0.47 () {60 vars in 1384 bytes} [Wed Aug 31 00:23:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 00:23:46.820676 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1a73b4-2d9e-4735-948b-b3b8fdb61015 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:23:46.821919 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1a73b4-2d9e-4735-948b-b3b8fdb61015 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:23:46.822497 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1a73b4-2d9e-4735-948b-b3b8fdb61015 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:23:46.909212 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-8c1a73b4-2d9e-4735-948b-b3b8fdb61015 None None] MFA Rules not processed for user `d43f2608ef11430a8655d3ba5ffa6f8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:23:46.912843 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-8c1a73b4-2d9e-4735-948b-b3b8fdb61015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:23:46.950117 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:23:47.059811 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1107/2227] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:23:46 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:23:47.079839 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9966b52-aac4-4cf5-95f8-f2c9f4e7562b service swift] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:23:47.081335 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-f9966b52-aac4-4cf5-95f8-f2c9f4e7562b service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:23:47.266033 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9966b52-aac4-4cf5-95f8-f2c9f4e7562b service swift] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:23:47.285534 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c576410-60c3-4da9-aa10-ca7eaea2f92a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea002bf49c248dbae7147665fa10fd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:23:47.286494 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c576410-60c3-4da9-aa10-ca7eaea2f92a service nova] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:23:47.286953 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c576410-60c3-4da9-aa10-ca7eaea2f92a service nova] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:23:47.287410 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c576410-60c3-4da9-aa10-ca7eaea2f92a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:23:47.417995 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c576410-60c3-4da9-aa10-ca7eaea2f92a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:23:47.421367 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c576410-60c3-4da9-aa10-ca7eaea2f92a service nova] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:23:47.446310 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1121/2228] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:23:47 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:23:50.943246 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a446ce-bc51-4baa-b137-081ec6e90de0 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:23:50.943819 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a446ce-bc51-4baa-b137-081ec6e90de0 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:23:50.943819 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a446ce-bc51-4baa-b137-081ec6e90de0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:23:50.971667 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-47a446ce-bc51-4baa-b137-081ec6e90de0 None None] MFA Rules not processed for user `213a798609294cb3ab6e0312ddbb1024`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:23:50.973314 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-47a446ce-bc51-4baa-b137-081ec6e90de0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:23:51.004345 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1108/2229] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:23:50 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:23:57.434314 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=58 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:23:58.491546 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f44778f-e053-4ae8-bb0c-687f16cb3cc8 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:23:58.493172 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f44778f-e053-4ae8-bb0c-687f16cb3cc8 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:23:58.493172 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f44778f-e053-4ae8-bb0c-687f16cb3cc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:23:58.514888 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-0f44778f-e053-4ae8-bb0c-687f16cb3cc8 None None] MFA Rules not processed for user `601aa9e547aa4d42bef6753b26f48eaa`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:23:58.516245 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-0f44778f-e053-4ae8-bb0c-687f16cb3cc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:23:58.524803 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1122/2230] 10.222.0.47 () {58 vars in 1009 bytes} [Wed Aug 31 00:23:58 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:23:58.541147 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a446ce-bc51-4baa-b137-081ec6e90de0 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:23:58.554989 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a446ce-bc51-4baa-b137-081ec6e90de0 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:23:58.560226 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29229c2-28a1-4446-94fd-17125ddf1fc6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffbfbf19509645f49dbf9566e447c8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:23:58.560865 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29229c2-28a1-4446-94fd-17125ddf1fc6 service swift] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:23:58.561144 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29229c2-28a1-4446-94fd-17125ddf1fc6 service swift] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:23:58.561418 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29229c2-28a1-4446-94fd-17125ddf1fc6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:23:58.572297 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29229c2-28a1-4446-94fd-17125ddf1fc6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:23:58.574193 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29229c2-28a1-4446-94fd-17125ddf1fc6 service swift] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:23:58.589589 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1109/2231] 10.222.0.47 () {60 vars in 1384 bytes} [Wed Aug 31 00:23:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 00:23:59.343421 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eb2e53-a023-4e53-a078-639b94a1107d None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:23:59.343711 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eb2e53-a023-4e53-a078-639b94a1107d None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:23:59.344014 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eb2e53-a023-4e53-a078-639b94a1107d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:23:59.368357 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-f3eb2e53-a023-4e53-a078-639b94a1107d None None] MFA Rules not processed for user `601aa9e547aa4d42bef6753b26f48eaa`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:23:59.369612 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-f3eb2e53-a023-4e53-a078-639b94a1107d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:23:59.377738 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1123/2232] 10.222.0.47 () {58 vars in 967 bytes} [Wed Aug 31 00:23:59 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:23:59.396662 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29229c2-28a1-4446-94fd-17125ddf1fc6 service swift] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:23:59.409271 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29229c2-28a1-4446-94fd-17125ddf1fc6 service swift] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:23:59.415581 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb96b138-1d63-42b4-add2-49a0b987eef6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffbfbf19509645f49dbf9566e447c8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:23:59.416282 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb96b138-1d63-42b4-add2-49a0b987eef6 service swift] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:23:59.416589 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb96b138-1d63-42b4-add2-49a0b987eef6 service swift] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:23:59.416889 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb96b138-1d63-42b4-add2-49a0b987eef6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:23:59.428482 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb96b138-1d63-42b4-add2-49a0b987eef6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:23:59.430456 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb96b138-1d63-42b4-add2-49a0b987eef6 service swift] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:23:59.442325 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1110/2233] 10.222.0.47 () {60 vars in 1384 bytes} [Wed Aug 31 00:23:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 00:23:59.788488 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3062329d-9bcf-452c-836e-6e8d12393c9f None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:23:59.789322 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3062329d-9bcf-452c-836e-6e8d12393c9f None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:23:59.789322 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3062329d-9bcf-452c-836e-6e8d12393c9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:23:59.811123 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-3062329d-9bcf-452c-836e-6e8d12393c9f None None] MFA Rules not processed for user `601aa9e547aa4d42bef6753b26f48eaa`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:23:59.812405 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-3062329d-9bcf-452c-836e-6e8d12393c9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:23:59.820423 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1124/2234] 10.222.0.47 () {58 vars in 1009 bytes} [Wed Aug 31 00:23:59 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:23:59.849031 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb96b138-1d63-42b4-add2-49a0b987eef6 service swift] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:23:59.862398 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb96b138-1d63-42b4-add2-49a0b987eef6 service swift] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:23:59.873654 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf7ef0c-4ad1-46ef-9ff6-e6489918fdd5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffbfbf19509645f49dbf9566e447c8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:23:59.873654 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf7ef0c-4ad1-46ef-9ff6-e6489918fdd5 service swift] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:23:59.873654 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf7ef0c-4ad1-46ef-9ff6-e6489918fdd5 service swift] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:23:59.873654 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf7ef0c-4ad1-46ef-9ff6-e6489918fdd5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:23:59.887891 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf7ef0c-4ad1-46ef-9ff6-e6489918fdd5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:23:59.889795 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf7ef0c-4ad1-46ef-9ff6-e6489918fdd5 service swift] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:23:59.904195 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1111/2235] 10.222.0.47 () {60 vars in 1384 bytes} [Wed Aug 31 00:23:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 00:24:00.388783 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04eacae-7858-49d0-8d17-55f2c18ddc66 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:00.389277 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04eacae-7858-49d0-8d17-55f2c18ddc66 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:00.389763 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04eacae-7858-49d0-8d17-55f2c18ddc66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:00.424945 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-b04eacae-7858-49d0-8d17-55f2c18ddc66 None None] MFA Rules not processed for user `601aa9e547aa4d42bef6753b26f48eaa`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:24:00.427052 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-b04eacae-7858-49d0-8d17-55f2c18ddc66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:24:00.440866 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1125/2236] 10.222.0.47 () {58 vars in 967 bytes} [Wed Aug 31 00:24:00 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:24:00.457579 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf7ef0c-4ad1-46ef-9ff6-e6489918fdd5 service swift] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:24:00.468956 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf7ef0c-4ad1-46ef-9ff6-e6489918fdd5 service swift] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:24:00.474814 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1967634-6441-497a-a541-57853dcaefef service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffbfbf19509645f49dbf9566e447c8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:24:00.475448 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1967634-6441-497a-a541-57853dcaefef service swift] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:00.475731 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1967634-6441-497a-a541-57853dcaefef service swift] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:00.476007 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1967634-6441-497a-a541-57853dcaefef service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:00.485976 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1967634-6441-497a-a541-57853dcaefef service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:24:00.488643 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1967634-6441-497a-a541-57853dcaefef service swift] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:24:00.498903 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1112/2237] 10.222.0.47 () {60 vars in 1384 bytes} [Wed Aug 31 00:24:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 00:24:02.975110 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04eacae-7858-49d0-8d17-55f2c18ddc66 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:24:02.977351 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-b04eacae-7858-49d0-8d17-55f2c18ddc66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:24:03.074887 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04eacae-7858-49d0-8d17-55f2c18ddc66 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:24:03.083571 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8ed1b9-4069-4ef0-b7d8-0d157363972d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:24:03.084918 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8ed1b9-4069-4ef0-b7d8-0d157363972d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:03.085466 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8ed1b9-4069-4ef0-b7d8-0d157363972d admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:03.085891 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8ed1b9-4069-4ef0-b7d8-0d157363972d admin admin] PATH_INFO: `/v3/users/46a26318c91b4976970c88d3c967ca10` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:03.088088 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8ed1b9-4069-4ef0-b7d8-0d157363972d admin admin] RBAC: Authorizing `identity:delete_user(user_id=46a26318c91b4976970c88d3c967ca10)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:24:03.092024 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8ed1b9-4069-4ef0-b7d8-0d157363972d admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:24:03.165074 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-be8ed1b9-4069-4ef0-b7d8-0d157363972d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46a26318c91b4976970c88d3c967ca10'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:24:03.173854 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-be8ed1b9-4069-4ef0-b7d8-0d157363972d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46a26318c91b4976970c88d3c967ca10'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:24:03.188309 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-be8ed1b9-4069-4ef0-b7d8-0d157363972d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46a26318c91b4976970c88d3c967ca10'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:24:03.189660 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-be8ed1b9-4069-4ef0-b7d8-0d157363972d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46a26318c91b4976970c88d3c967ca10'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:24:03.225150 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-be8ed1b9-4069-4ef0-b7d8-0d157363972d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46a26318c91b4976970c88d3c967ca10'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:24:03.235948 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1126/2238] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 31 00:24:02 2022] DELETE /identity/v3/users/46a26318c91b4976970c88d3c967ca10 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:24:03.242149 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35f29df-87fa-4bf7-b47e-71314176c792 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:03.242741 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35f29df-87fa-4bf7-b47e-71314176c792 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:03.242741 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35f29df-87fa-4bf7-b47e-71314176c792 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:03.264750 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-a35f29df-87fa-4bf7-b47e-71314176c792 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:24:03.266301 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-a35f29df-87fa-4bf7-b47e-71314176c792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:24:03.343337 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1113/2239] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:24:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:24:03.354915 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8ed1b9-4069-4ef0-b7d8-0d157363972d admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:24:03.356707 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-be8ed1b9-4069-4ef0-b7d8-0d157363972d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:24:03.429911 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8ed1b9-4069-4ef0-b7d8-0d157363972d admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:24:03.433744 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3fbeca-2fda-497c-9456-91ece5bda879 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'daae792cd11d4c4ca7aae0558998aced', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:24:03.434366 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3fbeca-2fda-497c-9456-91ece5bda879 service neutron] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:03.434642 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3fbeca-2fda-497c-9456-91ece5bda879 service neutron] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:03.434913 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3fbeca-2fda-497c-9456-91ece5bda879 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:03.443004 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:24:03.445893 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3fbeca-2fda-497c-9456-91ece5bda879 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:24:03.448062 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3fbeca-2fda-497c-9456-91ece5bda879 service neutron] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:24:03.462555 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1127/2240] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:24:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:24:03.945857 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35f29df-87fa-4bf7-b47e-71314176c792 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:24:03.947779 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-a35f29df-87fa-4bf7-b47e-71314176c792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:24:03.971423 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35f29df-87fa-4bf7-b47e-71314176c792 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:24:03.979313 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69740087-3ce8-4ece-bd14-20ba7df67580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:24:03.980588 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69740087-3ce8-4ece-bd14-20ba7df67580 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:03.981047 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69740087-3ce8-4ece-bd14-20ba7df67580 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:03.981689 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69740087-3ce8-4ece-bd14-20ba7df67580 admin admin] PATH_INFO: `/v3/projects/9e164298f9d449498f1c7b4c06a839be` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:03.984098 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69740087-3ce8-4ece-bd14-20ba7df67580 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e164298f9d449498f1c7b4c06a839be)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:24:03.990688 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69740087-3ce8-4ece-bd14-20ba7df67580 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:24:04.092705 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:24:04.113594 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-69740087-3ce8-4ece-bd14-20ba7df67580 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e164298f9d449498f1c7b4c06a839be', 'request_id': 'req-69740087-3ce8-4ece-bd14-20ba7df67580'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:24:04.123101 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-69740087-3ce8-4ece-bd14-20ba7df67580 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e164298f9d449498f1c7b4c06a839be', 'request_id': 'req-69740087-3ce8-4ece-bd14-20ba7df67580'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:24:04.132797 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-69740087-3ce8-4ece-bd14-20ba7df67580 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e164298f9d449498f1c7b4c06a839be', 'request_id': 'req-69740087-3ce8-4ece-bd14-20ba7df67580'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:24:04.152548 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-69740087-3ce8-4ece-bd14-20ba7df67580 admin admin] The token cache is being invalidate because project 9e164298f9d449498f1c7b4c06a839be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81523) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:24:04.153073 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-69740087-3ce8-4ece-bd14-20ba7df67580 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:24:04.153965 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-69740087-3ce8-4ece-bd14-20ba7df67580 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:24:04.155698 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1114/2241] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 31 00:24:03 2022] DELETE /identity/v3/projects/9e164298f9d449498f1c7b4c06a839be => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:24:04.162208 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6aa954-413f-440c-a0ad-8884b7fbbafb None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:04.162753 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6aa954-413f-440c-a0ad-8884b7fbbafb None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:04.163152 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6aa954-413f-440c-a0ad-8884b7fbbafb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:04.186016 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-af6aa954-413f-440c-a0ad-8884b7fbbafb None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:24:04.187259 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-af6aa954-413f-440c-a0ad-8884b7fbbafb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:24:04.299914 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1128/2242] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:24:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:24:04.367595 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0605de9f-1884-4ecb-85e0-7a7dc50dd7dc None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:04.368241 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0605de9f-1884-4ecb-85e0-7a7dc50dd7dc None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:04.368598 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0605de9f-1884-4ecb-85e0-7a7dc50dd7dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:04.398101 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-0605de9f-1884-4ecb-85e0-7a7dc50dd7dc None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:24:04.399765 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-0605de9f-1884-4ecb-85e0-7a7dc50dd7dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:24:04.408681 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1115/2243] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:24:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:24:04.414371 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6aa954-413f-440c-a0ad-8884b7fbbafb None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:24:04.426104 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6aa954-413f-440c-a0ad-8884b7fbbafb None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:24:04.431178 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d0295f-6433-4e31-8e18-e88c416baaa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:24:04.431825 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d0295f-6433-4e31-8e18-e88c416baaa7 admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:04.432115 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d0295f-6433-4e31-8e18-e88c416baaa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:04.432432 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d0295f-6433-4e31-8e18-e88c416baaa7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:04.433108 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d0295f-6433-4e31-8e18-e88c416baaa7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:24:04.433412 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d0295f-6433-4e31-8e18-e88c416baaa7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:24:04.435131 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d0295f-6433-4e31-8e18-e88c416baaa7 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:24:04.449671 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1129/2244] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 31 00:24:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:24:04.457703 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0605de9f-1884-4ecb-85e0-7a7dc50dd7dc None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:24:04.475503 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0605de9f-1884-4ecb-85e0-7a7dc50dd7dc None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:24:04.483435 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba41395a-c70f-43d6-a596-a8b4b5ee3b5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:24:04.484508 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba41395a-c70f-43d6-a596-a8b4b5ee3b5b admin admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:04.485006 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba41395a-c70f-43d6-a596-a8b4b5ee3b5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:04.486081 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba41395a-c70f-43d6-a596-a8b4b5ee3b5b admin admin] PATH_INFO: `/v3/projects` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:04.487463 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba41395a-c70f-43d6-a596-a8b4b5ee3b5b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:24:04.491246 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba41395a-c70f-43d6-a596-a8b4b5ee3b5b admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:24:04.536438 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1116/2245] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 31 00:24:04 2022] POST /identity/v3/projects => generated 399 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:24:04.542930 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d0295f-6433-4e31-8e18-e88c416baaa7 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:24:04.560598 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d0295f-6433-4e31-8e18-e88c416baaa7 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:24:04.643374 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5f3ded-88fd-4e32-8aff-219307a56122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:24:04.643374 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5f3ded-88fd-4e32-8aff-219307a56122 admin admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:04.643374 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5f3ded-88fd-4e32-8aff-219307a56122 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:04.643374 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5f3ded-88fd-4e32-8aff-219307a56122 admin admin] PATH_INFO: `/v3/users` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:04.644275 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5f3ded-88fd-4e32-8aff-219307a56122 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:24:04.644275 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5f3ded-88fd-4e32-8aff-219307a56122 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:24:04.669951 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1130/2246] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 31 00:24:04 2022] POST /identity/v3/users => generated 300 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:24:04.675234 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba41395a-c70f-43d6-a596-a8b4b5ee3b5b admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:24:04.688431 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba41395a-c70f-43d6-a596-a8b4b5ee3b5b admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:24:04.695097 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a79eef-076d-4b7e-ba38-7c6dc9210ca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:24:04.695770 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a79eef-076d-4b7e-ba38-7c6dc9210ca1 admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:04.696223 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a79eef-076d-4b7e-ba38-7c6dc9210ca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:04.696681 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a79eef-076d-4b7e-ba38-7c6dc9210ca1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:04.697532 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a79eef-076d-4b7e-ba38-7c6dc9210ca1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:24:04.699600 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a79eef-076d-4b7e-ba38-7c6dc9210ca1 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:24:04.716065 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1117/2247] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 00:24:04 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:24:04.723664 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5f3ded-88fd-4e32-8aff-219307a56122 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:24:04.737045 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5f3ded-88fd-4e32-8aff-219307a56122 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:24:04.742900 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07858ad3-0dcb-4786-a75a-bfd5d30308d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:24:04.743563 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07858ad3-0dcb-4786-a75a-bfd5d30308d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:04.743880 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07858ad3-0dcb-4786-a75a-bfd5d30308d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:04.744260 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07858ad3-0dcb-4786-a75a-bfd5d30308d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:04.744982 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07858ad3-0dcb-4786-a75a-bfd5d30308d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:24:04.746888 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07858ad3-0dcb-4786-a75a-bfd5d30308d3 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:24:04.762203 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1131/2248] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 00:24:04 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:24:04.768650 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a79eef-076d-4b7e-ba38-7c6dc9210ca1 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:24:04.788935 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a79eef-076d-4b7e-ba38-7c6dc9210ca1 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:24:04.797328 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f790d65-d9ed-444d-8c6c-368fd63d10b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:24:04.798509 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f790d65-d9ed-444d-8c6c-368fd63d10b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:04.799062 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f790d65-d9ed-444d-8c6c-368fd63d10b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:04.799588 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f790d65-d9ed-444d-8c6c-368fd63d10b2 admin admin] PATH_INFO: `/v3/projects/23673589610d4ca981a59aa271af1300/users/97ee7e56dc6541beb11577d3bfd91126/roles/fdad79ffbcbb4fa380dc9cf7dd108618` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:04.821708 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f790d65-d9ed-444d-8c6c-368fd63d10b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=23673589610d4ca981a59aa271af1300, user_id=97ee7e56dc6541beb11577d3bfd91126, role_id=fdad79ffbcbb4fa380dc9cf7dd108618)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:24:04.827358 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f790d65-d9ed-444d-8c6c-368fd63d10b2 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:24:04.849863 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1118/2249] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 00:24:04 2022] PUT /identity/v3/projects/23673589610d4ca981a59aa271af1300/users/97ee7e56dc6541beb11577d3bfd91126/roles/fdad79ffbcbb4fa380dc9cf7dd108618 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:24:04.864843 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ade57d2-dca2-4373-b93d-ad80ba674e53 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:04.865184 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ade57d2-dca2-4373-b93d-ad80ba674e53 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:04.865594 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ade57d2-dca2-4373-b93d-ad80ba674e53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:04.900227 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-0ade57d2-dca2-4373-b93d-ad80ba674e53 None None] MFA Rules not processed for user `97ee7e56dc6541beb11577d3bfd91126`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:24:04.901690 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-0ade57d2-dca2-4373-b93d-ad80ba674e53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:24:04.961814 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:24:04.998334 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1132/2250] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:24:04 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:24:05.012056 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f790d65-d9ed-444d-8c6c-368fd63d10b2 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:24:05.013827 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-4f790d65-d9ed-444d-8c6c-368fd63d10b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:24:05.079684 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f790d65-d9ed-444d-8c6c-368fd63d10b2 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:24:05.083663 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c57350-7f9f-4f0d-8c5e-fda0ebb84cbb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beecda6e9feb400288618745c784989f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:24:05.084407 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c57350-7f9f-4f0d-8c5e-fda0ebb84cbb service cinder] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:05.084690 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c57350-7f9f-4f0d-8c5e-fda0ebb84cbb service cinder] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:05.084965 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c57350-7f9f-4f0d-8c5e-fda0ebb84cbb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:05.094288 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c57350-7f9f-4f0d-8c5e-fda0ebb84cbb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:24:05.096098 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c57350-7f9f-4f0d-8c5e-fda0ebb84cbb service cinder] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:24:05.107295 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1119/2251] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:24:05 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:24:14.992790 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=4 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:24:15.102314 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=62,keystone:DELETE=4,keystone:INSERT=3 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:24:16.557265 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33d426c-0b15-4047-8e53-6311c1fc8647 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:16.558155 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33d426c-0b15-4047-8e53-6311c1fc8647 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:16.558155 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33d426c-0b15-4047-8e53-6311c1fc8647 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:16.602261 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-b33d426c-0b15-4047-8e53-6311c1fc8647 None None] MFA Rules not processed for user `601aa9e547aa4d42bef6753b26f48eaa`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:24:16.603912 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-b33d426c-0b15-4047-8e53-6311c1fc8647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:24:16.717202 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c57350-7f9f-4f0d-8c5e-fda0ebb84cbb service cinder] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:24:16.743171 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1133/2252] 10.222.0.47 () {58 vars in 967 bytes} [Wed Aug 31 00:24:16 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:24:16.763354 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33d426c-0b15-4047-8e53-6311c1fc8647 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:24:16.766100 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-b33d426c-0b15-4047-8e53-6311c1fc8647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:24:16.798189 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c57350-7f9f-4f0d-8c5e-fda0ebb84cbb service cinder] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:24:16.803096 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79b91d3-beef-4b9e-a7c1-1b5481a06557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:24:16.803788 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79b91d3-beef-4b9e-a7c1-1b5481a06557 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:16.804067 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79b91d3-beef-4b9e-a7c1-1b5481a06557 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:16.804381 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79b91d3-beef-4b9e-a7c1-1b5481a06557 admin admin] PATH_INFO: `/v3/users/97ee7e56dc6541beb11577d3bfd91126` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:16.805573 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79b91d3-beef-4b9e-a7c1-1b5481a06557 admin admin] RBAC: Authorizing `identity:delete_user(user_id=97ee7e56dc6541beb11577d3bfd91126)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:24:16.807608 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79b91d3-beef-4b9e-a7c1-1b5481a06557 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:24:16.872256 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-d79b91d3-beef-4b9e-a7c1-1b5481a06557 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97ee7e56dc6541beb11577d3bfd91126'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:24:16.886355 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-d79b91d3-beef-4b9e-a7c1-1b5481a06557 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97ee7e56dc6541beb11577d3bfd91126'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:24:16.893786 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33d426c-0b15-4047-8e53-6311c1fc8647 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:24:16.899013 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-d79b91d3-beef-4b9e-a7c1-1b5481a06557 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97ee7e56dc6541beb11577d3bfd91126'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:24:16.900300 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0715d7-bc97-422d-91e9-90b7aa2057e3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffbfbf19509645f49dbf9566e447c8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:24:16.900936 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0715d7-bc97-422d-91e9-90b7aa2057e3 service swift] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:16.901250 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0715d7-bc97-422d-91e9-90b7aa2057e3 service swift] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:16.901541 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0715d7-bc97-422d-91e9-90b7aa2057e3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:16.912209 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0715d7-bc97-422d-91e9-90b7aa2057e3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:24:16.913910 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0715d7-bc97-422d-91e9-90b7aa2057e3 service swift] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:24:16.918911 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-d79b91d3-beef-4b9e-a7c1-1b5481a06557 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97ee7e56dc6541beb11577d3bfd91126'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:24:16.920269 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-d79b91d3-beef-4b9e-a7c1-1b5481a06557 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97ee7e56dc6541beb11577d3bfd91126'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:24:16.927401 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1134/2253] 10.222.0.47 () {60 vars in 1384 bytes} [Wed Aug 31 00:24:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 31 00:24:16.930713 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1120/2254] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 31 00:24:16 2022] DELETE /identity/v3/users/97ee7e56dc6541beb11577d3bfd91126 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:24:16.936207 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48db35ad-4c97-4112-946c-53f87d4373ef None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:16.936736 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48db35ad-4c97-4112-946c-53f87d4373ef None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:16.937221 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48db35ad-4c97-4112-946c-53f87d4373ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:16.973567 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-48db35ad-4c97-4112-946c-53f87d4373ef None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:24:16.975826 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-48db35ad-4c97-4112-946c-53f87d4373ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:24:17.076357 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1135/2255] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:24:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:24:17.090736 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79b91d3-beef-4b9e-a7c1-1b5481a06557 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:24:17.093033 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-d79b91d3-beef-4b9e-a7c1-1b5481a06557 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:24:17.202847 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79b91d3-beef-4b9e-a7c1-1b5481a06557 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:24:17.210498 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea74957-e23b-4050-a646-3b419619150d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'daae792cd11d4c4ca7aae0558998aced', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:24:17.211960 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea74957-e23b-4050-a646-3b419619150d service neutron] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:17.212747 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea74957-e23b-4050-a646-3b419619150d service neutron] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:17.213657 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea74957-e23b-4050-a646-3b419619150d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:17.240075 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea74957-e23b-4050-a646-3b419619150d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:24:17.243451 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea74957-e23b-4050-a646-3b419619150d service neutron] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:24:17.270620 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1121/2256] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:24:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:24:18.284912 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48db35ad-4c97-4112-946c-53f87d4373ef None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:24:18.287051 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-48db35ad-4c97-4112-946c-53f87d4373ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:24:18.314801 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48db35ad-4c97-4112-946c-53f87d4373ef None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:24:18.323342 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7de123-7f6a-4545-92c9-ed3a579a8c51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:24:18.324471 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7de123-7f6a-4545-92c9-ed3a579a8c51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:18.325675 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7de123-7f6a-4545-92c9-ed3a579a8c51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:18.325675 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7de123-7f6a-4545-92c9-ed3a579a8c51 admin admin] PATH_INFO: `/v3/projects/23673589610d4ca981a59aa271af1300` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:18.327475 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7de123-7f6a-4545-92c9-ed3a579a8c51 admin admin] RBAC: Authorizing `identity:delete_project(project_id=23673589610d4ca981a59aa271af1300)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:24:18.329764 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7de123-7f6a-4545-92c9-ed3a579a8c51 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:24:18.389368 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:24:18.414691 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-8c7de123-7f6a-4545-92c9-ed3a579a8c51 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23673589610d4ca981a59aa271af1300', 'request_id': 'req-8c7de123-7f6a-4545-92c9-ed3a579a8c51'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:24:18.427554 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-8c7de123-7f6a-4545-92c9-ed3a579a8c51 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23673589610d4ca981a59aa271af1300', 'request_id': 'req-8c7de123-7f6a-4545-92c9-ed3a579a8c51'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:24:18.441699 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-8c7de123-7f6a-4545-92c9-ed3a579a8c51 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23673589610d4ca981a59aa271af1300', 'request_id': 'req-8c7de123-7f6a-4545-92c9-ed3a579a8c51'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:24:18.480383 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-8c7de123-7f6a-4545-92c9-ed3a579a8c51 admin admin] The token cache is being invalidate because project 23673589610d4ca981a59aa271af1300 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:24:18.480680 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-8c7de123-7f6a-4545-92c9-ed3a579a8c51 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:24:18.481455 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-8c7de123-7f6a-4545-92c9-ed3a579a8c51 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:24:18.483207 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1136/2257] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 31 00:24:18 2022] DELETE /identity/v3/projects/23673589610d4ca981a59aa271af1300 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:24:27.259727 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:24:28.470335 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=13,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:24:38.231892 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f2456e-87dc-458e-86a9-c8d55d709767 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:38.232770 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f2456e-87dc-458e-86a9-c8d55d709767 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:38.232770 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f2456e-87dc-458e-86a9-c8d55d709767 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:38.264744 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-26f2456e-87dc-458e-86a9-c8d55d709767 None None] MFA Rules not processed for user `c9dd5782e5f84ed68282cdda78ce909f`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:24:38.266323 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-26f2456e-87dc-458e-86a9-c8d55d709767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:24:38.361710 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1122/2258] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:24:38 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:24:41.902226 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7de123-7f6a-4545-92c9-ed3a579a8c51 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:24:41.903871 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-8c7de123-7f6a-4545-92c9-ed3a579a8c51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:24:41.974345 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7de123-7f6a-4545-92c9-ed3a579a8c51 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:24:41.985306 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1d5752-e0d5-4e36-beff-df218322e2f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'daae792cd11d4c4ca7aae0558998aced', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:24:41.986259 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1d5752-e0d5-4e36-beff-df218322e2f0 service neutron] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:24:41.986762 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1d5752-e0d5-4e36-beff-df218322e2f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:24:41.987168 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1d5752-e0d5-4e36-beff-df218322e2f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:24:41.990037 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-7d1d5752-e0d5-4e36-beff-df218322e2f0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:24:42.087299 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1d5752-e0d5-4e36-beff-df218322e2f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:24:42.089034 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1d5752-e0d5-4e36-beff-df218322e2f0 service neutron] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:24:42.102814 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1137/2259] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:24:41 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:24:48.353356 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=25 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:24:52.096732 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=50 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:25:05.376801 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeeb646-5e20-495a-96e0-f9f890f2151e None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:25:05.377697 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeeb646-5e20-495a-96e0-f9f890f2151e None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:25:05.377697 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeeb646-5e20-495a-96e0-f9f890f2151e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:25:05.400259 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-3aeeb646-5e20-495a-96e0-f9f890f2151e None None] MFA Rules not processed for user `f8ffd2d3c0c141118a7a9a5696c383e1`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:25:05.402260 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-3aeeb646-5e20-495a-96e0-f9f890f2151e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:25:05.473016 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1123/2260] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:25:05 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:25:09.504419 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a045afc-7f4b-4f9b-8a0c-4738294058cb None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:25:09.505328 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a045afc-7f4b-4f9b-8a0c-4738294058cb None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:25:09.505328 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a045afc-7f4b-4f9b-8a0c-4738294058cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:25:09.529432 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-8a045afc-7f4b-4f9b-8a0c-4738294058cb None None] MFA Rules not processed for user `b3da9d7af0fd4c1d99973e6b277b16d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:25:09.530684 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-8a045afc-7f4b-4f9b-8a0c-4738294058cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:25:09.598198 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1138/2261] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:25:09 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:25:15.464075 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=25 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:25:19.590416 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=25 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:25:29.912511 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e24a82-75a8-433c-b668-d839c2615149 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:25:29.913115 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e24a82-75a8-433c-b668-d839c2615149 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:25:29.913476 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e24a82-75a8-433c-b668-d839c2615149 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:25:29.947407 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-98e24a82-75a8-433c-b668-d839c2615149 None None] MFA Rules not processed for user `08fa033114244fc89c82939202f911e7`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:25:29.949652 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-98e24a82-75a8-433c-b668-d839c2615149 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:25:30.044493 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1124/2262] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:25:29 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:25:30.058152 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a045afc-7f4b-4f9b-8a0c-4738294058cb None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:25:30.060514 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-8a045afc-7f4b-4f9b-8a0c-4738294058cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:25:30.191362 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a045afc-7f4b-4f9b-8a0c-4738294058cb None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:25:30.198306 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99665ca-1740-45ee-98f7-88c1d7415fa7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea002bf49c248dbae7147665fa10fd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:25:30.199013 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99665ca-1740-45ee-98f7-88c1d7415fa7 service nova] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:25:30.199377 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99665ca-1740-45ee-98f7-88c1d7415fa7 service nova] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:25:30.199729 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99665ca-1740-45ee-98f7-88c1d7415fa7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:25:30.203312 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-e99665ca-1740-45ee-98f7-88c1d7415fa7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:25:30.223655 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99665ca-1740-45ee-98f7-88c1d7415fa7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:25:30.227327 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99665ca-1740-45ee-98f7-88c1d7415fa7 service nova] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:25:30.245564 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1139/2263] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:25:30 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:25:30.550577 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e24a82-75a8-433c-b668-d839c2615149 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:25:30.552117 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-98e24a82-75a8-433c-b668-d839c2615149 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:25:30.700884 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e24a82-75a8-433c-b668-d839c2615149 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:25:30.708231 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5614d0b3-395c-4869-adfe-499be89eb3be service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beecda6e9feb400288618745c784989f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:25:30.709376 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5614d0b3-395c-4869-adfe-499be89eb3be service cinder] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:25:30.710019 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5614d0b3-395c-4869-adfe-499be89eb3be service cinder] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:25:30.710473 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5614d0b3-395c-4869-adfe-499be89eb3be service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:25:30.714068 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-5614d0b3-395c-4869-adfe-499be89eb3be service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:25:30.831886 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5614d0b3-395c-4869-adfe-499be89eb3be service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:25:30.834295 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5614d0b3-395c-4869-adfe-499be89eb3be service cinder] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:25:30.847725 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1125/2264] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:25:30 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:25:32.384965 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99665ca-1740-45ee-98f7-88c1d7415fa7 service nova] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:25:32.387902 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-e99665ca-1740-45ee-98f7-88c1d7415fa7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:25:32.417912 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99665ca-1740-45ee-98f7-88c1d7415fa7 service nova] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:25:32.426419 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932e23ba-fc23-4525-87d5-1641f670cbe1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'daae792cd11d4c4ca7aae0558998aced', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:25:32.427458 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932e23ba-fc23-4525-87d5-1641f670cbe1 service neutron] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:25:32.427929 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932e23ba-fc23-4525-87d5-1641f670cbe1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:25:32.428441 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932e23ba-fc23-4525-87d5-1641f670cbe1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:25:32.431473 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-932e23ba-fc23-4525-87d5-1641f670cbe1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:25:32.465959 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932e23ba-fc23-4525-87d5-1641f670cbe1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:25:32.473443 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932e23ba-fc23-4525-87d5-1641f670cbe1 service neutron] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:25:32.500307 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1140/2265] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:25:32 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:25:38.602825 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5614d0b3-395c-4869-adfe-499be89eb3be service cinder] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:25:38.622002 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5614d0b3-395c-4869-adfe-499be89eb3be service cinder] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:25:38.633795 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d970f7-2c76-43c1-9b61-ffd3ae7550cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'daae792cd11d4c4ca7aae0558998aced', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:25:38.634856 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d970f7-2c76-43c1-9b61-ffd3ae7550cc service neutron] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:25:38.637764 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d970f7-2c76-43c1-9b61-ffd3ae7550cc service neutron] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:25:38.638280 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d970f7-2c76-43c1-9b61-ffd3ae7550cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:25:38.644135 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-76d970f7-2c76-43c1-9b61-ffd3ae7550cc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:25:38.695078 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d970f7-2c76-43c1-9b61-ffd3ae7550cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:25:38.698887 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d970f7-2c76-43c1-9b61-ffd3ae7550cc service neutron] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:25:38.730164 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1126/2266] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:25:38 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:25:42.487168 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=40 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:25:43.463045 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e58468-8e60-465b-bfa7-13b915c68678 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:25:43.463478 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e58468-8e60-465b-bfa7-13b915c68678 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:25:43.464132 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e58468-8e60-465b-bfa7-13b915c68678 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:25:43.505157 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-f1e58468-8e60-465b-bfa7-13b915c68678 None None] MFA Rules not processed for user `bc018a253e0a4b0bb96097ce4cc72c21`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:25:43.509126 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-f1e58468-8e60-465b-bfa7-13b915c68678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:25:43.522564 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1141/2267] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:25:43 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:25:44.158597 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d970f7-2c76-43c1-9b61-ffd3ae7550cc service neutron] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:25:44.172411 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d970f7-2c76-43c1-9b61-ffd3ae7550cc service neutron] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:25:44.179102 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa256414-bdd5-4a15-9714-01126bd9f7b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'daae792cd11d4c4ca7aae0558998aced', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:25:44.179827 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa256414-bdd5-4a15-9714-01126bd9f7b5 service neutron] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:25:44.180216 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa256414-bdd5-4a15-9714-01126bd9f7b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:25:44.180684 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa256414-bdd5-4a15-9714-01126bd9f7b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:25:44.182948 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-aa256414-bdd5-4a15-9714-01126bd9f7b5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:25:44.194945 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa256414-bdd5-4a15-9714-01126bd9f7b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:25:44.196446 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa256414-bdd5-4a15-9714-01126bd9f7b5 service neutron] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:25:44.208760 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1127/2268] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:25:44 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:25:44.671246 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e58468-8e60-465b-bfa7-13b915c68678 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:25:44.673639 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-f1e58468-8e60-465b-bfa7-13b915c68678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:25:44.777246 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e58468-8e60-465b-bfa7-13b915c68678 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:25:44.783471 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553eff5e-8a91-4812-837a-6c699bb5cc17 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f76e01e32264ff7a6a7740ffa0a207d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:25:44.784181 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553eff5e-8a91-4812-837a-6c699bb5cc17 service placement] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:25:44.784478 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553eff5e-8a91-4812-837a-6c699bb5cc17 service placement] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:25:44.784751 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553eff5e-8a91-4812-837a-6c699bb5cc17 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:25:44.786727 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-553eff5e-8a91-4812-837a-6c699bb5cc17 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:25:44.800531 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553eff5e-8a91-4812-837a-6c699bb5cc17 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:25:44.802157 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553eff5e-8a91-4812-837a-6c699bb5cc17 service placement] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:25:44.814696 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1142/2269] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:25:44 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:25:52.361781 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa256414-bdd5-4a15-9714-01126bd9f7b5 service neutron] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:25:52.388059 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa256414-bdd5-4a15-9714-01126bd9f7b5 service neutron] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:25:52.393322 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bfd760-7040-445c-ac0c-51a4bbe10e57 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beecda6e9feb400288618745c784989f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:25:52.394220 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bfd760-7040-445c-ac0c-51a4bbe10e57 service cinder] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:25:52.394657 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bfd760-7040-445c-ac0c-51a4bbe10e57 service cinder] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:25:52.395637 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bfd760-7040-445c-ac0c-51a4bbe10e57 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:25:52.398175 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-e0bfd760-7040-445c-ac0c-51a4bbe10e57 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:25:52.418721 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bfd760-7040-445c-ac0c-51a4bbe10e57 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:25:52.421009 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bfd760-7040-445c-ac0c-51a4bbe10e57 service cinder] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:25:52.439197 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1128/2270] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:25:52 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:25:52.943412 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553eff5e-8a91-4812-837a-6c699bb5cc17 service placement] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:25:52.963821 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553eff5e-8a91-4812-837a-6c699bb5cc17 service placement] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:25:52.969791 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081e2296-6e66-4413-aa96-c7ec1da69197 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'daae792cd11d4c4ca7aae0558998aced', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:25:52.970671 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081e2296-6e66-4413-aa96-c7ec1da69197 service neutron] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:25:52.971288 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081e2296-6e66-4413-aa96-c7ec1da69197 service neutron] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:25:52.972061 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081e2296-6e66-4413-aa96-c7ec1da69197 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:25:52.974694 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-081e2296-6e66-4413-aa96-c7ec1da69197 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:25:53.000048 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081e2296-6e66-4413-aa96-c7ec1da69197 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:25:53.011216 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081e2296-6e66-4413-aa96-c7ec1da69197 service neutron] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:25:53.029614 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1143/2271] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:25:52 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:26:02.430040 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=91 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:26:02.778075 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bfd760-7040-445c-ac0c-51a4bbe10e57 service cinder] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:02.781255 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-e0bfd760-7040-445c-ac0c-51a4bbe10e57 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:02.883056 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bfd760-7040-445c-ac0c-51a4bbe10e57 service cinder] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:02.889473 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2938202-def0-4c02-87aa-9cc6a97a7109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:02.891433 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2938202-def0-4c02-87aa-9cc6a97a7109 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:02.892214 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2938202-def0-4c02-87aa-9cc6a97a7109 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:02.896131 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2938202-def0-4c02-87aa-9cc6a97a7109 admin admin] PATH_INFO: `/v3/users/c9dd5782e5f84ed68282cdda78ce909f` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:02.901203 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2938202-def0-4c02-87aa-9cc6a97a7109 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9dd5782e5f84ed68282cdda78ce909f)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:02.905284 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2938202-def0-4c02-87aa-9cc6a97a7109 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:03.020957 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-a2938202-def0-4c02-87aa-9cc6a97a7109 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9dd5782e5f84ed68282cdda78ce909f'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:03.022644 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=41 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:26:03.037977 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-a2938202-def0-4c02-87aa-9cc6a97a7109 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9dd5782e5f84ed68282cdda78ce909f'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:03.066341 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-a2938202-def0-4c02-87aa-9cc6a97a7109 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9dd5782e5f84ed68282cdda78ce909f'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:03.106784 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-a2938202-def0-4c02-87aa-9cc6a97a7109 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9dd5782e5f84ed68282cdda78ce909f'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:03.107777 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-a2938202-def0-4c02-87aa-9cc6a97a7109 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9dd5782e5f84ed68282cdda78ce909f'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:03.120217 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1129/2272] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 31 00:26:02 2022] DELETE /identity/v3/users/c9dd5782e5f84ed68282cdda78ce909f => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:26:03.534924 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081e2296-6e66-4413-aa96-c7ec1da69197 service neutron] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:03.553473 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081e2296-6e66-4413-aa96-c7ec1da69197 service neutron] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:03.715922 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba398c6-e068-426a-9999-e281bb75bebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:03.716937 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba398c6-e068-426a-9999-e281bb75bebf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:03.718439 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba398c6-e068-426a-9999-e281bb75bebf admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:03.718944 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba398c6-e068-426a-9999-e281bb75bebf admin admin] PATH_INFO: `/v3/projects/29f449e37cc6482eaca34671c7541c4b` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:03.721297 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba398c6-e068-426a-9999-e281bb75bebf admin admin] RBAC: Authorizing `identity:delete_project(project_id=29f449e37cc6482eaca34671c7541c4b)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:03.724399 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba398c6-e068-426a-9999-e281bb75bebf admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:03.801393 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-1ba398c6-e068-426a-9999-e281bb75bebf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29f449e37cc6482eaca34671c7541c4b', 'request_id': 'req-1ba398c6-e068-426a-9999-e281bb75bebf'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:03.811479 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-1ba398c6-e068-426a-9999-e281bb75bebf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29f449e37cc6482eaca34671c7541c4b', 'request_id': 'req-1ba398c6-e068-426a-9999-e281bb75bebf'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:03.821734 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-1ba398c6-e068-426a-9999-e281bb75bebf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29f449e37cc6482eaca34671c7541c4b', 'request_id': 'req-1ba398c6-e068-426a-9999-e281bb75bebf'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:03.849510 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-1ba398c6-e068-426a-9999-e281bb75bebf admin admin] The token cache is being invalidate because project 29f449e37cc6482eaca34671c7541c4b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:26:03.850116 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-1ba398c6-e068-426a-9999-e281bb75bebf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:03.852797 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-1ba398c6-e068-426a-9999-e281bb75bebf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:03.856860 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1144/2273] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 31 00:26:03 2022] DELETE /identity/v3/projects/29f449e37cc6482eaca34671c7541c4b => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:26:03.870630 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90518417-0aef-4168-a7cf-882476f8c0a6 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:03.871435 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90518417-0aef-4168-a7cf-882476f8c0a6 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:03.871435 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90518417-0aef-4168-a7cf-882476f8c0a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:03.918142 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-90518417-0aef-4168-a7cf-882476f8c0a6 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:26:03.921356 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-90518417-0aef-4168-a7cf-882476f8c0a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:04.095780 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1130/2274] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:26:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:26:04.098744 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dafe700-5c85-467b-ac68-8ab932bd0ba4 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:04.099535 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dafe700-5c85-467b-ac68-8ab932bd0ba4 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:04.099745 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dafe700-5c85-467b-ac68-8ab932bd0ba4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:04.136780 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-1dafe700-5c85-467b-ac68-8ab932bd0ba4 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:26:04.139026 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-1dafe700-5c85-467b-ac68-8ab932bd0ba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:04.159224 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1145/2275] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:26:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:26:04.164452 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90518417-0aef-4168-a7cf-882476f8c0a6 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:04.182294 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90518417-0aef-4168-a7cf-882476f8c0a6 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:04.190843 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedf8464-db22-48af-94c9-064aa58b6e2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:04.191618 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedf8464-db22-48af-94c9-064aa58b6e2c admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:04.192037 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedf8464-db22-48af-94c9-064aa58b6e2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:04.192267 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedf8464-db22-48af-94c9-064aa58b6e2c admin admin] PATH_INFO: `/v3/domains` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:04.193031 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedf8464-db22-48af-94c9-064aa58b6e2c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:26:04.193418 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedf8464-db22-48af-94c9-064aa58b6e2c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:04.195206 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedf8464-db22-48af-94c9-064aa58b6e2c admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:04.217600 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1131/2276] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 31 00:26:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:26:04.219966 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dafe700-5c85-467b-ac68-8ab932bd0ba4 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:04.238710 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dafe700-5c85-467b-ac68-8ab932bd0ba4 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:04.246893 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c7031a-04d3-47ef-881f-b27f8d1b8ccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:04.247973 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c7031a-04d3-47ef-881f-b27f8d1b8ccd admin admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:04.249096 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c7031a-04d3-47ef-881f-b27f8d1b8ccd admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:04.249953 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c7031a-04d3-47ef-881f-b27f8d1b8ccd admin admin] PATH_INFO: `/v3/projects` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:04.250923 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c7031a-04d3-47ef-881f-b27f8d1b8ccd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:04.256246 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c7031a-04d3-47ef-881f-b27f8d1b8ccd admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:04.306323 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1146/2277] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 31 00:26:04 2022] POST /identity/v3/projects => generated 377 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:26:04.312942 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedf8464-db22-48af-94c9-064aa58b6e2c admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:04.334015 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedf8464-db22-48af-94c9-064aa58b6e2c admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:04.354312 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:26:04.469146 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61fc56a-8b07-4599-9de2-6ec188408f16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:04.470303 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61fc56a-8b07-4599-9de2-6ec188408f16 admin admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:04.471442 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61fc56a-8b07-4599-9de2-6ec188408f16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:04.471442 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61fc56a-8b07-4599-9de2-6ec188408f16 admin admin] PATH_INFO: `/v3/users` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:04.472939 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61fc56a-8b07-4599-9de2-6ec188408f16 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:04.476928 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61fc56a-8b07-4599-9de2-6ec188408f16 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:04.521756 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1132/2278] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 31 00:26:04 2022] POST /identity/v3/users => generated 289 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:26:04.525955 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c7031a-04d3-47ef-881f-b27f8d1b8ccd admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:04.544507 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c7031a-04d3-47ef-881f-b27f8d1b8ccd admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:04.555215 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02f68d0-8c91-44cf-b9f6-2127c632b7a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:04.556596 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02f68d0-8c91-44cf-b9f6-2127c632b7a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:04.557324 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02f68d0-8c91-44cf-b9f6-2127c632b7a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:04.558165 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02f68d0-8c91-44cf-b9f6-2127c632b7a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:04.559884 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02f68d0-8c91-44cf-b9f6-2127c632b7a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:04.564123 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02f68d0-8c91-44cf-b9f6-2127c632b7a8 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:04.594493 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1147/2279] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 00:26:04 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 00:26:04.597200 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61fc56a-8b07-4599-9de2-6ec188408f16 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:04.617095 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61fc56a-8b07-4599-9de2-6ec188408f16 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:04.628810 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f4c5b2-61cf-4a2e-a705-1dee6dfab47f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:04.630073 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f4c5b2-61cf-4a2e-a705-1dee6dfab47f admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:04.630630 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f4c5b2-61cf-4a2e-a705-1dee6dfab47f admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:04.631174 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f4c5b2-61cf-4a2e-a705-1dee6dfab47f admin admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:04.632487 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f4c5b2-61cf-4a2e-a705-1dee6dfab47f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:04.636274 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f4c5b2-61cf-4a2e-a705-1dee6dfab47f admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:04.659924 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1133/2280] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 00:26:04 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:26:04.666890 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02f68d0-8c91-44cf-b9f6-2127c632b7a8 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:04.689769 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02f68d0-8c91-44cf-b9f6-2127c632b7a8 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:04.699291 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca84336-f8b6-43b7-aa10-272817771e90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:04.700121 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca84336-f8b6-43b7-aa10-272817771e90 admin admin] REQUEST_METHOD: `PUT` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:04.700785 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca84336-f8b6-43b7-aa10-272817771e90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:04.701417 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca84336-f8b6-43b7-aa10-272817771e90 admin admin] PATH_INFO: `/v3/projects/5e59b45c75cb4f8ea7e7a47730709614/users/410f2e9dc2db4ffcb5ff0f67b0d00ddc/roles/fdad79ffbcbb4fa380dc9cf7dd108618` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:04.741639 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca84336-f8b6-43b7-aa10-272817771e90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e59b45c75cb4f8ea7e7a47730709614, user_id=410f2e9dc2db4ffcb5ff0f67b0d00ddc, role_id=fdad79ffbcbb4fa380dc9cf7dd108618)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:04.745619 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca84336-f8b6-43b7-aa10-272817771e90 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:04.774089 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1148/2281] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 00:26:04 2022] PUT /identity/v3/projects/5e59b45c75cb4f8ea7e7a47730709614/users/410f2e9dc2db4ffcb5ff0f67b0d00ddc/roles/fdad79ffbcbb4fa380dc9cf7dd108618 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:26:04.781902 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7711b212-353b-4fe1-ab35-49672b9938c6 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:04.782235 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7711b212-353b-4fe1-ab35-49672b9938c6 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:04.782502 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7711b212-353b-4fe1-ab35-49672b9938c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:04.810754 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-7711b212-353b-4fe1-ab35-49672b9938c6 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:26:04.811788 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-7711b212-353b-4fe1-ab35-49672b9938c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:04.934813 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1134/2282] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:26:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:26:04.947831 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca84336-f8b6-43b7-aa10-272817771e90 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:04.950870 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-7ca84336-f8b6-43b7-aa10-272817771e90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:05.039031 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:26:05.103954 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca84336-f8b6-43b7-aa10-272817771e90 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:05.109965 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5852ce-942b-49ca-988e-66937784b4ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'daae792cd11d4c4ca7aae0558998aced', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:05.111562 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5852ce-942b-49ca-988e-66937784b4ca service neutron] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:05.112016 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5852ce-942b-49ca-988e-66937784b4ca service neutron] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:05.112356 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5852ce-942b-49ca-988e-66937784b4ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:05.137096 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5852ce-942b-49ca-988e-66937784b4ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:05.139066 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5852ce-942b-49ca-988e-66937784b4ca service neutron] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:05.151160 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1149/2283] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:26:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:26:11.317344 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7711b212-353b-4fe1-ab35-49672b9938c6 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:11.320037 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-7711b212-353b-4fe1-ab35-49672b9938c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:11.529976 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7711b212-353b-4fe1-ab35-49672b9938c6 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:11.587884 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cac38cb-1cf3-4ea9-bfe0-2a45afcffc0a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea002bf49c248dbae7147665fa10fd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:11.589013 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cac38cb-1cf3-4ea9-bfe0-2a45afcffc0a service nova] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:11.589505 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cac38cb-1cf3-4ea9-bfe0-2a45afcffc0a service nova] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:11.589996 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cac38cb-1cf3-4ea9-bfe0-2a45afcffc0a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:11.595073 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-3cac38cb-1cf3-4ea9-bfe0-2a45afcffc0a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:11.665179 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cac38cb-1cf3-4ea9-bfe0-2a45afcffc0a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:11.668236 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cac38cb-1cf3-4ea9-bfe0-2a45afcffc0a service nova] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:11.736077 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1135/2284] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:26:11 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:26:12.234823 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c74439-0f24-4fc6-a8cc-0355fa37b38d None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:12.235379 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c74439-0f24-4fc6-a8cc-0355fa37b38d None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:12.235910 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c74439-0f24-4fc6-a8cc-0355fa37b38d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:12.283189 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-80c74439-0f24-4fc6-a8cc-0355fa37b38d None None] MFA Rules not processed for user `410f2e9dc2db4ffcb5ff0f67b0d00ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:26:12.284490 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-80c74439-0f24-4fc6-a8cc-0355fa37b38d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:12.410737 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1150/2285] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:26:12 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:26:12.412266 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cac38cb-1cf3-4ea9-bfe0-2a45afcffc0a service nova] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:12.426315 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cac38cb-1cf3-4ea9-bfe0-2a45afcffc0a service nova] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:12.432475 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d59136-3ab1-40dd-a4cc-9ade5e7a3001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:12.433304 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d59136-3ab1-40dd-a4cc-9ade5e7a3001 admin admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:12.433922 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d59136-3ab1-40dd-a4cc-9ade5e7a3001 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:12.434405 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d59136-3ab1-40dd-a4cc-9ade5e7a3001 admin admin] PATH_INFO: `/v3/projects` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:12.435497 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d59136-3ab1-40dd-a4cc-9ade5e7a3001 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:12.438417 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d59136-3ab1-40dd-a4cc-9ade5e7a3001 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:12.454547 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:26:12.491187 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1136/2286] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 31 00:26:12 2022] POST /identity/v3/projects => generated 377 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:26:12.496708 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c74439-0f24-4fc6-a8cc-0355fa37b38d None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:12.518537 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c74439-0f24-4fc6-a8cc-0355fa37b38d None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:12.618532 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3686453-b069-42b5-8097-72efb74a836b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:12.619584 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3686453-b069-42b5-8097-72efb74a836b admin admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:12.620086 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3686453-b069-42b5-8097-72efb74a836b admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:12.620652 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3686453-b069-42b5-8097-72efb74a836b admin admin] PATH_INFO: `/v3/users` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:12.621872 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3686453-b069-42b5-8097-72efb74a836b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:12.625900 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3686453-b069-42b5-8097-72efb74a836b admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:12.663136 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1151/2287] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 31 00:26:12 2022] POST /identity/v3/users => generated 295 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:26:12.668987 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d59136-3ab1-40dd-a4cc-9ade5e7a3001 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:12.683631 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d59136-3ab1-40dd-a4cc-9ade5e7a3001 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:12.692260 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1294b4-79c4-43da-af61-99292d96ccbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:12.695125 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1294b4-79c4-43da-af61-99292d96ccbc admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:12.695533 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1294b4-79c4-43da-af61-99292d96ccbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:12.695991 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1294b4-79c4-43da-af61-99292d96ccbc admin admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:12.696979 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1294b4-79c4-43da-af61-99292d96ccbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:12.699215 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1294b4-79c4-43da-af61-99292d96ccbc admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:12.713929 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1137/2288] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 00:26:12 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:26:12.719600 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3686453-b069-42b5-8097-72efb74a836b admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:12.738341 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3686453-b069-42b5-8097-72efb74a836b admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:12.747690 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773f9cf4-1d94-4045-9234-e658bad68b9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:12.748667 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773f9cf4-1d94-4045-9234-e658bad68b9b admin admin] REQUEST_METHOD: `PUT` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:12.749212 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773f9cf4-1d94-4045-9234-e658bad68b9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:12.749583 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773f9cf4-1d94-4045-9234-e658bad68b9b admin admin] PATH_INFO: `/v3/projects/3dd11c1f01664ae6be7a03dae5272eae/users/e32c05e148664ff49bce7ad9ef781e0a/roles/12f6817f9aaa4e2bb477095a6bed5d0f` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:12.770625 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773f9cf4-1d94-4045-9234-e658bad68b9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=3dd11c1f01664ae6be7a03dae5272eae, user_id=e32c05e148664ff49bce7ad9ef781e0a, role_id=12f6817f9aaa4e2bb477095a6bed5d0f)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:12.773840 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773f9cf4-1d94-4045-9234-e658bad68b9b admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:12.790310 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1152/2289] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 00:26:12 2022] PUT /identity/v3/projects/3dd11c1f01664ae6be7a03dae5272eae/users/e32c05e148664ff49bce7ad9ef781e0a/roles/12f6817f9aaa4e2bb477095a6bed5d0f => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:26:12.795235 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1294b4-79c4-43da-af61-99292d96ccbc admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:12.814272 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1294b4-79c4-43da-af61-99292d96ccbc admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:12.908035 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a553db5-55c6-4694-a6f2-33ffa8a8f29d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:12.908828 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a553db5-55c6-4694-a6f2-33ffa8a8f29d admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:12.909151 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a553db5-55c6-4694-a6f2-33ffa8a8f29d admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:12.909468 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a553db5-55c6-4694-a6f2-33ffa8a8f29d admin admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:12.910429 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a553db5-55c6-4694-a6f2-33ffa8a8f29d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:12.912268 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a553db5-55c6-4694-a6f2-33ffa8a8f29d admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:12.925126 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1138/2290] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 00:26:12 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:26:12.929786 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773f9cf4-1d94-4045-9234-e658bad68b9b admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:12.949016 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773f9cf4-1d94-4045-9234-e658bad68b9b admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:12.961539 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81fe3fb-af23-4e20-8b43-4023ab4c5b8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:12.962886 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81fe3fb-af23-4e20-8b43-4023ab4c5b8d admin admin] REQUEST_METHOD: `PUT` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:12.963469 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81fe3fb-af23-4e20-8b43-4023ab4c5b8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:12.964034 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81fe3fb-af23-4e20-8b43-4023ab4c5b8d admin admin] PATH_INFO: `/v3/projects/3dd11c1f01664ae6be7a03dae5272eae/users/e32c05e148664ff49bce7ad9ef781e0a/roles/12f6817f9aaa4e2bb477095a6bed5d0f` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:12.968549 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81fe3fb-af23-4e20-8b43-4023ab4c5b8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=3dd11c1f01664ae6be7a03dae5272eae, user_id=e32c05e148664ff49bce7ad9ef781e0a, role_id=12f6817f9aaa4e2bb477095a6bed5d0f)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:12.974530 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81fe3fb-af23-4e20-8b43-4023ab4c5b8d admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:12.993330 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1153/2291] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 00:26:12 2022] PUT /identity/v3/projects/3dd11c1f01664ae6be7a03dae5272eae/users/e32c05e148664ff49bce7ad9ef781e0a/roles/12f6817f9aaa4e2bb477095a6bed5d0f => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:26:19.735537 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa6d678-54e5-4da1-b728-6a9df9eeacf0 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:19.736416 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa6d678-54e5-4da1-b728-6a9df9eeacf0 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:19.736416 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa6d678-54e5-4da1-b728-6a9df9eeacf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:19.781568 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-1fa6d678-54e5-4da1-b728-6a9df9eeacf0 None None] MFA Rules not processed for user `e32c05e148664ff49bce7ad9ef781e0a`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:26:19.782871 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-1fa6d678-54e5-4da1-b728-6a9df9eeacf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:19.884242 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1139/2292] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:26:19 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:26:19.900023 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81fe3fb-af23-4e20-8b43-4023ab4c5b8d admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:19.902359 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-b81fe3fb-af23-4e20-8b43-4023ab4c5b8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:19.923244 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:26:20.017503 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81fe3fb-af23-4e20-8b43-4023ab4c5b8d admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:20.027499 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9cb364-0e8f-4706-b47b-a91c81d6ef55 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea002bf49c248dbae7147665fa10fd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:20.028539 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9cb364-0e8f-4706-b47b-a91c81d6ef55 service nova] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:20.029068 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9cb364-0e8f-4706-b47b-a91c81d6ef55 service nova] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:20.031086 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9cb364-0e8f-4706-b47b-a91c81d6ef55 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:20.158789 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9cb364-0e8f-4706-b47b-a91c81d6ef55 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:20.160495 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9cb364-0e8f-4706-b47b-a91c81d6ef55 service nova] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:20.173525 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1154/2293] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:26:19 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 00:26:21.524527 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa6d678-54e5-4da1-b728-6a9df9eeacf0 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:21.527451 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-1fa6d678-54e5-4da1-b728-6a9df9eeacf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:21.689320 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa6d678-54e5-4da1-b728-6a9df9eeacf0 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:21.697077 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef3f82f-06a8-4289-b522-2bf215f96111 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'daae792cd11d4c4ca7aae0558998aced', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:21.698596 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef3f82f-06a8-4289-b522-2bf215f96111 service neutron] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:21.699400 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef3f82f-06a8-4289-b522-2bf215f96111 service neutron] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:21.700112 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef3f82f-06a8-4289-b522-2bf215f96111 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:21.704255 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-bef3f82f-06a8-4289-b522-2bf215f96111 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:21.738059 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:26:21.855137 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef3f82f-06a8-4289-b522-2bf215f96111 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:21.857032 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef3f82f-06a8-4289-b522-2bf215f96111 service neutron] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:21.875825 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1140/2294] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:26:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:26:25.132591 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9cb364-0e8f-4706-b47b-a91c81d6ef55 service nova] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:25.146925 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9cb364-0e8f-4706-b47b-a91c81d6ef55 service nova] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:25.155045 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca178299-1e73-4698-8886-cd5639d36d51 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea002bf49c248dbae7147665fa10fd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:25.155712 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca178299-1e73-4698-8886-cd5639d36d51 service nova] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:25.156000 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca178299-1e73-4698-8886-cd5639d36d51 service nova] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:25.156326 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca178299-1e73-4698-8886-cd5639d36d51 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:25.159083 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-ca178299-1e73-4698-8886-cd5639d36d51 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:25.256607 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca178299-1e73-4698-8886-cd5639d36d51 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:25.258378 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca178299-1e73-4698-8886-cd5639d36d51 service nova] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:25.286253 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1155/2295] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:26:25 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 00:26:27.804802 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef3f82f-06a8-4289-b522-2bf215f96111 service neutron] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:27.808045 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-bef3f82f-06a8-4289-b522-2bf215f96111 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:27.855269 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef3f82f-06a8-4289-b522-2bf215f96111 service neutron] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:27.862556 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df084c44-923f-4277-9a97-0deb1d250a38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:27.863360 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df084c44-923f-4277-9a97-0deb1d250a38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:27.863862 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df084c44-923f-4277-9a97-0deb1d250a38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:27.864378 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df084c44-923f-4277-9a97-0deb1d250a38 admin admin] PATH_INFO: `/v3/users/f8ffd2d3c0c141118a7a9a5696c383e1` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:27.866269 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df084c44-923f-4277-9a97-0deb1d250a38 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8ffd2d3c0c141118a7a9a5696c383e1)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:27.868970 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df084c44-923f-4277-9a97-0deb1d250a38 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:27.959478 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-df084c44-923f-4277-9a97-0deb1d250a38 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8ffd2d3c0c141118a7a9a5696c383e1'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:27.981065 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-df084c44-923f-4277-9a97-0deb1d250a38 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8ffd2d3c0c141118a7a9a5696c383e1'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:28.009623 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-df084c44-923f-4277-9a97-0deb1d250a38 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8ffd2d3c0c141118a7a9a5696c383e1'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:28.039739 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-df084c44-923f-4277-9a97-0deb1d250a38 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8ffd2d3c0c141118a7a9a5696c383e1'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:28.040890 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-df084c44-923f-4277-9a97-0deb1d250a38 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8ffd2d3c0c141118a7a9a5696c383e1'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:28.050654 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1141/2296] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 31 00:26:27 2022] DELETE /identity/v3/users/f8ffd2d3c0c141118a7a9a5696c383e1 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:26:28.295435 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca178299-1e73-4698-8886-cd5639d36d51 service nova] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:28.309421 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca178299-1e73-4698-8886-cd5639d36d51 service nova] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:28.375328 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:26:28.392578 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df310e5-1d38-4f01-8f32-0da663825369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:28.393260 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df310e5-1d38-4f01-8f32-0da663825369 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:28.393592 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df310e5-1d38-4f01-8f32-0da663825369 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:28.393867 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df310e5-1d38-4f01-8f32-0da663825369 admin admin] PATH_INFO: `/v3/projects/af873e6a013c457aa2407fb24423ddc1` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:28.395022 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df310e5-1d38-4f01-8f32-0da663825369 admin admin] RBAC: Authorizing `identity:delete_project(project_id=af873e6a013c457aa2407fb24423ddc1)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:28.397162 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df310e5-1d38-4f01-8f32-0da663825369 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:28.464388 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-0df310e5-1d38-4f01-8f32-0da663825369 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af873e6a013c457aa2407fb24423ddc1', 'request_id': 'req-0df310e5-1d38-4f01-8f32-0da663825369'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:28.471981 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-0df310e5-1d38-4f01-8f32-0da663825369 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af873e6a013c457aa2407fb24423ddc1', 'request_id': 'req-0df310e5-1d38-4f01-8f32-0da663825369'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:28.479941 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-0df310e5-1d38-4f01-8f32-0da663825369 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af873e6a013c457aa2407fb24423ddc1', 'request_id': 'req-0df310e5-1d38-4f01-8f32-0da663825369'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:28.496120 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-0df310e5-1d38-4f01-8f32-0da663825369 admin admin] The token cache is being invalidate because project af873e6a013c457aa2407fb24423ddc1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:26:28.496515 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-0df310e5-1d38-4f01-8f32-0da663825369 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:28.497188 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-0df310e5-1d38-4f01-8f32-0da663825369 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:28.499585 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1156/2297] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 31 00:26:28 2022] DELETE /identity/v3/projects/af873e6a013c457aa2407fb24423ddc1 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:26:28.505609 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c223069-ffa6-425b-bec9-2edd7523312d None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:28.505938 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c223069-ffa6-425b-bec9-2edd7523312d None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:28.506250 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c223069-ffa6-425b-bec9-2edd7523312d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:28.528072 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-6c223069-ffa6-425b-bec9-2edd7523312d None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:26:28.529419 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-6c223069-ffa6-425b-bec9-2edd7523312d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:28.615075 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1142/2298] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:26:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:26:28.624077 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde5af48-26e3-442c-95a3-6d5128516cb9 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:28.624396 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde5af48-26e3-442c-95a3-6d5128516cb9 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:28.624698 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde5af48-26e3-442c-95a3-6d5128516cb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:28.646923 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-bde5af48-26e3-442c-95a3-6d5128516cb9 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:26:28.648362 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-bde5af48-26e3-442c-95a3-6d5128516cb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:28.657286 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1157/2299] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:26:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:26:28.662219 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c223069-ffa6-425b-bec9-2edd7523312d None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:28.672933 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c223069-ffa6-425b-bec9-2edd7523312d None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:28.678365 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c20843-3c4a-473d-89ba-ddf664075125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:28.679001 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c20843-3c4a-473d-89ba-ddf664075125 admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:28.679283 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c20843-3c4a-473d-89ba-ddf664075125 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:28.679560 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c20843-3c4a-473d-89ba-ddf664075125 admin admin] PATH_INFO: `/v3/domains` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:28.680276 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c20843-3c4a-473d-89ba-ddf664075125 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:26:28.680582 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c20843-3c4a-473d-89ba-ddf664075125 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:28.682262 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c20843-3c4a-473d-89ba-ddf664075125 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:28.695418 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1143/2300] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 31 00:26:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:26:28.702057 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde5af48-26e3-442c-95a3-6d5128516cb9 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:28.712437 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde5af48-26e3-442c-95a3-6d5128516cb9 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:28.718826 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd56661-7f4d-4b79-9bab-e0d9d16181ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:28.719516 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd56661-7f4d-4b79-9bab-e0d9d16181ce admin admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:28.719869 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd56661-7f4d-4b79-9bab-e0d9d16181ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:28.720353 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd56661-7f4d-4b79-9bab-e0d9d16181ce admin admin] PATH_INFO: `/v3/projects` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:28.721279 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd56661-7f4d-4b79-9bab-e0d9d16181ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:28.724517 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd56661-7f4d-4b79-9bab-e0d9d16181ce admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:28.758633 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1158/2301] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 31 00:26:28 2022] POST /identity/v3/projects => generated 365 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:26:28.763461 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c20843-3c4a-473d-89ba-ddf664075125 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:28.776495 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c20843-3c4a-473d-89ba-ddf664075125 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:28.784770 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:26:28.866396 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b037f95-5fc1-45cd-a20d-3600e337b14d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:28.867139 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b037f95-5fc1-45cd-a20d-3600e337b14d admin admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:28.867441 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b037f95-5fc1-45cd-a20d-3600e337b14d admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:28.867957 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b037f95-5fc1-45cd-a20d-3600e337b14d admin admin] PATH_INFO: `/v3/users` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:28.868722 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b037f95-5fc1-45cd-a20d-3600e337b14d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:28.870787 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b037f95-5fc1-45cd-a20d-3600e337b14d admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:28.898923 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1144/2302] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 31 00:26:28 2022] POST /identity/v3/users => generated 283 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:26:28.903469 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd56661-7f4d-4b79-9bab-e0d9d16181ce admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:28.921012 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd56661-7f4d-4b79-9bab-e0d9d16181ce admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:28.927865 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a232881e-c3d6-42a4-a065-74837a827f4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:28.928544 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a232881e-c3d6-42a4-a065-74837a827f4b admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:28.928830 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a232881e-c3d6-42a4-a065-74837a827f4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:28.929109 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a232881e-c3d6-42a4-a065-74837a827f4b admin admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:28.929767 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a232881e-c3d6-42a4-a065-74837a827f4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:28.931417 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a232881e-c3d6-42a4-a065-74837a827f4b admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:28.943647 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1159/2303] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 00:26:28 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:26:28.948130 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b037f95-5fc1-45cd-a20d-3600e337b14d admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:28.959171 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b037f95-5fc1-45cd-a20d-3600e337b14d admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:28.964741 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae1129b-324d-432a-95cc-5c4c80f5703a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:28.965376 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae1129b-324d-432a-95cc-5c4c80f5703a admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:28.965687 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae1129b-324d-432a-95cc-5c4c80f5703a admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:28.966212 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae1129b-324d-432a-95cc-5c4c80f5703a admin admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:28.967712 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae1129b-324d-432a-95cc-5c4c80f5703a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:28.970861 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae1129b-324d-432a-95cc-5c4c80f5703a admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:28.986877 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1145/2304] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 00:26:28 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 00:26:28.991154 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a232881e-c3d6-42a4-a065-74837a827f4b admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:29.005511 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a232881e-c3d6-42a4-a065-74837a827f4b admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:29.010513 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04940490-60cd-4b66-ab62-ca2ecefca30c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:29.011193 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04940490-60cd-4b66-ab62-ca2ecefca30c admin admin] REQUEST_METHOD: `PUT` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:29.011470 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04940490-60cd-4b66-ab62-ca2ecefca30c admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:29.011744 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04940490-60cd-4b66-ab62-ca2ecefca30c admin admin] PATH_INFO: `/v3/projects/b7a2e5d274ca441cbc4ca1a534552c23/users/ba5d3705f2214d1d93edaa3dd6fa89ef/roles/fdad79ffbcbb4fa380dc9cf7dd108618` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:29.033959 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04940490-60cd-4b66-ab62-ca2ecefca30c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7a2e5d274ca441cbc4ca1a534552c23, user_id=ba5d3705f2214d1d93edaa3dd6fa89ef, role_id=fdad79ffbcbb4fa380dc9cf7dd108618)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:29.037632 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04940490-60cd-4b66-ab62-ca2ecefca30c admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:29.054365 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1160/2305] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 00:26:28 2022] PUT /identity/v3/projects/b7a2e5d274ca441cbc4ca1a534552c23/users/ba5d3705f2214d1d93edaa3dd6fa89ef/roles/fdad79ffbcbb4fa380dc9cf7dd108618 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:26:29.071928 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10c8027-e782-439f-922a-b8e76deac0ab None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:29.072395 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10c8027-e782-439f-922a-b8e76deac0ab None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:29.072780 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10c8027-e782-439f-922a-b8e76deac0ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:29.107041 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-b10c8027-e782-439f-922a-b8e76deac0ab None None] MFA Rules not processed for user `ba5d3705f2214d1d93edaa3dd6fa89ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:26:29.108796 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-b10c8027-e782-439f-922a-b8e76deac0ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:29.207716 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1146/2306] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:26:29 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:26:29.220329 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04940490-60cd-4b66-ab62-ca2ecefca30c admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:29.222470 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-04940490-60cd-4b66-ab62-ca2ecefca30c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:29.295858 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04940490-60cd-4b66-ab62-ca2ecefca30c admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:29.300953 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec36b41e-3952-4d04-af3b-899ab6f40fbf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beecda6e9feb400288618745c784989f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:29.301700 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec36b41e-3952-4d04-af3b-899ab6f40fbf service cinder] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:29.301984 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec36b41e-3952-4d04-af3b-899ab6f40fbf service cinder] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:29.302303 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec36b41e-3952-4d04-af3b-899ab6f40fbf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:29.316887 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec36b41e-3952-4d04-af3b-899ab6f40fbf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:29.318634 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec36b41e-3952-4d04-af3b-899ab6f40fbf service cinder] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:29.331624 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1161/2307] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:26:29 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:26:38.537030 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10c8027-e782-439f-922a-b8e76deac0ab None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:38.619203 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10c8027-e782-439f-922a-b8e76deac0ab None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:38.630776 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27c11fe-7979-4984-8157-a8b108b91f9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:38.630776 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27c11fe-7979-4984-8157-a8b108b91f9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:38.630776 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27c11fe-7979-4984-8157-a8b108b91f9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:38.630776 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27c11fe-7979-4984-8157-a8b108b91f9f admin admin] PATH_INFO: `/v3/users/ba5d3705f2214d1d93edaa3dd6fa89ef` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:38.631560 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27c11fe-7979-4984-8157-a8b108b91f9f admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba5d3705f2214d1d93edaa3dd6fa89ef)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:38.632920 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27c11fe-7979-4984-8157-a8b108b91f9f admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:38.662169 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:26:38.699892 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-f27c11fe-7979-4984-8157-a8b108b91f9f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba5d3705f2214d1d93edaa3dd6fa89ef'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:38.711440 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-f27c11fe-7979-4984-8157-a8b108b91f9f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba5d3705f2214d1d93edaa3dd6fa89ef'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:38.723406 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-f27c11fe-7979-4984-8157-a8b108b91f9f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba5d3705f2214d1d93edaa3dd6fa89ef'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:38.743580 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-f27c11fe-7979-4984-8157-a8b108b91f9f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba5d3705f2214d1d93edaa3dd6fa89ef'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:38.744435 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-f27c11fe-7979-4984-8157-a8b108b91f9f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba5d3705f2214d1d93edaa3dd6fa89ef'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:38.754312 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1147/2308] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 31 00:26:38 2022] DELETE /identity/v3/users/ba5d3705f2214d1d93edaa3dd6fa89ef => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:26:38.759600 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cf0a07-ad1f-411d-8964-bda908373607 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:38.760422 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cf0a07-ad1f-411d-8964-bda908373607 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:38.760715 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cf0a07-ad1f-411d-8964-bda908373607 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:38.789064 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-d9cf0a07-ad1f-411d-8964-bda908373607 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:26:38.791558 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-d9cf0a07-ad1f-411d-8964-bda908373607 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:38.809127 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:26:38.871433 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1162/2309] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:26:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:26:38.882099 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27c11fe-7979-4984-8157-a8b108b91f9f admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:38.883661 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-f27c11fe-7979-4984-8157-a8b108b91f9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:38.948029 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27c11fe-7979-4984-8157-a8b108b91f9f admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:38.952679 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90977f29-7505-448c-a42b-79b27abb13fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'daae792cd11d4c4ca7aae0558998aced', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:38.953306 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90977f29-7505-448c-a42b-79b27abb13fb service neutron] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:38.953587 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90977f29-7505-448c-a42b-79b27abb13fb service neutron] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:38.953856 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90977f29-7505-448c-a42b-79b27abb13fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:38.963835 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90977f29-7505-448c-a42b-79b27abb13fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:38.965338 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90977f29-7505-448c-a42b-79b27abb13fb service neutron] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:38.975712 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1148/2310] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:26:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 00:26:39.319422 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cf0a07-ad1f-411d-8964-bda908373607 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:39.321572 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-d9cf0a07-ad1f-411d-8964-bda908373607 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:39.340436 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cf0a07-ad1f-411d-8964-bda908373607 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:39.347896 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08850117-59a3-4393-874f-272bd306b6b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:39.348699 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08850117-59a3-4393-874f-272bd306b6b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:39.349177 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08850117-59a3-4393-874f-272bd306b6b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:39.349619 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08850117-59a3-4393-874f-272bd306b6b7 admin admin] PATH_INFO: `/v3/projects/b7a2e5d274ca441cbc4ca1a534552c23` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:39.352207 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08850117-59a3-4393-874f-272bd306b6b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7a2e5d274ca441cbc4ca1a534552c23)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:39.355615 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08850117-59a3-4393-874f-272bd306b6b7 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:39.436316 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-08850117-59a3-4393-874f-272bd306b6b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7a2e5d274ca441cbc4ca1a534552c23', 'request_id': 'req-08850117-59a3-4393-874f-272bd306b6b7'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:39.444741 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-08850117-59a3-4393-874f-272bd306b6b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7a2e5d274ca441cbc4ca1a534552c23', 'request_id': 'req-08850117-59a3-4393-874f-272bd306b6b7'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:39.454249 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-08850117-59a3-4393-874f-272bd306b6b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7a2e5d274ca441cbc4ca1a534552c23', 'request_id': 'req-08850117-59a3-4393-874f-272bd306b6b7'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:39.476308 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-08850117-59a3-4393-874f-272bd306b6b7 admin admin] The token cache is being invalidate because project b7a2e5d274ca441cbc4ca1a534552c23 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:26:39.477028 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-08850117-59a3-4393-874f-272bd306b6b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:39.478186 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-08850117-59a3-4393-874f-272bd306b6b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:39.481220 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1163/2311] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 31 00:26:39 2022] DELETE /identity/v3/projects/b7a2e5d274ca441cbc4ca1a534552c23 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:26:39.490670 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dbafc6-33f7-4bcd-88e8-80c6553498a3 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:39.491407 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dbafc6-33f7-4bcd-88e8-80c6553498a3 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:39.492002 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dbafc6-33f7-4bcd-88e8-80c6553498a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:39.521842 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-a0dbafc6-33f7-4bcd-88e8-80c6553498a3 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:26:39.523388 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-a0dbafc6-33f7-4bcd-88e8-80c6553498a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:39.630592 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1149/2312] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:26:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:26:39.632282 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ba261d-9646-4b26-aee0-0284ce3c8c57 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:39.632577 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ba261d-9646-4b26-aee0-0284ce3c8c57 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:39.632856 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ba261d-9646-4b26-aee0-0284ce3c8c57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:39.670304 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-94ba261d-9646-4b26-aee0-0284ce3c8c57 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:26:39.671930 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-94ba261d-9646-4b26-aee0-0284ce3c8c57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:39.681825 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1164/2313] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:26:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:26:39.687591 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dbafc6-33f7-4bcd-88e8-80c6553498a3 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:39.699702 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dbafc6-33f7-4bcd-88e8-80c6553498a3 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:39.706098 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482995d1-3c1a-42d0-850f-af5b29722b95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:39.707091 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482995d1-3c1a-42d0-850f-af5b29722b95 admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:39.707580 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482995d1-3c1a-42d0-850f-af5b29722b95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:39.708655 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482995d1-3c1a-42d0-850f-af5b29722b95 admin admin] PATH_INFO: `/v3/domains` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:39.710125 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482995d1-3c1a-42d0-850f-af5b29722b95 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:26:39.710669 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482995d1-3c1a-42d0-850f-af5b29722b95 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:39.713144 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482995d1-3c1a-42d0-850f-af5b29722b95 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:39.735824 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1150/2314] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 31 00:26:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:26:39.738103 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ba261d-9646-4b26-aee0-0284ce3c8c57 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:39.757470 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ba261d-9646-4b26-aee0-0284ce3c8c57 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:39.768610 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c00c7e-6299-4a43-b206-5f89c6cfbc25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:39.769556 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c00c7e-6299-4a43-b206-5f89c6cfbc25 admin admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:39.769769 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c00c7e-6299-4a43-b206-5f89c6cfbc25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:39.770114 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c00c7e-6299-4a43-b206-5f89c6cfbc25 admin admin] PATH_INFO: `/v3/projects` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:39.770935 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c00c7e-6299-4a43-b206-5f89c6cfbc25 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:39.774068 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c00c7e-6299-4a43-b206-5f89c6cfbc25 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:39.836460 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1165/2315] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 31 00:26:39 2022] POST /identity/v3/projects => generated 405 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:26:39.837779 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482995d1-3c1a-42d0-850f-af5b29722b95 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:39.877477 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482995d1-3c1a-42d0-850f-af5b29722b95 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:39.940421 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:26:40.008331 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07373641-fe02-4a54-a4fb-ce43693bf57f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:40.009082 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07373641-fe02-4a54-a4fb-ce43693bf57f admin admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:40.009436 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07373641-fe02-4a54-a4fb-ce43693bf57f admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:40.009781 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07373641-fe02-4a54-a4fb-ce43693bf57f admin admin] PATH_INFO: `/v3/users` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:40.010528 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07373641-fe02-4a54-a4fb-ce43693bf57f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:40.014367 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07373641-fe02-4a54-a4fb-ce43693bf57f admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:40.022483 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e764f685-d9e7-4617-b122-97ef549c9343 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:40.023627 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e764f685-d9e7-4617-b122-97ef549c9343 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:40.024738 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e764f685-d9e7-4617-b122-97ef549c9343 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:40.049468 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1151/2316] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 31 00:26:39 2022] POST /identity/v3/users => generated 303 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:26:40.056004 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07373641-fe02-4a54-a4fb-ce43693bf57f admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:40.073401 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-e764f685-d9e7-4617-b122-97ef549c9343 None None] MFA Rules not processed for user `410f2e9dc2db4ffcb5ff0f67b0d00ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:26:40.076367 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-e764f685-d9e7-4617-b122-97ef549c9343 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:40.076991 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07373641-fe02-4a54-a4fb-ce43693bf57f admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:40.086221 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee96e0a-4dff-41f6-80d8-89db854f3420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:40.087247 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee96e0a-4dff-41f6-80d8-89db854f3420 admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:40.087725 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee96e0a-4dff-41f6-80d8-89db854f3420 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:40.088246 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee96e0a-4dff-41f6-80d8-89db854f3420 admin admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:40.089446 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee96e0a-4dff-41f6-80d8-89db854f3420 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:40.093633 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee96e0a-4dff-41f6-80d8-89db854f3420 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:40.115972 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1152/2317] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 00:26:40 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:26:40.123727 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee96e0a-4dff-41f6-80d8-89db854f3420 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:40.142807 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee96e0a-4dff-41f6-80d8-89db854f3420 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:40.149488 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f474498f-90c6-4aec-835a-77b9d080744f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:40.150436 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f474498f-90c6-4aec-835a-77b9d080744f admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:40.150646 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f474498f-90c6-4aec-835a-77b9d080744f admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:40.150919 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f474498f-90c6-4aec-835a-77b9d080744f admin admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:40.151686 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f474498f-90c6-4aec-835a-77b9d080744f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:40.154118 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f474498f-90c6-4aec-835a-77b9d080744f admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:40.168709 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1153/2318] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 00:26:40 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 00:26:40.174684 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f474498f-90c6-4aec-835a-77b9d080744f admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:40.179935 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1166/2319] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:26:40 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:26:40.188799 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f474498f-90c6-4aec-835a-77b9d080744f admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:40.195277 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ac7623-6147-4c74-9c34-8783b0445ec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:40.196669 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ac7623-6147-4c74-9c34-8783b0445ec8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:40.197294 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ac7623-6147-4c74-9c34-8783b0445ec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:40.197988 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ac7623-6147-4c74-9c34-8783b0445ec8 admin admin] PATH_INFO: `/v3/projects/dbbf7c1ae02547f084afb8409319d88c/users/3284119b244b40b7a11f6b86ddd89d08/roles/fdad79ffbcbb4fa380dc9cf7dd108618` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:40.222752 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ac7623-6147-4c74-9c34-8783b0445ec8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dbbf7c1ae02547f084afb8409319d88c, user_id=3284119b244b40b7a11f6b86ddd89d08, role_id=fdad79ffbcbb4fa380dc9cf7dd108618)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:40.233126 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ac7623-6147-4c74-9c34-8783b0445ec8 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:40.257529 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1154/2320] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 00:26:40 2022] PUT /identity/v3/projects/dbbf7c1ae02547f084afb8409319d88c/users/3284119b244b40b7a11f6b86ddd89d08/roles/fdad79ffbcbb4fa380dc9cf7dd108618 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:26:40.265887 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e185616-9caa-4047-bc84-01e2da3d35cf None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:40.266499 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e185616-9caa-4047-bc84-01e2da3d35cf None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:40.267064 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e185616-9caa-4047-bc84-01e2da3d35cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:40.302808 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-8e185616-9caa-4047-bc84-01e2da3d35cf None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:26:40.305114 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-8e185616-9caa-4047-bc84-01e2da3d35cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:40.339047 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:26:40.428918 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1167/2321] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:26:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:26:40.441945 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ac7623-6147-4c74-9c34-8783b0445ec8 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:40.443973 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-75ac7623-6147-4c74-9c34-8783b0445ec8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:40.518126 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ac7623-6147-4c74-9c34-8783b0445ec8 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:40.523999 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfec1b5a-e5a4-4753-a020-f8f9184e9b74 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'daae792cd11d4c4ca7aae0558998aced', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:40.525080 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfec1b5a-e5a4-4753-a020-f8f9184e9b74 service neutron] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:40.525566 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfec1b5a-e5a4-4753-a020-f8f9184e9b74 service neutron] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:40.526060 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfec1b5a-e5a4-4753-a020-f8f9184e9b74 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:40.546955 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfec1b5a-e5a4-4753-a020-f8f9184e9b74 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:40.550073 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfec1b5a-e5a4-4753-a020-f8f9184e9b74 service neutron] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:40.564808 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1155/2322] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:26:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 00:26:41.121521 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e185616-9caa-4047-bc84-01e2da3d35cf None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:41.124278 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-8e185616-9caa-4047-bc84-01e2da3d35cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:41.137983 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e185616-9caa-4047-bc84-01e2da3d35cf None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:41.157520 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdf59ff-b2bc-4cdd-b330-c88fd7feb0da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'daae792cd11d4c4ca7aae0558998aced', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:41.158167 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdf59ff-b2bc-4cdd-b330-c88fd7feb0da service neutron] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:41.158526 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdf59ff-b2bc-4cdd-b330-c88fd7feb0da service neutron] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:41.158875 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdf59ff-b2bc-4cdd-b330-c88fd7feb0da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:41.160934 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-ffdf59ff-b2bc-4cdd-b330-c88fd7feb0da service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:41.173761 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdf59ff-b2bc-4cdd-b330-c88fd7feb0da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:41.175955 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdf59ff-b2bc-4cdd-b330-c88fd7feb0da service neutron] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:41.187831 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1168/2323] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:26:41 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 00:26:41.913500 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d54919-75e3-4a70-bd8d-8755285b3a04 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:41.917401 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d54919-75e3-4a70-bd8d-8755285b3a04 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:41.923254 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d54919-75e3-4a70-bd8d-8755285b3a04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:42.018025 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-06d54919-75e3-4a70-bd8d-8755285b3a04 None None] MFA Rules not processed for user `3284119b244b40b7a11f6b86ddd89d08`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:26:42.020193 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-06d54919-75e3-4a70-bd8d-8755285b3a04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:42.151217 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1156/2324] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:26:41 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:26:42.157174 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdf59ff-b2bc-4cdd-b330-c88fd7feb0da service neutron] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:42.174428 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdf59ff-b2bc-4cdd-b330-c88fd7feb0da service neutron] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:42.181727 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb4e1fe-9c18-4779-9ce8-82ab498181c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:42.183310 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb4e1fe-9c18-4779-9ce8-82ab498181c5 admin admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:42.183865 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb4e1fe-9c18-4779-9ce8-82ab498181c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:42.184430 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb4e1fe-9c18-4779-9ce8-82ab498181c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:42.185882 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb4e1fe-9c18-4779-9ce8-82ab498181c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:42.188709 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb4e1fe-9c18-4779-9ce8-82ab498181c5 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:42.236650 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1169/2325] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 31 00:26:42 2022] POST /identity/v3/projects => generated 405 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:26:42.243059 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d54919-75e3-4a70-bd8d-8755285b3a04 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:42.250879 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:26:42.260457 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d54919-75e3-4a70-bd8d-8755285b3a04 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:42.444904 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd78c958-7736-4686-8c00-44c82223992d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:42.445544 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd78c958-7736-4686-8c00-44c82223992d admin admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:42.445825 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd78c958-7736-4686-8c00-44c82223992d admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:42.446254 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd78c958-7736-4686-8c00-44c82223992d admin admin] PATH_INFO: `/v3/users` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:42.446752 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd78c958-7736-4686-8c00-44c82223992d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:42.448987 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd78c958-7736-4686-8c00-44c82223992d admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:42.502343 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1157/2326] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 31 00:26:42 2022] POST /identity/v3/users => generated 309 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:26:42.508599 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb4e1fe-9c18-4779-9ce8-82ab498181c5 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:42.530647 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb4e1fe-9c18-4779-9ce8-82ab498181c5 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:42.538566 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955c777c-5bd2-401c-ad2e-fbbd2dc9c74f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:42.538957 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955c777c-5bd2-401c-ad2e-fbbd2dc9c74f admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:42.539425 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955c777c-5bd2-401c-ad2e-fbbd2dc9c74f admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:42.540352 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955c777c-5bd2-401c-ad2e-fbbd2dc9c74f admin admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:42.541200 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955c777c-5bd2-401c-ad2e-fbbd2dc9c74f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:42.543688 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955c777c-5bd2-401c-ad2e-fbbd2dc9c74f admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:42.558280 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1170/2327] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 00:26:42 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:26:42.564596 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd78c958-7736-4686-8c00-44c82223992d admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:42.580567 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd78c958-7736-4686-8c00-44c82223992d admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:42.595887 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b9a757-9453-4e5b-accc-f179f17e8c35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:42.597642 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b9a757-9453-4e5b-accc-f179f17e8c35 admin admin] REQUEST_METHOD: `PUT` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:42.604088 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b9a757-9453-4e5b-accc-f179f17e8c35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:42.604629 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b9a757-9453-4e5b-accc-f179f17e8c35 admin admin] PATH_INFO: `/v3/projects/8006634323b4495ba0b94e33444894a2/users/c31ee277dd8544fba324c89b349b2501/roles/12f6817f9aaa4e2bb477095a6bed5d0f` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:42.631483 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b9a757-9453-4e5b-accc-f179f17e8c35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8006634323b4495ba0b94e33444894a2, user_id=c31ee277dd8544fba324c89b349b2501, role_id=12f6817f9aaa4e2bb477095a6bed5d0f)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:42.635613 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b9a757-9453-4e5b-accc-f179f17e8c35 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:42.661622 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1158/2328] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 00:26:42 2022] PUT /identity/v3/projects/8006634323b4495ba0b94e33444894a2/users/c31ee277dd8544fba324c89b349b2501/roles/12f6817f9aaa4e2bb477095a6bed5d0f => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:26:42.667519 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955c777c-5bd2-401c-ad2e-fbbd2dc9c74f admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:42.693768 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955c777c-5bd2-401c-ad2e-fbbd2dc9c74f admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:42.800700 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f582482-599c-491d-ab5a-5c55014b47e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:42.801398 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f582482-599c-491d-ab5a-5c55014b47e5 admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:42.801842 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f582482-599c-491d-ab5a-5c55014b47e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:42.802116 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f582482-599c-491d-ab5a-5c55014b47e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:42.803144 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f582482-599c-491d-ab5a-5c55014b47e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:42.805111 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f582482-599c-491d-ab5a-5c55014b47e5 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:42.823957 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1171/2329] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 00:26:42 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:26:42.828272 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b9a757-9453-4e5b-accc-f179f17e8c35 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:42.853692 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b9a757-9453-4e5b-accc-f179f17e8c35 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:42.863098 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da62955-2fc7-4662-ab8d-86ff916eb904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:42.864295 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da62955-2fc7-4662-ab8d-86ff916eb904 admin admin] REQUEST_METHOD: `PUT` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:42.864783 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da62955-2fc7-4662-ab8d-86ff916eb904 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:42.865292 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da62955-2fc7-4662-ab8d-86ff916eb904 admin admin] PATH_INFO: `/v3/projects/8006634323b4495ba0b94e33444894a2/users/c31ee277dd8544fba324c89b349b2501/roles/12f6817f9aaa4e2bb477095a6bed5d0f` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:42.868833 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da62955-2fc7-4662-ab8d-86ff916eb904 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8006634323b4495ba0b94e33444894a2, user_id=c31ee277dd8544fba324c89b349b2501, role_id=12f6817f9aaa4e2bb477095a6bed5d0f)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:42.874652 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da62955-2fc7-4662-ab8d-86ff916eb904 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:42.908033 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1159/2330] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 00:26:42 2022] PUT /identity/v3/projects/8006634323b4495ba0b94e33444894a2/users/c31ee277dd8544fba324c89b349b2501/roles/12f6817f9aaa4e2bb477095a6bed5d0f => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:26:44.222745 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6387f51-493b-42a5-8ced-2c342777338a None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:44.224284 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6387f51-493b-42a5-8ced-2c342777338a None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:44.225400 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6387f51-493b-42a5-8ced-2c342777338a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:44.306917 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-d6387f51-493b-42a5-8ced-2c342777338a None None] MFA Rules not processed for user `c31ee277dd8544fba324c89b349b2501`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:26:44.308707 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-d6387f51-493b-42a5-8ced-2c342777338a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:44.399391 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:26:44.492871 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1172/2331] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:26:44 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:26:45.568321 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da62955-2fc7-4662-ab8d-86ff916eb904 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:45.571054 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-5da62955-2fc7-4662-ab8d-86ff916eb904 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:45.692290 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da62955-2fc7-4662-ab8d-86ff916eb904 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:45.707111 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2194ef-bf02-43ab-b2e6-c54c02adb480 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f76e01e32264ff7a6a7740ffa0a207d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:45.707814 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2194ef-bf02-43ab-b2e6-c54c02adb480 service placement] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:45.708095 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2194ef-bf02-43ab-b2e6-c54c02adb480 service placement] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:45.708642 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2194ef-bf02-43ab-b2e6-c54c02adb480 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:45.712465 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-ef2194ef-bf02-43ab-b2e6-c54c02adb480 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:45.747355 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2194ef-bf02-43ab-b2e6-c54c02adb480 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:45.751606 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2194ef-bf02-43ab-b2e6-c54c02adb480 service placement] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:45.773949 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1160/2332] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:26:45 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:26:46.650473 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6387f51-493b-42a5-8ced-2c342777338a None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:46.787334 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6387f51-493b-42a5-8ced-2c342777338a None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:46.800034 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68e437b-59e3-4c96-bade-25564e10e8c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:46.801219 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68e437b-59e3-4c96-bade-25564e10e8c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:46.801694 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68e437b-59e3-4c96-bade-25564e10e8c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:46.802161 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68e437b-59e3-4c96-bade-25564e10e8c6 admin admin] PATH_INFO: `/v3/users/3284119b244b40b7a11f6b86ddd89d08` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:46.805021 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68e437b-59e3-4c96-bade-25564e10e8c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3284119b244b40b7a11f6b86ddd89d08)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:46.808781 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68e437b-59e3-4c96-bade-25564e10e8c6 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:46.877506 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-c68e437b-59e3-4c96-bade-25564e10e8c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3284119b244b40b7a11f6b86ddd89d08'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:46.885773 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-c68e437b-59e3-4c96-bade-25564e10e8c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3284119b244b40b7a11f6b86ddd89d08'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:46.895786 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-c68e437b-59e3-4c96-bade-25564e10e8c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3284119b244b40b7a11f6b86ddd89d08'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:46.896486 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-c68e437b-59e3-4c96-bade-25564e10e8c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3284119b244b40b7a11f6b86ddd89d08'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:46.913026 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-c68e437b-59e3-4c96-bade-25564e10e8c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3284119b244b40b7a11f6b86ddd89d08'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:46.920619 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1173/2333] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 31 00:26:46 2022] DELETE /identity/v3/users/3284119b244b40b7a11f6b86ddd89d08 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:26:47.246435 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2194ef-bf02-43ab-b2e6-c54c02adb480 service placement] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:47.275701 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2194ef-bf02-43ab-b2e6-c54c02adb480 service placement] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:47.389016 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:26:47.416074 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae87ce94-746d-4713-8446-27550c86188c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:47.416566 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae87ce94-746d-4713-8446-27550c86188c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:47.417043 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae87ce94-746d-4713-8446-27550c86188c admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:47.417442 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae87ce94-746d-4713-8446-27550c86188c admin admin] PATH_INFO: `/v3/projects/dbbf7c1ae02547f084afb8409319d88c` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:47.418945 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae87ce94-746d-4713-8446-27550c86188c admin admin] RBAC: Authorizing `identity:delete_project(project_id=dbbf7c1ae02547f084afb8409319d88c)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:47.421934 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae87ce94-746d-4713-8446-27550c86188c admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:47.525250 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-ae87ce94-746d-4713-8446-27550c86188c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dbbf7c1ae02547f084afb8409319d88c', 'request_id': 'req-ae87ce94-746d-4713-8446-27550c86188c'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:47.540799 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-ae87ce94-746d-4713-8446-27550c86188c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dbbf7c1ae02547f084afb8409319d88c', 'request_id': 'req-ae87ce94-746d-4713-8446-27550c86188c'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:47.553222 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-ae87ce94-746d-4713-8446-27550c86188c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dbbf7c1ae02547f084afb8409319d88c', 'request_id': 'req-ae87ce94-746d-4713-8446-27550c86188c'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:47.579091 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-ae87ce94-746d-4713-8446-27550c86188c admin admin] The token cache is being invalidate because project dbbf7c1ae02547f084afb8409319d88c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81523) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:26:47.579748 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-ae87ce94-746d-4713-8446-27550c86188c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:47.581296 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-ae87ce94-746d-4713-8446-27550c86188c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:47.583146 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1161/2334] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 31 00:26:47 2022] DELETE /identity/v3/projects/dbbf7c1ae02547f084afb8409319d88c => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:26:47.588931 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68e437b-59e3-4c96-bade-25564e10e8c6 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:47.590866 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-c68e437b-59e3-4c96-bade-25564e10e8c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:47.613945 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68e437b-59e3-4c96-bade-25564e10e8c6 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:47.715925 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0beec5e9-f0ad-4b91-b575-eedc6260cbc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:47.717585 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beec5e9-f0ad-4b91-b575-eedc6260cbc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:47.718102 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beec5e9-f0ad-4b91-b575-eedc6260cbc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:47.718606 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beec5e9-f0ad-4b91-b575-eedc6260cbc7 admin admin] PATH_INFO: `/v3/users/c31ee277dd8544fba324c89b349b2501` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:47.720881 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0beec5e9-f0ad-4b91-b575-eedc6260cbc7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c31ee277dd8544fba324c89b349b2501)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:47.724878 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0beec5e9-f0ad-4b91-b575-eedc6260cbc7 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:47.753825 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:26:47.825323 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-0beec5e9-f0ad-4b91-b575-eedc6260cbc7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c31ee277dd8544fba324c89b349b2501'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:47.837933 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-0beec5e9-f0ad-4b91-b575-eedc6260cbc7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c31ee277dd8544fba324c89b349b2501'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:47.853197 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-0beec5e9-f0ad-4b91-b575-eedc6260cbc7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c31ee277dd8544fba324c89b349b2501'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:47.854736 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-0beec5e9-f0ad-4b91-b575-eedc6260cbc7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c31ee277dd8544fba324c89b349b2501'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:47.887269 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-0beec5e9-f0ad-4b91-b575-eedc6260cbc7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c31ee277dd8544fba324c89b349b2501'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:47.902976 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1174/2335] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 31 00:26:47 2022] DELETE /identity/v3/users/c31ee277dd8544fba324c89b349b2501 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:26:48.199555 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae87ce94-746d-4713-8446-27550c86188c admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:48.203230 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-ae87ce94-746d-4713-8446-27550c86188c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:48.240288 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae87ce94-746d-4713-8446-27550c86188c admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:48.360976 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac58fa8-484e-4e61-b752-de5f238ac9ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:48.362097 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac58fa8-484e-4e61-b752-de5f238ac9ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:48.362565 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac58fa8-484e-4e61-b752-de5f238ac9ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:48.363045 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac58fa8-484e-4e61-b752-de5f238ac9ee admin admin] PATH_INFO: `/v3/projects/8006634323b4495ba0b94e33444894a2` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:48.365328 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac58fa8-484e-4e61-b752-de5f238ac9ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=8006634323b4495ba0b94e33444894a2)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:48.370003 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac58fa8-484e-4e61-b752-de5f238ac9ee admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:48.457522 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-0ac58fa8-484e-4e61-b752-de5f238ac9ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8006634323b4495ba0b94e33444894a2', 'request_id': 'req-0ac58fa8-484e-4e61-b752-de5f238ac9ee'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:48.466256 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-0ac58fa8-484e-4e61-b752-de5f238ac9ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8006634323b4495ba0b94e33444894a2', 'request_id': 'req-0ac58fa8-484e-4e61-b752-de5f238ac9ee'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:48.475683 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-0ac58fa8-484e-4e61-b752-de5f238ac9ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8006634323b4495ba0b94e33444894a2', 'request_id': 'req-0ac58fa8-484e-4e61-b752-de5f238ac9ee'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:48.497219 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-0ac58fa8-484e-4e61-b752-de5f238ac9ee admin admin] The token cache is being invalidate because project 8006634323b4495ba0b94e33444894a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81523) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:26:48.497690 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-0ac58fa8-484e-4e61-b752-de5f238ac9ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:48.499370 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-0ac58fa8-484e-4e61-b752-de5f238ac9ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:48.505235 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1162/2336] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 31 00:26:48 2022] DELETE /identity/v3/projects/8006634323b4495ba0b94e33444894a2 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:26:48.507651 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32eb2b9-e075-4bbe-8c5e-891a5ec46adb None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:48.508202 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32eb2b9-e075-4bbe-8c5e-891a5ec46adb None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:48.509163 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32eb2b9-e075-4bbe-8c5e-891a5ec46adb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:48.541827 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501a0077-42b1-4d98-9ad5-04dbf1270a2d None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:48.542130 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501a0077-42b1-4d98-9ad5-04dbf1270a2d None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:48.542580 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501a0077-42b1-4d98-9ad5-04dbf1270a2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:48.553325 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:26:48.570239 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-501a0077-42b1-4d98-9ad5-04dbf1270a2d None None] MFA Rules not processed for user `b3da9d7af0fd4c1d99973e6b277b16d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:26:48.572933 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-501a0077-42b1-4d98-9ad5-04dbf1270a2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:48.657265 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1163/2337] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:26:48 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:26:48.677043 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-f32eb2b9-e075-4bbe-8c5e-891a5ec46adb None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:26:48.678288 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-f32eb2b9-e075-4bbe-8c5e-891a5ec46adb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:48.763454 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1175/2338] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:26:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:26:48.776315 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe3cc24-2393-4890-9053-6e59a6aa4732 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:48.776732 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe3cc24-2393-4890-9053-6e59a6aa4732 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:48.777101 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe3cc24-2393-4890-9053-6e59a6aa4732 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:48.802632 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-afe3cc24-2393-4890-9053-6e59a6aa4732 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:26:48.803929 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-afe3cc24-2393-4890-9053-6e59a6aa4732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:48.813088 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1164/2339] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:26:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:26:48.818356 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32eb2b9-e075-4bbe-8c5e-891a5ec46adb None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:48.836963 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32eb2b9-e075-4bbe-8c5e-891a5ec46adb None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:48.847486 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15b26b4-b495-4c8a-9891-47960d316a8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:48.849157 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15b26b4-b495-4c8a-9891-47960d316a8b admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:48.849984 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15b26b4-b495-4c8a-9891-47960d316a8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:48.851098 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15b26b4-b495-4c8a-9891-47960d316a8b admin admin] PATH_INFO: `/v3/domains` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:48.853316 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15b26b4-b495-4c8a-9891-47960d316a8b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:26:48.854255 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15b26b4-b495-4c8a-9891-47960d316a8b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:48.857788 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15b26b4-b495-4c8a-9891-47960d316a8b admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:48.884203 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1176/2340] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 31 00:26:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:26:48.886155 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe3cc24-2393-4890-9053-6e59a6aa4732 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:48.896784 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe3cc24-2393-4890-9053-6e59a6aa4732 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:48.902133 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0fcf99-b7c1-424f-9310-981c74e54dfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:48.902814 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0fcf99-b7c1-424f-9310-981c74e54dfe admin admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:48.903097 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0fcf99-b7c1-424f-9310-981c74e54dfe admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:48.903370 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0fcf99-b7c1-424f-9310-981c74e54dfe admin admin] PATH_INFO: `/v3/projects` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:48.904854 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0fcf99-b7c1-424f-9310-981c74e54dfe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:48.906829 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0fcf99-b7c1-424f-9310-981c74e54dfe admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:48.940058 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1165/2341] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 31 00:26:48 2022] POST /identity/v3/projects => generated 371 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:26:48.945586 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15b26b4-b495-4c8a-9891-47960d316a8b admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:48.959168 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15b26b4-b495-4c8a-9891-47960d316a8b admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:49.041736 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dece50-b775-46bb-8f0d-a2e4c641fc43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:49.042354 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dece50-b775-46bb-8f0d-a2e4c641fc43 admin admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:49.042723 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dece50-b775-46bb-8f0d-a2e4c641fc43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:49.043079 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dece50-b775-46bb-8f0d-a2e4c641fc43 admin admin] PATH_INFO: `/v3/users` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:49.043896 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dece50-b775-46bb-8f0d-a2e4c641fc43 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:49.047850 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dece50-b775-46bb-8f0d-a2e4c641fc43 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:49.077683 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1177/2342] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 31 00:26:48 2022] POST /identity/v3/users => generated 286 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:26:49.082031 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0fcf99-b7c1-424f-9310-981c74e54dfe admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:49.102668 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0fcf99-b7c1-424f-9310-981c74e54dfe admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:49.108422 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d704bd16-519c-4e76-9773-868d7bda1797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:49.109063 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d704bd16-519c-4e76-9773-868d7bda1797 admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:49.109355 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d704bd16-519c-4e76-9773-868d7bda1797 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:49.109618 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d704bd16-519c-4e76-9773-868d7bda1797 admin admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:49.110280 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d704bd16-519c-4e76-9773-868d7bda1797 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:49.111955 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d704bd16-519c-4e76-9773-868d7bda1797 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:49.128571 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1166/2343] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 00:26:49 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:26:49.130729 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dece50-b775-46bb-8f0d-a2e4c641fc43 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:49.149411 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dece50-b775-46bb-8f0d-a2e4c641fc43 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:49.156377 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af064bbb-0017-4bc8-92c3-661d713bc02e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:49.157161 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af064bbb-0017-4bc8-92c3-661d713bc02e admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:49.157506 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af064bbb-0017-4bc8-92c3-661d713bc02e admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:49.157980 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af064bbb-0017-4bc8-92c3-661d713bc02e admin admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:49.158780 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af064bbb-0017-4bc8-92c3-661d713bc02e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:49.161461 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af064bbb-0017-4bc8-92c3-661d713bc02e admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:49.163716 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:26:49.181984 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1178/2344] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 00:26:49 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:26:49.187807 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d704bd16-519c-4e76-9773-868d7bda1797 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:49.201476 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d704bd16-519c-4e76-9773-868d7bda1797 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:49.209765 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b225d9-723b-4362-94eb-68d20c8c3d51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:49.211292 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b225d9-723b-4362-94eb-68d20c8c3d51 admin admin] REQUEST_METHOD: `PUT` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:49.211841 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b225d9-723b-4362-94eb-68d20c8c3d51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:49.212325 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b225d9-723b-4362-94eb-68d20c8c3d51 admin admin] PATH_INFO: `/v3/projects/fecb0342147d4bfeba3a263b1bc5afb0/users/7e58c27b6d134c5486a4d26376ae7c25/roles/fdad79ffbcbb4fa380dc9cf7dd108618` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:49.234675 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b225d9-723b-4362-94eb-68d20c8c3d51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fecb0342147d4bfeba3a263b1bc5afb0, user_id=7e58c27b6d134c5486a4d26376ae7c25, role_id=fdad79ffbcbb4fa380dc9cf7dd108618)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:49.237736 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b225d9-723b-4362-94eb-68d20c8c3d51 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:49.256812 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1167/2345] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 00:26:49 2022] PUT /identity/v3/projects/fecb0342147d4bfeba3a263b1bc5afb0/users/7e58c27b6d134c5486a4d26376ae7c25/roles/fdad79ffbcbb4fa380dc9cf7dd108618 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:26:49.267357 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1eba2b-d625-4af4-97c0-dfa52640045f None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:49.267641 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1eba2b-d625-4af4-97c0-dfa52640045f None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:49.268578 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1eba2b-d625-4af4-97c0-dfa52640045f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:49.304769 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-3f1eba2b-d625-4af4-97c0-dfa52640045f None None] MFA Rules not processed for user `7e58c27b6d134c5486a4d26376ae7c25`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:26:49.307355 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-3f1eba2b-d625-4af4-97c0-dfa52640045f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:49.417383 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1179/2346] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:26:49 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:26:49.426308 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b225d9-723b-4362-94eb-68d20c8c3d51 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:49.548973 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b225d9-723b-4362-94eb-68d20c8c3d51 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:49.554180 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92773b7-0efa-4f21-96fc-9937101b693c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:49.554748 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92773b7-0efa-4f21-96fc-9937101b693c admin admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:49.555032 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92773b7-0efa-4f21-96fc-9937101b693c admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:49.555307 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92773b7-0efa-4f21-96fc-9937101b693c admin admin] PATH_INFO: `/v3/projects` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:49.555981 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92773b7-0efa-4f21-96fc-9937101b693c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:49.558032 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92773b7-0efa-4f21-96fc-9937101b693c admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:49.590355 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1168/2347] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 31 00:26:49 2022] POST /identity/v3/projects => generated 371 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:26:49.596036 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1eba2b-d625-4af4-97c0-dfa52640045f None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:49.609307 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1eba2b-d625-4af4-97c0-dfa52640045f None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:49.687616 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bc26e3-6e81-46e2-8f6c-0eb612619689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:49.688507 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bc26e3-6e81-46e2-8f6c-0eb612619689 admin admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:49.688896 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bc26e3-6e81-46e2-8f6c-0eb612619689 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:49.689290 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bc26e3-6e81-46e2-8f6c-0eb612619689 admin admin] PATH_INFO: `/v3/users` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:49.690034 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bc26e3-6e81-46e2-8f6c-0eb612619689 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:49.692541 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bc26e3-6e81-46e2-8f6c-0eb612619689 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:49.717283 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1180/2348] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 31 00:26:49 2022] POST /identity/v3/users => generated 292 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:26:49.722034 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92773b7-0efa-4f21-96fc-9937101b693c admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:49.734228 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92773b7-0efa-4f21-96fc-9937101b693c admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:49.740352 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8091339-937c-47d5-a2ee-581e9880bb0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:49.742263 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8091339-937c-47d5-a2ee-581e9880bb0c admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:49.742697 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8091339-937c-47d5-a2ee-581e9880bb0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:49.743184 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8091339-937c-47d5-a2ee-581e9880bb0c admin admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:49.744442 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8091339-937c-47d5-a2ee-581e9880bb0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:49.746380 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8091339-937c-47d5-a2ee-581e9880bb0c admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:49.761702 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1169/2349] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 00:26:49 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:26:49.767208 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bc26e3-6e81-46e2-8f6c-0eb612619689 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:49.781528 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bc26e3-6e81-46e2-8f6c-0eb612619689 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:49.787436 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb96f509-7dc9-43ab-89ae-02957f523149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:49.788353 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb96f509-7dc9-43ab-89ae-02957f523149 admin admin] REQUEST_METHOD: `PUT` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:49.788954 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb96f509-7dc9-43ab-89ae-02957f523149 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:49.789379 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb96f509-7dc9-43ab-89ae-02957f523149 admin admin] PATH_INFO: `/v3/projects/bc49251b8aed47c78b132e88026f40d9/users/f89e4452b6544149837ee7db6a6fae70/roles/12f6817f9aaa4e2bb477095a6bed5d0f` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:49.811144 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb96f509-7dc9-43ab-89ae-02957f523149 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc49251b8aed47c78b132e88026f40d9, user_id=f89e4452b6544149837ee7db6a6fae70, role_id=12f6817f9aaa4e2bb477095a6bed5d0f)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:49.813930 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb96f509-7dc9-43ab-89ae-02957f523149 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:49.834642 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1181/2350] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 00:26:49 2022] PUT /identity/v3/projects/bc49251b8aed47c78b132e88026f40d9/users/f89e4452b6544149837ee7db6a6fae70/roles/12f6817f9aaa4e2bb477095a6bed5d0f => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:26:49.839115 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8091339-937c-47d5-a2ee-581e9880bb0c admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:49.850947 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8091339-937c-47d5-a2ee-581e9880bb0c admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:49.875085 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:26:49.970356 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1691ac53-7adb-46b8-bada-8afd84b9524f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:49.972386 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1691ac53-7adb-46b8-bada-8afd84b9524f admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:49.972721 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1691ac53-7adb-46b8-bada-8afd84b9524f admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:49.972999 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1691ac53-7adb-46b8-bada-8afd84b9524f admin admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:49.973720 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1691ac53-7adb-46b8-bada-8afd84b9524f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:49.975401 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1691ac53-7adb-46b8-bada-8afd84b9524f admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:49.992785 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1170/2351] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 00:26:49 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:26:49.998223 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb96f509-7dc9-43ab-89ae-02957f523149 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:50.010492 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb96f509-7dc9-43ab-89ae-02957f523149 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:50.017146 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72957f1e-43ec-4397-9ca1-5decec014598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:50.017831 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72957f1e-43ec-4397-9ca1-5decec014598 admin admin] REQUEST_METHOD: `PUT` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:50.018103 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72957f1e-43ec-4397-9ca1-5decec014598 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:50.018382 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72957f1e-43ec-4397-9ca1-5decec014598 admin admin] PATH_INFO: `/v3/projects/bc49251b8aed47c78b132e88026f40d9/users/f89e4452b6544149837ee7db6a6fae70/roles/12f6817f9aaa4e2bb477095a6bed5d0f` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:50.020524 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72957f1e-43ec-4397-9ca1-5decec014598 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc49251b8aed47c78b132e88026f40d9, user_id=f89e4452b6544149837ee7db6a6fae70, role_id=12f6817f9aaa4e2bb477095a6bed5d0f)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:50.023511 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72957f1e-43ec-4397-9ca1-5decec014598 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:50.037118 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1182/2352] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 00:26:49 2022] PUT /identity/v3/projects/bc49251b8aed47c78b132e88026f40d9/users/f89e4452b6544149837ee7db6a6fae70/roles/12f6817f9aaa4e2bb477095a6bed5d0f => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:26:50.049412 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a953aa86-0d93-452f-a8d8-24bac07fdca5 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:50.049845 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a953aa86-0d93-452f-a8d8-24bac07fdca5 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:50.050035 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a953aa86-0d93-452f-a8d8-24bac07fdca5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:50.084291 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-a953aa86-0d93-452f-a8d8-24bac07fdca5 None None] MFA Rules not processed for user `f89e4452b6544149837ee7db6a6fae70`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:26:50.085451 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-a953aa86-0d93-452f-a8d8-24bac07fdca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:50.219777 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1171/2353] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:26:50 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:26:50.233702 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72957f1e-43ec-4397-9ca1-5decec014598 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:50.235814 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-72957f1e-43ec-4397-9ca1-5decec014598 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:50.336893 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:26:50.389589 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72957f1e-43ec-4397-9ca1-5decec014598 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:50.395287 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2012b7e-231d-4123-b86f-a0e7906d609f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beecda6e9feb400288618745c784989f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:50.396408 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2012b7e-231d-4123-b86f-a0e7906d609f service cinder] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:50.397063 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2012b7e-231d-4123-b86f-a0e7906d609f service cinder] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:50.397821 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2012b7e-231d-4123-b86f-a0e7906d609f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:50.421065 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2012b7e-231d-4123-b86f-a0e7906d609f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:50.428951 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2012b7e-231d-4123-b86f-a0e7906d609f service cinder] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:50.466833 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1183/2354] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:26:50 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:26:51.205281 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a953aa86-0d93-452f-a8d8-24bac07fdca5 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:51.347746 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a953aa86-0d93-452f-a8d8-24bac07fdca5 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:51.360487 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e74d54-db15-4fb9-a6ff-ee7a8da4c07a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:51.361833 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e74d54-db15-4fb9-a6ff-ee7a8da4c07a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:51.362040 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e74d54-db15-4fb9-a6ff-ee7a8da4c07a admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:51.362528 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e74d54-db15-4fb9-a6ff-ee7a8da4c07a admin admin] PATH_INFO: `/v3/users/7e58c27b6d134c5486a4d26376ae7c25` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:51.364692 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e74d54-db15-4fb9-a6ff-ee7a8da4c07a admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e58c27b6d134c5486a4d26376ae7c25)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:51.369338 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e74d54-db15-4fb9-a6ff-ee7a8da4c07a admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:51.465320 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:26:51.474977 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-d0e74d54-db15-4fb9-a6ff-ee7a8da4c07a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e58c27b6d134c5486a4d26376ae7c25'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:51.490093 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-d0e74d54-db15-4fb9-a6ff-ee7a8da4c07a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e58c27b6d134c5486a4d26376ae7c25'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:51.504235 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-d0e74d54-db15-4fb9-a6ff-ee7a8da4c07a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e58c27b6d134c5486a4d26376ae7c25'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:51.528344 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-d0e74d54-db15-4fb9-a6ff-ee7a8da4c07a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e58c27b6d134c5486a4d26376ae7c25'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:51.530263 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-d0e74d54-db15-4fb9-a6ff-ee7a8da4c07a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e58c27b6d134c5486a4d26376ae7c25'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:51.546552 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1172/2355] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 31 00:26:51 2022] DELETE /identity/v3/users/7e58c27b6d134c5486a4d26376ae7c25 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:26:51.553099 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33874949-b560-418e-8fe9-e8790cb6f0f1 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:51.553954 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33874949-b560-418e-8fe9-e8790cb6f0f1 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:51.554450 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33874949-b560-418e-8fe9-e8790cb6f0f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:51.589351 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-33874949-b560-418e-8fe9-e8790cb6f0f1 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:26:51.592081 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-33874949-b560-418e-8fe9-e8790cb6f0f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:51.686719 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1184/2356] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:26:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:26:51.701966 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e74d54-db15-4fb9-a6ff-ee7a8da4c07a admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:51.704145 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-d0e74d54-db15-4fb9-a6ff-ee7a8da4c07a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:51.798517 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e74d54-db15-4fb9-a6ff-ee7a8da4c07a admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:51.802582 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea8c037-c136-4b52-a2dd-ec9d16e41c5c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'daae792cd11d4c4ca7aae0558998aced', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:51.803269 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea8c037-c136-4b52-a2dd-ec9d16e41c5c service neutron] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:51.803587 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea8c037-c136-4b52-a2dd-ec9d16e41c5c service neutron] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:51.803898 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea8c037-c136-4b52-a2dd-ec9d16e41c5c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:51.817363 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea8c037-c136-4b52-a2dd-ec9d16e41c5c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:51.819012 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea8c037-c136-4b52-a2dd-ec9d16e41c5c service neutron] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:51.835909 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1173/2357] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:26:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:26:53.180778 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33874949-b560-418e-8fe9-e8790cb6f0f1 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:53.183175 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-33874949-b560-418e-8fe9-e8790cb6f0f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:53.206692 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33874949-b560-418e-8fe9-e8790cb6f0f1 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:53.215281 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d712dc9-28e6-46fb-8714-86f94c7b6f4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:53.217090 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d712dc9-28e6-46fb-8714-86f94c7b6f4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:53.218177 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d712dc9-28e6-46fb-8714-86f94c7b6f4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:53.219084 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d712dc9-28e6-46fb-8714-86f94c7b6f4f admin admin] PATH_INFO: `/v3/projects/fecb0342147d4bfeba3a263b1bc5afb0` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:53.221584 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d712dc9-28e6-46fb-8714-86f94c7b6f4f admin admin] RBAC: Authorizing `identity:delete_project(project_id=fecb0342147d4bfeba3a263b1bc5afb0)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:53.226271 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d712dc9-28e6-46fb-8714-86f94c7b6f4f admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:53.325304 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-8d712dc9-28e6-46fb-8714-86f94c7b6f4f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fecb0342147d4bfeba3a263b1bc5afb0', 'request_id': 'req-8d712dc9-28e6-46fb-8714-86f94c7b6f4f'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:53.338314 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-8d712dc9-28e6-46fb-8714-86f94c7b6f4f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fecb0342147d4bfeba3a263b1bc5afb0', 'request_id': 'req-8d712dc9-28e6-46fb-8714-86f94c7b6f4f'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:53.348941 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-8d712dc9-28e6-46fb-8714-86f94c7b6f4f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fecb0342147d4bfeba3a263b1bc5afb0', 'request_id': 'req-8d712dc9-28e6-46fb-8714-86f94c7b6f4f'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:53.367348 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-8d712dc9-28e6-46fb-8714-86f94c7b6f4f admin admin] The token cache is being invalidate because project fecb0342147d4bfeba3a263b1bc5afb0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:26:53.367904 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-8d712dc9-28e6-46fb-8714-86f94c7b6f4f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:53.368981 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-8d712dc9-28e6-46fb-8714-86f94c7b6f4f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:53.376575 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1185/2358] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 31 00:26:53 2022] DELETE /identity/v3/projects/fecb0342147d4bfeba3a263b1bc5afb0 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:26:53.378700 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea8c037-c136-4b52-a2dd-ec9d16e41c5c service neutron] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:53.398931 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea8c037-c136-4b52-a2dd-ec9d16e41c5c service neutron] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:53.519557 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfb580a-ef61-4954-a16b-93121685b857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:53.520624 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfb580a-ef61-4954-a16b-93121685b857 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:53.521238 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfb580a-ef61-4954-a16b-93121685b857 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:53.521918 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfb580a-ef61-4954-a16b-93121685b857 admin admin] PATH_INFO: `/v3/users/f89e4452b6544149837ee7db6a6fae70` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:53.524881 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfb580a-ef61-4954-a16b-93121685b857 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f89e4452b6544149837ee7db6a6fae70)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:53.526531 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfb580a-ef61-4954-a16b-93121685b857 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:53.624360 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-8bfb580a-ef61-4954-a16b-93121685b857 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f89e4452b6544149837ee7db6a6fae70'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:53.636779 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-8bfb580a-ef61-4954-a16b-93121685b857 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f89e4452b6544149837ee7db6a6fae70'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:53.649030 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-8bfb580a-ef61-4954-a16b-93121685b857 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f89e4452b6544149837ee7db6a6fae70'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:53.653626 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:26:53.677395 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-8bfb580a-ef61-4954-a16b-93121685b857 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f89e4452b6544149837ee7db6a6fae70'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:53.678782 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-8bfb580a-ef61-4954-a16b-93121685b857 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f89e4452b6544149837ee7db6a6fae70'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:53.696333 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1174/2359] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 31 00:26:53 2022] DELETE /identity/v3/users/f89e4452b6544149837ee7db6a6fae70 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:26:54.636280 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d712dc9-28e6-46fb-8714-86f94c7b6f4f admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:54.638114 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-8d712dc9-28e6-46fb-8714-86f94c7b6f4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:54.656144 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d712dc9-28e6-46fb-8714-86f94c7b6f4f admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:54.779059 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01505459-7864-4288-9f97-274cc0cae3fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:54.780747 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01505459-7864-4288-9f97-274cc0cae3fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:54.781245 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01505459-7864-4288-9f97-274cc0cae3fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:54.781705 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01505459-7864-4288-9f97-274cc0cae3fa admin admin] PATH_INFO: `/v3/projects/bc49251b8aed47c78b132e88026f40d9` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:54.783954 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01505459-7864-4288-9f97-274cc0cae3fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc49251b8aed47c78b132e88026f40d9)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:54.786874 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01505459-7864-4288-9f97-274cc0cae3fa admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:54.798906 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:26:54.865819 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-01505459-7864-4288-9f97-274cc0cae3fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc49251b8aed47c78b132e88026f40d9', 'request_id': 'req-01505459-7864-4288-9f97-274cc0cae3fa'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:54.874964 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-01505459-7864-4288-9f97-274cc0cae3fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc49251b8aed47c78b132e88026f40d9', 'request_id': 'req-01505459-7864-4288-9f97-274cc0cae3fa'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:54.882877 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-01505459-7864-4288-9f97-274cc0cae3fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc49251b8aed47c78b132e88026f40d9', 'request_id': 'req-01505459-7864-4288-9f97-274cc0cae3fa'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:54.904371 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-01505459-7864-4288-9f97-274cc0cae3fa admin admin] The token cache is being invalidate because project bc49251b8aed47c78b132e88026f40d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:26:54.904652 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-01505459-7864-4288-9f97-274cc0cae3fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:54.905736 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-01505459-7864-4288-9f97-274cc0cae3fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:26:54.907568 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1186/2360] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 31 00:26:54 2022] DELETE /identity/v3/projects/bc49251b8aed47c78b132e88026f40d9 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:26:54.914106 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0b429e-8a57-474a-a217-31db79ed0d9d None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:54.914788 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0b429e-8a57-474a-a217-31db79ed0d9d None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:54.915124 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0b429e-8a57-474a-a217-31db79ed0d9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:54.953330 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-5e0b429e-8a57-474a-a217-31db79ed0d9d None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:26:54.955513 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-5e0b429e-8a57-474a-a217-31db79ed0d9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:55.066164 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1175/2361] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:26:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:26:55.078269 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fcfc2f-634e-4ef7-b425-ec2c734ce883 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:55.079548 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fcfc2f-634e-4ef7-b425-ec2c734ce883 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:55.079548 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fcfc2f-634e-4ef7-b425-ec2c734ce883 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:55.114730 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-17fcfc2f-634e-4ef7-b425-ec2c734ce883 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:26:55.117028 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-17fcfc2f-634e-4ef7-b425-ec2c734ce883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:55.131648 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1187/2362] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:26:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:26:55.137813 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0b429e-8a57-474a-a217-31db79ed0d9d None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:55.157785 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0b429e-8a57-474a-a217-31db79ed0d9d None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:55.166210 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137e33bd-f9c4-41b7-9cac-f2ae1065d5a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:55.167354 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137e33bd-f9c4-41b7-9cac-f2ae1065d5a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:55.168047 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137e33bd-f9c4-41b7-9cac-f2ae1065d5a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:55.168891 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137e33bd-f9c4-41b7-9cac-f2ae1065d5a0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:55.170833 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137e33bd-f9c4-41b7-9cac-f2ae1065d5a0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:26:55.171373 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137e33bd-f9c4-41b7-9cac-f2ae1065d5a0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:55.174851 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137e33bd-f9c4-41b7-9cac-f2ae1065d5a0 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:55.193191 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1176/2363] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 31 00:26:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:26:55.199745 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fcfc2f-634e-4ef7-b425-ec2c734ce883 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:55.213640 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fcfc2f-634e-4ef7-b425-ec2c734ce883 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:55.222927 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fed79c1-ce01-460f-b38b-84dcac3b6adf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:55.224519 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fed79c1-ce01-460f-b38b-84dcac3b6adf admin admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:55.225307 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fed79c1-ce01-460f-b38b-84dcac3b6adf admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:55.225847 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fed79c1-ce01-460f-b38b-84dcac3b6adf admin admin] PATH_INFO: `/v3/projects` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:55.228863 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fed79c1-ce01-460f-b38b-84dcac3b6adf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:55.233509 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fed79c1-ce01-460f-b38b-84dcac3b6adf admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:55.293915 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1188/2364] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 31 00:26:55 2022] POST /identity/v3/projects => generated 369 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:26:55.301757 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137e33bd-f9c4-41b7-9cac-f2ae1065d5a0 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:55.318590 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137e33bd-f9c4-41b7-9cac-f2ae1065d5a0 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:55.425910 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec55c36-713c-4722-a37b-b6715368b59b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:55.426451 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec55c36-713c-4722-a37b-b6715368b59b admin admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:55.426732 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec55c36-713c-4722-a37b-b6715368b59b admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:55.427005 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec55c36-713c-4722-a37b-b6715368b59b admin admin] PATH_INFO: `/v3/users` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:55.427656 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec55c36-713c-4722-a37b-b6715368b59b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:55.429658 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec55c36-713c-4722-a37b-b6715368b59b admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:55.463422 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1177/2365] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 31 00:26:55 2022] POST /identity/v3/users => generated 285 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:26:55.469237 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fed79c1-ce01-460f-b38b-84dcac3b6adf admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:55.482499 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fed79c1-ce01-460f-b38b-84dcac3b6adf admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:55.487582 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39f4036-9718-4f98-b7bb-3ccd9758cf2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:55.488280 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39f4036-9718-4f98-b7bb-3ccd9758cf2d admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:55.488729 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39f4036-9718-4f98-b7bb-3ccd9758cf2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:55.488896 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39f4036-9718-4f98-b7bb-3ccd9758cf2d admin admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:55.489679 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39f4036-9718-4f98-b7bb-3ccd9758cf2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:55.491238 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39f4036-9718-4f98-b7bb-3ccd9758cf2d admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:55.503604 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1189/2366] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 00:26:55 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 00:26:55.507910 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec55c36-713c-4722-a37b-b6715368b59b admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:55.519593 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec55c36-713c-4722-a37b-b6715368b59b admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:55.525336 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c5f8e8-b84e-4e2b-8c1a-6a66163e9f80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:55.525962 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c5f8e8-b84e-4e2b-8c1a-6a66163e9f80 admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:55.526246 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c5f8e8-b84e-4e2b-8c1a-6a66163e9f80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:55.526523 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c5f8e8-b84e-4e2b-8c1a-6a66163e9f80 admin admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:55.527181 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c5f8e8-b84e-4e2b-8c1a-6a66163e9f80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:55.529440 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c5f8e8-b84e-4e2b-8c1a-6a66163e9f80 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:55.543272 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1178/2367] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 00:26:55 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:26:55.549196 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39f4036-9718-4f98-b7bb-3ccd9758cf2d admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:55.561498 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39f4036-9718-4f98-b7bb-3ccd9758cf2d admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:55.568273 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938ab7e7-e5b7-458c-a5a8-bcfe5c4b3713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:55.569289 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938ab7e7-e5b7-458c-a5a8-bcfe5c4b3713 admin admin] REQUEST_METHOD: `PUT` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:55.569573 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938ab7e7-e5b7-458c-a5a8-bcfe5c4b3713 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:55.569847 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938ab7e7-e5b7-458c-a5a8-bcfe5c4b3713 admin admin] PATH_INFO: `/v3/projects/0931c4cc855d40d7a02ab82c0c1f0752/users/f27478bd37964986a164e40622d16c45/roles/fdad79ffbcbb4fa380dc9cf7dd108618` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:55.590917 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938ab7e7-e5b7-458c-a5a8-bcfe5c4b3713 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0931c4cc855d40d7a02ab82c0c1f0752, user_id=f27478bd37964986a164e40622d16c45, role_id=fdad79ffbcbb4fa380dc9cf7dd108618)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:55.594933 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938ab7e7-e5b7-458c-a5a8-bcfe5c4b3713 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:55.619557 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1190/2368] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 00:26:55 2022] PUT /identity/v3/projects/0931c4cc855d40d7a02ab82c0c1f0752/users/f27478bd37964986a164e40622d16c45/roles/fdad79ffbcbb4fa380dc9cf7dd108618 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:26:55.638791 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c1a345-e4e0-4869-a154-01fb9e6ccfd6 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:55.639223 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c1a345-e4e0-4869-a154-01fb9e6ccfd6 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:55.639520 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c1a345-e4e0-4869-a154-01fb9e6ccfd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:55.695131 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-53c1a345-e4e0-4869-a154-01fb9e6ccfd6 None None] MFA Rules not processed for user `f27478bd37964986a164e40622d16c45`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:26:55.697453 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-53c1a345-e4e0-4869-a154-01fb9e6ccfd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:55.757559 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:26:55.793137 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1179/2369] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:26:55 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:26:55.799339 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938ab7e7-e5b7-458c-a5a8-bcfe5c4b3713 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:55.887836 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938ab7e7-e5b7-458c-a5a8-bcfe5c4b3713 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:55.895937 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4235a19f-430a-47f8-aea1-62b6c37ad366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:55.897096 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4235a19f-430a-47f8-aea1-62b6c37ad366 admin admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:55.897575 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4235a19f-430a-47f8-aea1-62b6c37ad366 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:55.898293 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4235a19f-430a-47f8-aea1-62b6c37ad366 admin admin] PATH_INFO: `/v3/projects` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:55.899886 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4235a19f-430a-47f8-aea1-62b6c37ad366 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:55.903790 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4235a19f-430a-47f8-aea1-62b6c37ad366 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:55.945004 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1191/2370] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 31 00:26:55 2022] POST /identity/v3/projects => generated 367 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:26:55.954838 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c1a345-e4e0-4869-a154-01fb9e6ccfd6 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:55.969054 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c1a345-e4e0-4869-a154-01fb9e6ccfd6 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:56.049807 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcda27e3-d286-48f1-9dde-ba650a224a08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:56.050445 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcda27e3-d286-48f1-9dde-ba650a224a08 admin admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:56.050732 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcda27e3-d286-48f1-9dde-ba650a224a08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:56.050999 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcda27e3-d286-48f1-9dde-ba650a224a08 admin admin] PATH_INFO: `/v3/users` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:56.051658 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcda27e3-d286-48f1-9dde-ba650a224a08 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:56.053717 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcda27e3-d286-48f1-9dde-ba650a224a08 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:56.084202 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1180/2371] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 31 00:26:55 2022] POST /identity/v3/users => generated 290 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:26:56.086267 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4235a19f-430a-47f8-aea1-62b6c37ad366 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:56.099065 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4235a19f-430a-47f8-aea1-62b6c37ad366 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:56.104017 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5597514-0a89-4a8b-a009-d1458c72fd98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:56.104692 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5597514-0a89-4a8b-a009-d1458c72fd98 admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:56.104976 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5597514-0a89-4a8b-a009-d1458c72fd98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:56.105245 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5597514-0a89-4a8b-a009-d1458c72fd98 admin admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:56.105889 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5597514-0a89-4a8b-a009-d1458c72fd98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:56.107660 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5597514-0a89-4a8b-a009-d1458c72fd98 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:56.128899 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1192/2372] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 00:26:56 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:26:56.133435 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcda27e3-d286-48f1-9dde-ba650a224a08 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:56.146198 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcda27e3-d286-48f1-9dde-ba650a224a08 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:56.152060 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575b9b2a-a617-4bd6-aaca-7ae773cfa44a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:56.152830 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575b9b2a-a617-4bd6-aaca-7ae773cfa44a admin admin] REQUEST_METHOD: `PUT` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:56.153112 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575b9b2a-a617-4bd6-aaca-7ae773cfa44a admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:56.153391 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575b9b2a-a617-4bd6-aaca-7ae773cfa44a admin admin] PATH_INFO: `/v3/projects/d49cc6a3204a4680a179f4cc35eee7d3/users/d9c71f9c458f4200b6a2518da8715303/roles/12f6817f9aaa4e2bb477095a6bed5d0f` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:56.172056 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575b9b2a-a617-4bd6-aaca-7ae773cfa44a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d49cc6a3204a4680a179f4cc35eee7d3, user_id=d9c71f9c458f4200b6a2518da8715303, role_id=12f6817f9aaa4e2bb477095a6bed5d0f)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:56.175016 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575b9b2a-a617-4bd6-aaca-7ae773cfa44a admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:56.193441 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1181/2373] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 00:26:56 2022] PUT /identity/v3/projects/d49cc6a3204a4680a179f4cc35eee7d3/users/d9c71f9c458f4200b6a2518da8715303/roles/12f6817f9aaa4e2bb477095a6bed5d0f => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:26:56.197791 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5597514-0a89-4a8b-a009-d1458c72fd98 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:56.205659 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:26:56.210484 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5597514-0a89-4a8b-a009-d1458c72fd98 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:56.342523 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64fca64-d75f-4d19-9d3d-a55a7443fa66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:56.343359 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64fca64-d75f-4d19-9d3d-a55a7443fa66 admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:56.343778 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64fca64-d75f-4d19-9d3d-a55a7443fa66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:56.344191 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64fca64-d75f-4d19-9d3d-a55a7443fa66 admin admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:56.345087 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64fca64-d75f-4d19-9d3d-a55a7443fa66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:56.347033 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64fca64-d75f-4d19-9d3d-a55a7443fa66 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:56.360637 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1193/2374] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 00:26:56 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:26:56.365097 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575b9b2a-a617-4bd6-aaca-7ae773cfa44a admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:56.378136 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575b9b2a-a617-4bd6-aaca-7ae773cfa44a admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:56.383931 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a71215-5e03-4d80-a0b6-aaa8ae1d5662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:56.384669 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a71215-5e03-4d80-a0b6-aaa8ae1d5662 admin admin] REQUEST_METHOD: `PUT` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:56.384953 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a71215-5e03-4d80-a0b6-aaa8ae1d5662 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:56.385229 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a71215-5e03-4d80-a0b6-aaa8ae1d5662 admin admin] PATH_INFO: `/v3/projects/d49cc6a3204a4680a179f4cc35eee7d3/users/d9c71f9c458f4200b6a2518da8715303/roles/12f6817f9aaa4e2bb477095a6bed5d0f` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:56.390867 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a71215-5e03-4d80-a0b6-aaa8ae1d5662 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d49cc6a3204a4680a179f4cc35eee7d3, user_id=d9c71f9c458f4200b6a2518da8715303, role_id=12f6817f9aaa4e2bb477095a6bed5d0f)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:56.391397 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a71215-5e03-4d80-a0b6-aaa8ae1d5662 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:56.407222 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1182/2375] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 00:26:56 2022] PUT /identity/v3/projects/d49cc6a3204a4680a179f4cc35eee7d3/users/d9c71f9c458f4200b6a2518da8715303/roles/12f6817f9aaa4e2bb477095a6bed5d0f => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:26:56.428025 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3781d8-cc6e-4d30-8d59-2b4a1f573a63 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:56.428422 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3781d8-cc6e-4d30-8d59-2b4a1f573a63 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:56.428773 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3781d8-cc6e-4d30-8d59-2b4a1f573a63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:56.469330 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-3e3781d8-cc6e-4d30-8d59-2b4a1f573a63 None None] MFA Rules not processed for user `d9c71f9c458f4200b6a2518da8715303`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:26:56.470683 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-3e3781d8-cc6e-4d30-8d59-2b4a1f573a63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:56.566640 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1194/2376] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:26:56 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:26:56.589288 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a71215-5e03-4d80-a0b6-aaa8ae1d5662 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:56.592702 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-22a71215-5e03-4d80-a0b6-aaa8ae1d5662 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:56.702478 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a71215-5e03-4d80-a0b6-aaa8ae1d5662 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:56.709168 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e17794a-ae54-4beb-a31c-0ad9440955f0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beecda6e9feb400288618745c784989f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:56.710186 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e17794a-ae54-4beb-a31c-0ad9440955f0 service cinder] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:56.710626 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e17794a-ae54-4beb-a31c-0ad9440955f0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:56.711100 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e17794a-ae54-4beb-a31c-0ad9440955f0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:56.738318 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e17794a-ae54-4beb-a31c-0ad9440955f0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:56.741338 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e17794a-ae54-4beb-a31c-0ad9440955f0 service cinder] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:56.762431 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1183/2377] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:26:56 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:26:56.839254 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3781d8-cc6e-4d30-8d59-2b4a1f573a63 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:26:56.842126 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-3e3781d8-cc6e-4d30-8d59-2b4a1f573a63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:26:56.865119 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3781d8-cc6e-4d30-8d59-2b4a1f573a63 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:26:56.871786 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4197e60-0247-4203-bd4f-098996e2100f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beecda6e9feb400288618745c784989f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:26:56.872995 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4197e60-0247-4203-bd4f-098996e2100f service cinder] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:26:56.873503 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4197e60-0247-4203-bd4f-098996e2100f service cinder] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:26:56.874013 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4197e60-0247-4203-bd4f-098996e2100f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:26:57.027930 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4197e60-0247-4203-bd4f-098996e2100f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:26:57.031768 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4197e60-0247-4203-bd4f-098996e2100f service cinder] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:26:57.050843 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1195/2378] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:26:56 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:27:00.864111 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e17794a-ae54-4beb-a31c-0ad9440955f0 service cinder] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:00.869425 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-3e17794a-ae54-4beb-a31c-0ad9440955f0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:01.018886 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:27:01.135986 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e17794a-ae54-4beb-a31c-0ad9440955f0 service cinder] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:01.149046 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39d2ff3-37a2-4988-96c9-d8b7c3869bd5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea002bf49c248dbae7147665fa10fd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:01.150997 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39d2ff3-37a2-4988-96c9-d8b7c3869bd5 service nova] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:01.151922 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39d2ff3-37a2-4988-96c9-d8b7c3869bd5 service nova] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:01.152440 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39d2ff3-37a2-4988-96c9-d8b7c3869bd5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:01.157927 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-d39d2ff3-37a2-4988-96c9-d8b7c3869bd5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:01.190558 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39d2ff3-37a2-4988-96c9-d8b7c3869bd5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:01.190558 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39d2ff3-37a2-4988-96c9-d8b7c3869bd5 service nova] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:01.211635 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1184/2379] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:27:00 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:27:01.630530 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4197e60-0247-4203-bd4f-098996e2100f service cinder] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:01.703030 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:27:01.761827 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4197e60-0247-4203-bd4f-098996e2100f service cinder] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:01.770840 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878cfc31-b554-4a18-8a9f-8bcabc0625d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:01.771836 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878cfc31-b554-4a18-8a9f-8bcabc0625d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:01.772480 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878cfc31-b554-4a18-8a9f-8bcabc0625d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:01.773276 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878cfc31-b554-4a18-8a9f-8bcabc0625d6 admin admin] PATH_INFO: `/v3/users/f27478bd37964986a164e40622d16c45` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:01.776713 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878cfc31-b554-4a18-8a9f-8bcabc0625d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f27478bd37964986a164e40622d16c45)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:01.781678 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878cfc31-b554-4a18-8a9f-8bcabc0625d6 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:01.884569 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-878cfc31-b554-4a18-8a9f-8bcabc0625d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f27478bd37964986a164e40622d16c45'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:01.893817 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-878cfc31-b554-4a18-8a9f-8bcabc0625d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f27478bd37964986a164e40622d16c45'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:01.906431 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-878cfc31-b554-4a18-8a9f-8bcabc0625d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f27478bd37964986a164e40622d16c45'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:01.911199 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-878cfc31-b554-4a18-8a9f-8bcabc0625d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f27478bd37964986a164e40622d16c45'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:01.941125 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-878cfc31-b554-4a18-8a9f-8bcabc0625d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f27478bd37964986a164e40622d16c45'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:01.953036 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1196/2380] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 31 00:27:01 2022] DELETE /identity/v3/users/f27478bd37964986a164e40622d16c45 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:27:01.962212 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503cda35-c051-4ced-b49f-b61c64c309fe None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:01.963139 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503cda35-c051-4ced-b49f-b61c64c309fe None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:01.963139 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503cda35-c051-4ced-b49f-b61c64c309fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:02.000348 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-503cda35-c051-4ced-b49f-b61c64c309fe None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:27:02.002424 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-503cda35-c051-4ced-b49f-b61c64c309fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:02.099431 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1185/2381] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:27:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:27:02.110105 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878cfc31-b554-4a18-8a9f-8bcabc0625d6 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:02.111559 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-878cfc31-b554-4a18-8a9f-8bcabc0625d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:02.182384 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878cfc31-b554-4a18-8a9f-8bcabc0625d6 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:02.186513 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0209c954-197b-4ff5-9752-17386bfc965b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'daae792cd11d4c4ca7aae0558998aced', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:02.187152 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0209c954-197b-4ff5-9752-17386bfc965b service neutron] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:02.187426 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0209c954-197b-4ff5-9752-17386bfc965b service neutron] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:02.187721 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0209c954-197b-4ff5-9752-17386bfc965b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:02.198638 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0209c954-197b-4ff5-9752-17386bfc965b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:02.200105 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0209c954-197b-4ff5-9752-17386bfc965b service neutron] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:02.212401 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1197/2382] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:27:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:27:02.663906 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503cda35-c051-4ced-b49f-b61c64c309fe None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:02.666258 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-503cda35-c051-4ced-b49f-b61c64c309fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:02.688857 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503cda35-c051-4ced-b49f-b61c64c309fe None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:02.695179 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae61050-21fa-4b77-b80b-eeee8b781004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:02.696278 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae61050-21fa-4b77-b80b-eeee8b781004 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:02.696779 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae61050-21fa-4b77-b80b-eeee8b781004 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:02.697231 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae61050-21fa-4b77-b80b-eeee8b781004 admin admin] PATH_INFO: `/v3/projects/0931c4cc855d40d7a02ab82c0c1f0752` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:02.698857 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae61050-21fa-4b77-b80b-eeee8b781004 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0931c4cc855d40d7a02ab82c0c1f0752)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:02.702726 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae61050-21fa-4b77-b80b-eeee8b781004 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:02.774430 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-bae61050-21fa-4b77-b80b-eeee8b781004 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0931c4cc855d40d7a02ab82c0c1f0752', 'request_id': 'req-bae61050-21fa-4b77-b80b-eeee8b781004'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:02.783221 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-bae61050-21fa-4b77-b80b-eeee8b781004 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0931c4cc855d40d7a02ab82c0c1f0752', 'request_id': 'req-bae61050-21fa-4b77-b80b-eeee8b781004'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:02.791738 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-bae61050-21fa-4b77-b80b-eeee8b781004 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0931c4cc855d40d7a02ab82c0c1f0752', 'request_id': 'req-bae61050-21fa-4b77-b80b-eeee8b781004'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:02.824003 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-bae61050-21fa-4b77-b80b-eeee8b781004 admin admin] The token cache is being invalidate because project 0931c4cc855d40d7a02ab82c0c1f0752 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81523) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:27:02.825190 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-bae61050-21fa-4b77-b80b-eeee8b781004 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:02.826356 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-bae61050-21fa-4b77-b80b-eeee8b781004 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:02.843316 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1186/2383] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 31 00:27:02 2022] DELETE /identity/v3/projects/0931c4cc855d40d7a02ab82c0c1f0752 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:27:02.848998 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0209c954-197b-4ff5-9752-17386bfc965b service neutron] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:02.861844 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0209c954-197b-4ff5-9752-17386bfc965b service neutron] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:02.968089 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:27:02.998958 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4349589a-37b5-4a0f-a617-76e5fcfe2d1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:02.999919 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4349589a-37b5-4a0f-a617-76e5fcfe2d1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:03.000468 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4349589a-37b5-4a0f-a617-76e5fcfe2d1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:03.000921 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4349589a-37b5-4a0f-a617-76e5fcfe2d1c admin admin] PATH_INFO: `/v3/users/d9c71f9c458f4200b6a2518da8715303` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:03.010001 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4349589a-37b5-4a0f-a617-76e5fcfe2d1c admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9c71f9c458f4200b6a2518da8715303)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:03.020008 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4349589a-37b5-4a0f-a617-76e5fcfe2d1c admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:03.183154 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-4349589a-37b5-4a0f-a617-76e5fcfe2d1c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9c71f9c458f4200b6a2518da8715303'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:03.218564 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-4349589a-37b5-4a0f-a617-76e5fcfe2d1c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9c71f9c458f4200b6a2518da8715303'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:03.240289 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-4349589a-37b5-4a0f-a617-76e5fcfe2d1c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9c71f9c458f4200b6a2518da8715303'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:03.241677 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-4349589a-37b5-4a0f-a617-76e5fcfe2d1c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9c71f9c458f4200b6a2518da8715303'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:03.298089 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-4349589a-37b5-4a0f-a617-76e5fcfe2d1c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9c71f9c458f4200b6a2518da8715303'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:03.321048 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1198/2384] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 31 00:27:02 2022] DELETE /identity/v3/users/d9c71f9c458f4200b6a2518da8715303 => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:27:04.027836 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae61050-21fa-4b77-b80b-eeee8b781004 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:04.030511 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-bae61050-21fa-4b77-b80b-eeee8b781004 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:04.051529 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae61050-21fa-4b77-b80b-eeee8b781004 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:04.088101 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b16e58f-1b48-47f9-81dc-a7043fe2ed3c None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:04.088972 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b16e58f-1b48-47f9-81dc-a7043fe2ed3c None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:04.088972 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b16e58f-1b48-47f9-81dc-a7043fe2ed3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:04.131637 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-9b16e58f-1b48-47f9-81dc-a7043fe2ed3c None None] MFA Rules not processed for user `601aa9e547aa4d42bef6753b26f48eaa`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:27:04.133472 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-9b16e58f-1b48-47f9-81dc-a7043fe2ed3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:04.291751 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:27:04.389440 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cededf8f-a5d5-419f-b7ee-98c6a763b32f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:04.390603 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cededf8f-a5d5-419f-b7ee-98c6a763b32f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:04.391095 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cededf8f-a5d5-419f-b7ee-98c6a763b32f admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:04.391590 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cededf8f-a5d5-419f-b7ee-98c6a763b32f admin admin] PATH_INFO: `/v3/projects/d49cc6a3204a4680a179f4cc35eee7d3` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:04.396259 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1199/2385] 10.222.0.47 () {58 vars in 1009 bytes} [Wed Aug 31 00:27:04 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:27:04.400115 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cededf8f-a5d5-419f-b7ee-98c6a763b32f admin admin] RBAC: Authorizing `identity:delete_project(project_id=d49cc6a3204a4680a179f4cc35eee7d3)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:04.413869 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cededf8f-a5d5-419f-b7ee-98c6a763b32f admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:04.535940 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b16e58f-1b48-47f9-81dc-a7043fe2ed3c None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:04.538725 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-9b16e58f-1b48-47f9-81dc-a7043fe2ed3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:04.568672 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-cededf8f-a5d5-419f-b7ee-98c6a763b32f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd49cc6a3204a4680a179f4cc35eee7d3', 'request_id': 'req-cededf8f-a5d5-419f-b7ee-98c6a763b32f'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:04.584064 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-cededf8f-a5d5-419f-b7ee-98c6a763b32f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd49cc6a3204a4680a179f4cc35eee7d3', 'request_id': 'req-cededf8f-a5d5-419f-b7ee-98c6a763b32f'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:04.598872 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-cededf8f-a5d5-419f-b7ee-98c6a763b32f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd49cc6a3204a4680a179f4cc35eee7d3', 'request_id': 'req-cededf8f-a5d5-419f-b7ee-98c6a763b32f'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:04.623207 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-cededf8f-a5d5-419f-b7ee-98c6a763b32f admin admin] The token cache is being invalidate because project d49cc6a3204a4680a179f4cc35eee7d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81523) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:27:04.623493 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-cededf8f-a5d5-419f-b7ee-98c6a763b32f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:04.624695 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-cededf8f-a5d5-419f-b7ee-98c6a763b32f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:04.627762 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1187/2386] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 31 00:27:04 2022] DELETE /identity/v3/projects/d49cc6a3204a4680a179f4cc35eee7d3 => generated 0 bytes in 600 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:27:04.651091 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586e0c21-b18a-40b4-9c43-333c009e3241 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:04.651563 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586e0c21-b18a-40b4-9c43-333c009e3241 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:04.652061 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586e0c21-b18a-40b4-9c43-333c009e3241 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:04.676361 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b16e58f-1b48-47f9-81dc-a7043fe2ed3c None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:04.691201 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:27:04.706861 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-586e0c21-b18a-40b4-9c43-333c009e3241 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:27:04.732194 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-586e0c21-b18a-40b4-9c43-333c009e3241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:04.792405 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292bb813-c49c-4576-84db-383b44a64ebc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffbfbf19509645f49dbf9566e447c8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:04.794873 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292bb813-c49c-4576-84db-383b44a64ebc service swift] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:04.795365 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292bb813-c49c-4576-84db-383b44a64ebc service swift] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:04.795866 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292bb813-c49c-4576-84db-383b44a64ebc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:04.801498 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-292bb813-c49c-4576-84db-383b44a64ebc service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:04.852546 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1188/2387] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:27:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:27:04.865589 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73efea8e-91ab-4025-a1b4-8ba5f1110c39 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:04.866990 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73efea8e-91ab-4025-a1b4-8ba5f1110c39 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:04.867786 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73efea8e-91ab-4025-a1b4-8ba5f1110c39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:04.929673 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-73efea8e-91ab-4025-a1b4-8ba5f1110c39 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:27:04.936112 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-73efea8e-91ab-4025-a1b4-8ba5f1110c39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:04.962762 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1189/2388] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:27:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:27:04.970880 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73efea8e-91ab-4025-a1b4-8ba5f1110c39 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:04.976180 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292bb813-c49c-4576-84db-383b44a64ebc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:04.978900 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292bb813-c49c-4576-84db-383b44a64ebc service swift] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:04.993087 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1200/2389] 10.222.0.47 () {60 vars in 1384 bytes} [Wed Aug 31 00:27:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 31 00:27:05.027982 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73efea8e-91ab-4025-a1b4-8ba5f1110c39 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:05.043539 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1cb99e-8351-4ad6-ac59-531ccf2d32f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:05.045203 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1cb99e-8351-4ad6-ac59-531ccf2d32f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:05.045674 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1cb99e-8351-4ad6-ac59-531ccf2d32f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:05.046624 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1cb99e-8351-4ad6-ac59-531ccf2d32f6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:05.047690 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1cb99e-8351-4ad6-ac59-531ccf2d32f6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:27:05.048268 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1cb99e-8351-4ad6-ac59-531ccf2d32f6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:05.051608 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1cb99e-8351-4ad6-ac59-531ccf2d32f6 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:05.092700 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1190/2390] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 31 00:27:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:27:05.097507 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292bb813-c49c-4576-84db-383b44a64ebc service swift] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:05.121968 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292bb813-c49c-4576-84db-383b44a64ebc service swift] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:05.128092 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79764646-583a-4db5-939a-e1dde6d93eca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:05.128917 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79764646-583a-4db5-939a-e1dde6d93eca admin admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:05.129269 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79764646-583a-4db5-939a-e1dde6d93eca admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:05.129611 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79764646-583a-4db5-939a-e1dde6d93eca admin admin] PATH_INFO: `/v3/projects` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:05.130487 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79764646-583a-4db5-939a-e1dde6d93eca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:05.132584 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79764646-583a-4db5-939a-e1dde6d93eca admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:05.185849 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1201/2391] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 31 00:27:05 2022] POST /identity/v3/projects => generated 373 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:27:05.187864 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1cb99e-8351-4ad6-ac59-531ccf2d32f6 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:05.200472 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1cb99e-8351-4ad6-ac59-531ccf2d32f6 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:05.364741 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:27:05.383689 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a05b7c-c2b9-4e66-87c0-bcff5380f80d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:05.384473 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a05b7c-c2b9-4e66-87c0-bcff5380f80d admin admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:05.384825 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a05b7c-c2b9-4e66-87c0-bcff5380f80d admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:05.385196 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a05b7c-c2b9-4e66-87c0-bcff5380f80d admin admin] PATH_INFO: `/v3/users` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:05.385959 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a05b7c-c2b9-4e66-87c0-bcff5380f80d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:05.389061 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a05b7c-c2b9-4e66-87c0-bcff5380f80d admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:05.425370 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1191/2392] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 31 00:27:05 2022] POST /identity/v3/users => generated 287 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:27:05.426808 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79764646-583a-4db5-939a-e1dde6d93eca admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:05.440892 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79764646-583a-4db5-939a-e1dde6d93eca admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:05.446741 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd213b2-5263-4e6e-b5b4-2fcea4092ffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:05.447561 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd213b2-5263-4e6e-b5b4-2fcea4092ffb admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:05.448004 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd213b2-5263-4e6e-b5b4-2fcea4092ffb admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:05.448534 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd213b2-5263-4e6e-b5b4-2fcea4092ffb admin admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:05.449355 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd213b2-5263-4e6e-b5b4-2fcea4092ffb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:05.451559 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd213b2-5263-4e6e-b5b4-2fcea4092ffb admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:05.471227 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1202/2393] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 00:27:05 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:27:05.472806 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a05b7c-c2b9-4e66-87c0-bcff5380f80d admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:05.488041 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a05b7c-c2b9-4e66-87c0-bcff5380f80d admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:05.494734 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f97959-d327-4db1-9947-0f3a2ed14d46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:05.495542 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f97959-d327-4db1-9947-0f3a2ed14d46 admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:05.495922 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f97959-d327-4db1-9947-0f3a2ed14d46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:05.496359 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f97959-d327-4db1-9947-0f3a2ed14d46 admin admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:05.497368 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f97959-d327-4db1-9947-0f3a2ed14d46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:05.499756 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f97959-d327-4db1-9947-0f3a2ed14d46 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:05.539108 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1192/2394] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 00:27:05 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:27:05.544561 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd213b2-5263-4e6e-b5b4-2fcea4092ffb admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:05.585083 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd213b2-5263-4e6e-b5b4-2fcea4092ffb admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:05.622672 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc8176d-89fd-477c-8d67-f14156f5d12e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:05.623896 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc8176d-89fd-477c-8d67-f14156f5d12e admin admin] REQUEST_METHOD: `PUT` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:05.624420 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc8176d-89fd-477c-8d67-f14156f5d12e admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:05.624919 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc8176d-89fd-477c-8d67-f14156f5d12e admin admin] PATH_INFO: `/v3/projects/d6a3fa4005284ee8af51afe5903b5900/users/01c0485003df47ac8e66d0c1d707af87/roles/fdad79ffbcbb4fa380dc9cf7dd108618` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:05.662855 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc8176d-89fd-477c-8d67-f14156f5d12e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6a3fa4005284ee8af51afe5903b5900, user_id=01c0485003df47ac8e66d0c1d707af87, role_id=fdad79ffbcbb4fa380dc9cf7dd108618)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:05.668583 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc8176d-89fd-477c-8d67-f14156f5d12e admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:05.716819 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1203/2395] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 00:27:05 2022] PUT /identity/v3/projects/d6a3fa4005284ee8af51afe5903b5900/users/01c0485003df47ac8e66d0c1d707af87/roles/fdad79ffbcbb4fa380dc9cf7dd108618 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:27:05.723247 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f97959-d327-4db1-9947-0f3a2ed14d46 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:05.725548 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-a1f97959-d327-4db1-9947-0f3a2ed14d46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:05.728306 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c406a8cc-0387-4258-92f7-e65f81bc5d69 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:05.728811 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c406a8cc-0387-4258-92f7-e65f81bc5d69 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:05.729295 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c406a8cc-0387-4258-92f7-e65f81bc5d69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:05.790577 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-c406a8cc-0387-4258-92f7-e65f81bc5d69 None None] MFA Rules not processed for user `01c0485003df47ac8e66d0c1d707af87`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:27:05.792912 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-c406a8cc-0387-4258-92f7-e65f81bc5d69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:05.895599 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f97959-d327-4db1-9947-0f3a2ed14d46 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:05.911752 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:27:05.953592 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1204/2396] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:27:05 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:27:05.973086 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c406a8cc-0387-4258-92f7-e65f81bc5d69 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:05.975318 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-c406a8cc-0387-4258-92f7-e65f81bc5d69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:06.035139 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e4dd53-744c-447e-9237-2f18d1ad34b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'daae792cd11d4c4ca7aae0558998aced', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:06.036633 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e4dd53-744c-447e-9237-2f18d1ad34b2 service neutron] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:06.037241 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e4dd53-744c-447e-9237-2f18d1ad34b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:06.037924 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e4dd53-744c-447e-9237-2f18d1ad34b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:06.043068 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-13e4dd53-744c-447e-9237-2f18d1ad34b2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:06.078461 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c406a8cc-0387-4258-92f7-e65f81bc5d69 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:06.082908 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cc90dc-e668-4d47-9051-f5fda07d8301 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beecda6e9feb400288618745c784989f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:06.083570 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cc90dc-e668-4d47-9051-f5fda07d8301 service cinder] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:06.083797 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cc90dc-e668-4d47-9051-f5fda07d8301 service cinder] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:06.084070 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cc90dc-e668-4d47-9051-f5fda07d8301 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:06.096013 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cc90dc-e668-4d47-9051-f5fda07d8301 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:06.096013 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cc90dc-e668-4d47-9051-f5fda07d8301 service cinder] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:06.108923 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1205/2397] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:27:05 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 00:27:06.155870 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cc90dc-e668-4d47-9051-f5fda07d8301 service cinder] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:06.216286 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e4dd53-744c-447e-9237-2f18d1ad34b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:06.219275 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e4dd53-744c-447e-9237-2f18d1ad34b2 service neutron] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:06.244667 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1193/2398] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:27:05 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 522 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:27:06.359746 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cc90dc-e668-4d47-9051-f5fda07d8301 service cinder] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:06.366401 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ea0ae7-56cc-4c1c-9170-8803f35464cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:06.367368 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ea0ae7-56cc-4c1c-9170-8803f35464cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:06.367823 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ea0ae7-56cc-4c1c-9170-8803f35464cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:06.368292 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ea0ae7-56cc-4c1c-9170-8803f35464cc admin admin] PATH_INFO: `/v3/users/01c0485003df47ac8e66d0c1d707af87` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:06.373905 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ea0ae7-56cc-4c1c-9170-8803f35464cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=01c0485003df47ac8e66d0c1d707af87)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:06.376323 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ea0ae7-56cc-4c1c-9170-8803f35464cc admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:06.469546 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-02ea0ae7-56cc-4c1c-9170-8803f35464cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01c0485003df47ac8e66d0c1d707af87'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:06.479695 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-02ea0ae7-56cc-4c1c-9170-8803f35464cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01c0485003df47ac8e66d0c1d707af87'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:06.491830 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-02ea0ae7-56cc-4c1c-9170-8803f35464cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01c0485003df47ac8e66d0c1d707af87'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:06.492644 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-02ea0ae7-56cc-4c1c-9170-8803f35464cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01c0485003df47ac8e66d0c1d707af87'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:06.511992 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-02ea0ae7-56cc-4c1c-9170-8803f35464cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01c0485003df47ac8e66d0c1d707af87'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:06.521538 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1206/2399] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 31 00:27:06 2022] DELETE /identity/v3/users/01c0485003df47ac8e66d0c1d707af87 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:27:06.529613 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eacbb7d-5029-4eda-9efe-b8292124c30d None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:06.530338 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eacbb7d-5029-4eda-9efe-b8292124c30d None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:06.530837 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eacbb7d-5029-4eda-9efe-b8292124c30d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:06.579997 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-0eacbb7d-5029-4eda-9efe-b8292124c30d None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:27:06.597507 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-0eacbb7d-5029-4eda-9efe-b8292124c30d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:06.766898 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:27:06.886546 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1194/2400] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:27:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 359 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:27:06.908522 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ea0ae7-56cc-4c1c-9170-8803f35464cc admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:06.910071 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-02ea0ae7-56cc-4c1c-9170-8803f35464cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:06.931611 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:27:07.079095 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ea0ae7-56cc-4c1c-9170-8803f35464cc admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:07.092676 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a628a4a0-3446-42c0-9d87-b9fff654c773 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'daae792cd11d4c4ca7aae0558998aced', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:07.093909 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a628a4a0-3446-42c0-9d87-b9fff654c773 service neutron] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:07.094521 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a628a4a0-3446-42c0-9d87-b9fff654c773 service neutron] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:07.095132 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a628a4a0-3446-42c0-9d87-b9fff654c773 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:07.120746 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a628a4a0-3446-42c0-9d87-b9fff654c773 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:07.125674 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a628a4a0-3446-42c0-9d87-b9fff654c773 service neutron] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:07.171104 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1207/2401] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:27:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:27:08.370578 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eacbb7d-5029-4eda-9efe-b8292124c30d None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:08.374606 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-0eacbb7d-5029-4eda-9efe-b8292124c30d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:08.474392 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eacbb7d-5029-4eda-9efe-b8292124c30d None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:08.499510 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cce50f3-44de-4b5a-90e2-87599fa4d95d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:08.501920 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cce50f3-44de-4b5a-90e2-87599fa4d95d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:08.505415 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cce50f3-44de-4b5a-90e2-87599fa4d95d admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:08.505991 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cce50f3-44de-4b5a-90e2-87599fa4d95d admin admin] PATH_INFO: `/v3/projects/d6a3fa4005284ee8af51afe5903b5900` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:08.512232 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cce50f3-44de-4b5a-90e2-87599fa4d95d admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6a3fa4005284ee8af51afe5903b5900)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:08.521260 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cce50f3-44de-4b5a-90e2-87599fa4d95d admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:08.658861 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-9cce50f3-44de-4b5a-90e2-87599fa4d95d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6a3fa4005284ee8af51afe5903b5900', 'request_id': 'req-9cce50f3-44de-4b5a-90e2-87599fa4d95d'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:08.678034 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-9cce50f3-44de-4b5a-90e2-87599fa4d95d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6a3fa4005284ee8af51afe5903b5900', 'request_id': 'req-9cce50f3-44de-4b5a-90e2-87599fa4d95d'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:08.692618 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-9cce50f3-44de-4b5a-90e2-87599fa4d95d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6a3fa4005284ee8af51afe5903b5900', 'request_id': 'req-9cce50f3-44de-4b5a-90e2-87599fa4d95d'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:08.726017 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-9cce50f3-44de-4b5a-90e2-87599fa4d95d admin admin] The token cache is being invalidate because project d6a3fa4005284ee8af51afe5903b5900 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81523) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:27:08.727333 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-9cce50f3-44de-4b5a-90e2-87599fa4d95d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:08.728399 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-9cce50f3-44de-4b5a-90e2-87599fa4d95d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:08.730817 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1195/2402] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 31 00:27:08 2022] DELETE /identity/v3/projects/d6a3fa4005284ee8af51afe5903b5900 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:27:08.740182 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38977516-a686-4c7e-815d-b9488f002a27 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:08.740756 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38977516-a686-4c7e-815d-b9488f002a27 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:08.741013 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38977516-a686-4c7e-815d-b9488f002a27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:08.810619 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-38977516-a686-4c7e-815d-b9488f002a27 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:27:08.814768 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-38977516-a686-4c7e-815d-b9488f002a27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:09.019370 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1208/2403] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:27:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:27:09.031852 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4996ba6e-9c3c-4a49-b2d2-92885f48bb5a None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:09.032327 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4996ba6e-9c3c-4a49-b2d2-92885f48bb5a None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:09.032805 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4996ba6e-9c3c-4a49-b2d2-92885f48bb5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:09.084744 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-4996ba6e-9c3c-4a49-b2d2-92885f48bb5a None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:27:09.087044 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-4996ba6e-9c3c-4a49-b2d2-92885f48bb5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:09.108633 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1196/2404] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:27:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:27:09.109555 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38977516-a686-4c7e-815d-b9488f002a27 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:09.137471 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38977516-a686-4c7e-815d-b9488f002a27 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:09.160535 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae8f1cd-3335-40d4-9203-15a2c7e36ca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:09.161485 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae8f1cd-3335-40d4-9203-15a2c7e36ca1 admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:09.161925 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae8f1cd-3335-40d4-9203-15a2c7e36ca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:09.162372 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae8f1cd-3335-40d4-9203-15a2c7e36ca1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:09.163766 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae8f1cd-3335-40d4-9203-15a2c7e36ca1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:27:09.164298 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae8f1cd-3335-40d4-9203-15a2c7e36ca1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:09.166129 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae8f1cd-3335-40d4-9203-15a2c7e36ca1 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:09.189247 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1209/2405] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 31 00:27:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:27:09.196530 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4996ba6e-9c3c-4a49-b2d2-92885f48bb5a None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:09.225402 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4996ba6e-9c3c-4a49-b2d2-92885f48bb5a None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:09.231056 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226a6073-0879-42a6-abd7-2d673b61003a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:09.232731 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226a6073-0879-42a6-abd7-2d673b61003a admin admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:09.233220 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226a6073-0879-42a6-abd7-2d673b61003a admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:09.233651 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226a6073-0879-42a6-abd7-2d673b61003a admin admin] PATH_INFO: `/v3/projects` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:09.234989 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226a6073-0879-42a6-abd7-2d673b61003a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:09.237550 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226a6073-0879-42a6-abd7-2d673b61003a admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:09.274709 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1197/2406] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 31 00:27:09 2022] POST /identity/v3/projects => generated 383 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:27:09.286717 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae8f1cd-3335-40d4-9203-15a2c7e36ca1 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:09.311051 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae8f1cd-3335-40d4-9203-15a2c7e36ca1 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:09.462805 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074319df-d6ad-414b-a6a1-ba212ae53f22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:09.463540 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074319df-d6ad-414b-a6a1-ba212ae53f22 admin admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:09.463811 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074319df-d6ad-414b-a6a1-ba212ae53f22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:09.464226 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074319df-d6ad-414b-a6a1-ba212ae53f22 admin admin] PATH_INFO: `/v3/users` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:09.465912 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074319df-d6ad-414b-a6a1-ba212ae53f22 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:09.468535 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074319df-d6ad-414b-a6a1-ba212ae53f22 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:09.521096 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1210/2407] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 31 00:27:09 2022] POST /identity/v3/users => generated 292 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:27:09.526724 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226a6073-0879-42a6-abd7-2d673b61003a admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:09.557322 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226a6073-0879-42a6-abd7-2d673b61003a admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:09.577072 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ca3fa8-ef38-4bb9-8f07-d12bc2c4b036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:09.581976 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ca3fa8-ef38-4bb9-8f07-d12bc2c4b036 admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:09.582278 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ca3fa8-ef38-4bb9-8f07-d12bc2c4b036 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:09.582543 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ca3fa8-ef38-4bb9-8f07-d12bc2c4b036 admin admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:09.583290 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ca3fa8-ef38-4bb9-8f07-d12bc2c4b036 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:09.585035 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ca3fa8-ef38-4bb9-8f07-d12bc2c4b036 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:09.642929 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1198/2408] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 00:27:09 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:27:09.644194 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074319df-d6ad-414b-a6a1-ba212ae53f22 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:09.668855 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074319df-d6ad-414b-a6a1-ba212ae53f22 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:09.678727 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfe83b8-54a2-4747-89ab-adb4afe44e4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:09.679661 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfe83b8-54a2-4747-89ab-adb4afe44e4f admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:09.680168 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfe83b8-54a2-4747-89ab-adb4afe44e4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:09.680659 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfe83b8-54a2-4747-89ab-adb4afe44e4f admin admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:09.682400 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfe83b8-54a2-4747-89ab-adb4afe44e4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:09.686448 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfe83b8-54a2-4747-89ab-adb4afe44e4f admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:09.714939 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1211/2409] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 00:27:09 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:27:09.721893 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ca3fa8-ef38-4bb9-8f07-d12bc2c4b036 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:09.769542 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ca3fa8-ef38-4bb9-8f07-d12bc2c4b036 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:09.791898 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a86563-0dc7-4123-aee3-5e27ab5c2b68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:09.800043 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a86563-0dc7-4123-aee3-5e27ab5c2b68 admin admin] REQUEST_METHOD: `PUT` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:09.800707 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a86563-0dc7-4123-aee3-5e27ab5c2b68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:09.801435 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a86563-0dc7-4123-aee3-5e27ab5c2b68 admin admin] PATH_INFO: `/v3/projects/d2b2473cfa244cf1aaaa6e4dac08a3d6/users/cacf8da1fc48427eacc993769c4f9f3a/roles/fdad79ffbcbb4fa380dc9cf7dd108618` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:09.876104 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a86563-0dc7-4123-aee3-5e27ab5c2b68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2b2473cfa244cf1aaaa6e4dac08a3d6, user_id=cacf8da1fc48427eacc993769c4f9f3a, role_id=fdad79ffbcbb4fa380dc9cf7dd108618)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:09.880115 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a86563-0dc7-4123-aee3-5e27ab5c2b68 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:09.939487 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1199/2410] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 00:27:09 2022] PUT /identity/v3/projects/d2b2473cfa244cf1aaaa6e4dac08a3d6/users/cacf8da1fc48427eacc993769c4f9f3a/roles/fdad79ffbcbb4fa380dc9cf7dd108618 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:27:09.941221 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0998309-2668-4bf0-882a-ee170a3befb8 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:09.942402 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0998309-2668-4bf0-882a-ee170a3befb8 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:09.942402 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0998309-2668-4bf0-882a-ee170a3befb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:09.997028 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-f0998309-2668-4bf0-882a-ee170a3befb8 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:27:10.000521 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-f0998309-2668-4bf0-882a-ee170a3befb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:10.037448 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:27:10.284853 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1212/2411] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:27:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 345 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:27:10.354146 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a86563-0dc7-4123-aee3-5e27ab5c2b68 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:10.356371 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-b4a86563-0dc7-4123-aee3-5e27ab5c2b68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:10.618836 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0998309-2668-4bf0-882a-ee170a3befb8 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:10.621330 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-f0998309-2668-4bf0-882a-ee170a3befb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:10.685685 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a86563-0dc7-4123-aee3-5e27ab5c2b68 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:10.696142 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d25072-9643-41b1-a3db-f219ec72978b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'daae792cd11d4c4ca7aae0558998aced', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:10.697711 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d25072-9643-41b1-a3db-f219ec72978b service neutron] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:10.709329 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d25072-9643-41b1-a3db-f219ec72978b service neutron] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:10.710506 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d25072-9643-41b1-a3db-f219ec72978b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:10.751799 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d25072-9643-41b1-a3db-f219ec72978b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:10.753854 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d25072-9643-41b1-a3db-f219ec72978b service neutron] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:10.789139 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:27:10.794299 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1200/2412] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:27:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 00:27:10.902997 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0998309-2668-4bf0-882a-ee170a3befb8 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:10.941231 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea3363b-1045-408c-a1a7-ce01484ec9ad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea002bf49c248dbae7147665fa10fd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:10.942274 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea3363b-1045-408c-a1a7-ce01484ec9ad service nova] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:10.942802 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea3363b-1045-408c-a1a7-ce01484ec9ad service nova] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:10.943322 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea3363b-1045-408c-a1a7-ce01484ec9ad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:10.963697 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-fea3363b-1045-408c-a1a7-ce01484ec9ad service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:11.061813 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea3363b-1045-408c-a1a7-ce01484ec9ad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:11.067458 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea3363b-1045-408c-a1a7-ce01484ec9ad service nova] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:11.129459 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1213/2413] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:27:10 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 511 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:27:20.555863 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91bc697-5b1f-44a3-9118-16da23d09bc7 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:20.557270 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91bc697-5b1f-44a3-9118-16da23d09bc7 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:20.557933 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91bc697-5b1f-44a3-9118-16da23d09bc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:20.682578 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-f91bc697-5b1f-44a3-9118-16da23d09bc7 None None] MFA Rules not processed for user `cacf8da1fc48427eacc993769c4f9f3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:27:20.685801 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-f91bc697-5b1f-44a3-9118-16da23d09bc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:20.945302 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1201/2414] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:27:20 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 387 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:27:20.946634 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea3363b-1045-408c-a1a7-ce01484ec9ad service nova] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:20.966441 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea3363b-1045-408c-a1a7-ce01484ec9ad service nova] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:20.989798 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c96b37-2848-471f-9350-75df891b06f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:20.990199 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c96b37-2848-471f-9350-75df891b06f7 admin admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:20.990735 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c96b37-2848-471f-9350-75df891b06f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:20.991023 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c96b37-2848-471f-9350-75df891b06f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:20.991870 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c96b37-2848-471f-9350-75df891b06f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:21.013544 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c96b37-2848-471f-9350-75df891b06f7 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:21.097109 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1214/2415] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 31 00:27:20 2022] POST /identity/v3/projects => generated 385 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:27:21.098128 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91bc697-5b1f-44a3-9118-16da23d09bc7 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:21.125832 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91bc697-5b1f-44a3-9118-16da23d09bc7 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:21.317384 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a53742-5ab0-4703-b4da-48780a13e952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:21.318257 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a53742-5ab0-4703-b4da-48780a13e952 admin admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:21.318709 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a53742-5ab0-4703-b4da-48780a13e952 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:21.319144 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a53742-5ab0-4703-b4da-48780a13e952 admin admin] PATH_INFO: `/v3/users` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:21.320032 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a53742-5ab0-4703-b4da-48780a13e952 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:21.322577 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a53742-5ab0-4703-b4da-48780a13e952 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:21.359538 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1202/2416] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 31 00:27:21 2022] POST /identity/v3/users => generated 299 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:27:21.379488 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c96b37-2848-471f-9350-75df891b06f7 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:21.416242 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c96b37-2848-471f-9350-75df891b06f7 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:21.439732 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db72dbdb-c6ac-4890-8341-c930bd0fb1ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:21.441858 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db72dbdb-c6ac-4890-8341-c930bd0fb1ef admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:21.444551 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db72dbdb-c6ac-4890-8341-c930bd0fb1ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:21.445101 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db72dbdb-c6ac-4890-8341-c930bd0fb1ef admin admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:21.448635 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db72dbdb-c6ac-4890-8341-c930bd0fb1ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:21.458054 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db72dbdb-c6ac-4890-8341-c930bd0fb1ef admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:21.527639 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1215/2417] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 00:27:21 2022] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:27:21.529587 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a53742-5ab0-4703-b4da-48780a13e952 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:21.553530 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a53742-5ab0-4703-b4da-48780a13e952 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:21.577032 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3938d0ef-4563-43ba-b144-4d44241a141b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:21.578912 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3938d0ef-4563-43ba-b144-4d44241a141b admin admin] REQUEST_METHOD: `PUT` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:21.579777 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3938d0ef-4563-43ba-b144-4d44241a141b admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:21.580689 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3938d0ef-4563-43ba-b144-4d44241a141b admin admin] PATH_INFO: `/v3/projects/51a9e9ece54741ef8c65759bfb81afc1/users/2c0fe3990f3b4aa8a8ea974e73342c0f/roles/12f6817f9aaa4e2bb477095a6bed5d0f` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:21.643223 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3938d0ef-4563-43ba-b144-4d44241a141b admin admin] RBAC: Authorizing `identity:create_grant(project_id=51a9e9ece54741ef8c65759bfb81afc1, user_id=2c0fe3990f3b4aa8a8ea974e73342c0f, role_id=12f6817f9aaa4e2bb477095a6bed5d0f)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:21.664880 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3938d0ef-4563-43ba-b144-4d44241a141b admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:21.793460 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1203/2418] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 00:27:21 2022] PUT /identity/v3/projects/51a9e9ece54741ef8c65759bfb81afc1/users/2c0fe3990f3b4aa8a8ea974e73342c0f/roles/12f6817f9aaa4e2bb477095a6bed5d0f => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:27:21.802181 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db72dbdb-c6ac-4890-8341-c930bd0fb1ef admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:21.835428 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db72dbdb-c6ac-4890-8341-c930bd0fb1ef admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:22.118326 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d96161-8a25-44a0-b198-143186d84f36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:22.119553 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d96161-8a25-44a0-b198-143186d84f36 admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:22.120129 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d96161-8a25-44a0-b198-143186d84f36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:22.120653 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d96161-8a25-44a0-b198-143186d84f36 admin admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:22.122595 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d96161-8a25-44a0-b198-143186d84f36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:22.126960 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d96161-8a25-44a0-b198-143186d84f36 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:22.193537 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3938d0ef-4563-43ba-b144-4d44241a141b admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:22.212054 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1216/2419] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 00:27:21 2022] GET /identity/v3/roles => generated 1420 bytes in 418 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 00:27:22.239580 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3938d0ef-4563-43ba-b144-4d44241a141b admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:22.262423 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a115e04-d1cf-4d97-b396-39abd1136a15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:22.263902 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a115e04-d1cf-4d97-b396-39abd1136a15 admin admin] REQUEST_METHOD: `PUT` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:22.264601 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a115e04-d1cf-4d97-b396-39abd1136a15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:22.265057 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a115e04-d1cf-4d97-b396-39abd1136a15 admin admin] PATH_INFO: `/v3/projects/51a9e9ece54741ef8c65759bfb81afc1/users/2c0fe3990f3b4aa8a8ea974e73342c0f/roles/12f6817f9aaa4e2bb477095a6bed5d0f` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:22.275779 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a115e04-d1cf-4d97-b396-39abd1136a15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=51a9e9ece54741ef8c65759bfb81afc1, user_id=2c0fe3990f3b4aa8a8ea974e73342c0f, role_id=12f6817f9aaa4e2bb477095a6bed5d0f)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:22.285437 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a115e04-d1cf-4d97-b396-39abd1136a15 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:22.318369 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1204/2420] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 00:27:22 2022] PUT /identity/v3/projects/51a9e9ece54741ef8c65759bfb81afc1/users/2c0fe3990f3b4aa8a8ea974e73342c0f/roles/12f6817f9aaa4e2bb477095a6bed5d0f => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:27:32.161138 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=96,keystone:INSERT=1 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:27:32.312693 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=76,keystone:INSERT=5 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:27:34.935838 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9317c7-b5e6-45c9-baa5-222b98ba2c8b None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:34.936764 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9317c7-b5e6-45c9-baa5-222b98ba2c8b None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:34.936764 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9317c7-b5e6-45c9-baa5-222b98ba2c8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:34.972194 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-9f9317c7-b5e6-45c9-baa5-222b98ba2c8b None None] MFA Rules not processed for user `2c0fe3990f3b4aa8a8ea974e73342c0f`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:27:34.974347 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-9f9317c7-b5e6-45c9-baa5-222b98ba2c8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:35.083652 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1217/2421] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:27:34 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:27:35.099827 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a115e04-d1cf-4d97-b396-39abd1136a15 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:35.102711 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-5a115e04-d1cf-4d97-b396-39abd1136a15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:35.206053 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a115e04-d1cf-4d97-b396-39abd1136a15 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:35.209972 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0103c0e6-e601-4a7e-bb72-d5a7f97b65c7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc025521e1dc4c91ab50a8718a87754f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:35.210606 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0103c0e6-e601-4a7e-bb72-d5a7f97b65c7 service glance] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:35.210883 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0103c0e6-e601-4a7e-bb72-d5a7f97b65c7 service glance] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:35.211154 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0103c0e6-e601-4a7e-bb72-d5a7f97b65c7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:35.291347 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0103c0e6-e601-4a7e-bb72-d5a7f97b65c7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:35.295497 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0103c0e6-e601-4a7e-bb72-d5a7f97b65c7 service glance] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:35.327616 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1205/2422] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:27:35 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:27:35.624016 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de44d40-6d11-4846-8804-511135f802de None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:35.624456 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de44d40-6d11-4846-8804-511135f802de None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:35.624829 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de44d40-6d11-4846-8804-511135f802de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:35.662236 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-5de44d40-6d11-4846-8804-511135f802de None None] MFA Rules not processed for user `601aa9e547aa4d42bef6753b26f48eaa`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:27:35.670067 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-5de44d40-6d11-4846-8804-511135f802de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:35.861752 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1218/2423] 10.222.0.47 () {58 vars in 1009 bytes} [Wed Aug 31 00:27:35 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:27:35.889808 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0103c0e6-e601-4a7e-bb72-d5a7f97b65c7 service glance] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:35.891648 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-0103c0e6-e601-4a7e-bb72-d5a7f97b65c7 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:36.010867 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0103c0e6-e601-4a7e-bb72-d5a7f97b65c7 service glance] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:36.028135 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3dc2c9-1165-4398-ab9e-8f76d16b7ab1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffbfbf19509645f49dbf9566e447c8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:36.029572 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3dc2c9-1165-4398-ab9e-8f76d16b7ab1 service swift] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:36.030092 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3dc2c9-1165-4398-ab9e-8f76d16b7ab1 service swift] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:36.030577 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3dc2c9-1165-4398-ab9e-8f76d16b7ab1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:36.051226 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3dc2c9-1165-4398-ab9e-8f76d16b7ab1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:36.057049 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3dc2c9-1165-4398-ab9e-8f76d16b7ab1 service swift] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:36.076038 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1206/2424] 10.222.0.47 () {60 vars in 1384 bytes} [Wed Aug 31 00:27:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 31 00:27:37.641708 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b594bc6-8660-4ac9-bef2-6c528499e4d6 None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:37.642422 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b594bc6-8660-4ac9-bef2-6c528499e4d6 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:37.642602 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b594bc6-8660-4ac9-bef2-6c528499e4d6 None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:37.649308 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1219/2425] 10.222.0.47 () {54 vars in 921 bytes} [Wed Aug 31 00:27:37 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:27:37.656767 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aafa4d-83f5-4c37-8c06-266834365ddc None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:37.657605 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aafa4d-83f5-4c37-8c06-266834365ddc None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:37.657802 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aafa4d-83f5-4c37-8c06-266834365ddc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:37.752459 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-23aafa4d-83f5-4c37-8c06-266834365ddc None None] MFA Rules not processed for user `9ea002bf49c248dbae7147665fa10fd1`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:27:37.755563 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-23aafa4d-83f5-4c37-8c06-266834365ddc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:37.937291 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:27:38.045878 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1207/2426] 10.222.0.47 () {58 vars in 1018 bytes} [Wed Aug 31 00:27:37 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 389 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:27:38.057123 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b594bc6-8660-4ac9-bef2-6c528499e4d6 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:38.074329 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b594bc6-8660-4ac9-bef2-6c528499e4d6 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:38.083642 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870eb8a1-0fa2-45cc-9f86-bb74b27e5c03 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc025521e1dc4c91ab50a8718a87754f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:38.084608 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870eb8a1-0fa2-45cc-9f86-bb74b27e5c03 service glance] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:38.085273 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870eb8a1-0fa2-45cc-9f86-bb74b27e5c03 service glance] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:38.085707 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870eb8a1-0fa2-45cc-9f86-bb74b27e5c03 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:38.110118 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870eb8a1-0fa2-45cc-9f86-bb74b27e5c03 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:38.111636 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870eb8a1-0fa2-45cc-9f86-bb74b27e5c03 service glance] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:38.132338 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1220/2427] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:27:38 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:27:38.294962 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a3dbea-b9be-4185-994f-c4fc02d9eeba None None] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:38.298054 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a3dbea-b9be-4185-994f-c4fc02d9eeba None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:38.299010 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a3dbea-b9be-4185-994f-c4fc02d9eeba None None] PATH_INFO: `/` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:38.303425 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1208/2428] 10.222.0.47 () {54 vars in 921 bytes} [Wed Aug 31 00:27:38 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:27:38.320954 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46ef725-2c61-43af-a71a-8bf51959840b None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:38.321489 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46ef725-2c61-43af-a71a-8bf51959840b None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:38.322009 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46ef725-2c61-43af-a71a-8bf51959840b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:38.378453 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-f46ef725-2c61-43af-a71a-8bf51959840b None None] MFA Rules not processed for user `daae792cd11d4c4ca7aae0558998aced`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:27:38.382592 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-f46ef725-2c61-43af-a71a-8bf51959840b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:38.523805 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1221/2429] 10.222.0.47 () {58 vars in 1018 bytes} [Wed Aug 31 00:27:38 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:27:38.550496 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a3dbea-b9be-4185-994f-c4fc02d9eeba None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:38.553788 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-a8a3dbea-b9be-4185-994f-c4fc02d9eeba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:38.597520 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a3dbea-b9be-4185-994f-c4fc02d9eeba None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:38.613822 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93720614-cfa7-4562-84ee-07b5bdaa7571 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'daae792cd11d4c4ca7aae0558998aced', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:38.616014 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93720614-cfa7-4562-84ee-07b5bdaa7571 service neutron] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:38.617515 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93720614-cfa7-4562-84ee-07b5bdaa7571 service neutron] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:38.619066 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93720614-cfa7-4562-84ee-07b5bdaa7571 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:38.636620 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93720614-cfa7-4562-84ee-07b5bdaa7571 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:38.641011 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93720614-cfa7-4562-84ee-07b5bdaa7571 service neutron] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:38.675235 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1209/2430] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:27:38 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:27:38.944293 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae87f1f0-519f-46ae-ba8a-6071bb4acadb None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:38.944864 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae87f1f0-519f-46ae-ba8a-6071bb4acadb None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:38.945468 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae87f1f0-519f-46ae-ba8a-6071bb4acadb None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:38.949169 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1222/2431] 10.222.0.47 () {54 vars in 921 bytes} [Wed Aug 31 00:27:38 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:27:38.956868 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6531f51-9b93-478d-bb33-c8cc600bb3be None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:38.957946 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6531f51-9b93-478d-bb33-c8cc600bb3be None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:38.958384 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6531f51-9b93-478d-bb33-c8cc600bb3be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:39.002285 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-b6531f51-9b93-478d-bb33-c8cc600bb3be None None] MFA Rules not processed for user `9ea002bf49c248dbae7147665fa10fd1`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:27:39.003658 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-b6531f51-9b93-478d-bb33-c8cc600bb3be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:39.029942 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1210/2432] 10.222.0.47 () {58 vars in 1018 bytes} [Wed Aug 31 00:27:38 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:27:39.046653 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae87f1f0-519f-46ae-ba8a-6071bb4acadb None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:39.064693 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae87f1f0-519f-46ae-ba8a-6071bb4acadb None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:39.071064 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdd4b28-4baf-419c-8b58-d3e39c2ed21f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'daae792cd11d4c4ca7aae0558998aced', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:39.072131 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdd4b28-4baf-419c-8b58-d3e39c2ed21f service neutron] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:39.072929 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdd4b28-4baf-419c-8b58-d3e39c2ed21f service neutron] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:39.073435 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdd4b28-4baf-419c-8b58-d3e39c2ed21f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:39.105898 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdd4b28-4baf-419c-8b58-d3e39c2ed21f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:39.110441 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdd4b28-4baf-419c-8b58-d3e39c2ed21f service neutron] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:39.171567 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1223/2433] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:27:39 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:27:39.462467 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6531f51-9b93-478d-bb33-c8cc600bb3be None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:39.510508 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6531f51-9b93-478d-bb33-c8cc600bb3be None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:39.536363 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fc7ce9-94e3-46ac-9ac1-8e0a3ab1b54e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'daae792cd11d4c4ca7aae0558998aced', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:39.537345 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fc7ce9-94e3-46ac-9ac1-8e0a3ab1b54e service neutron] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:39.537835 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fc7ce9-94e3-46ac-9ac1-8e0a3ab1b54e service neutron] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:39.540934 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fc7ce9-94e3-46ac-9ac1-8e0a3ab1b54e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:39.551668 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-f1fc7ce9-94e3-46ac-9ac1-8e0a3ab1b54e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:39.888385 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fc7ce9-94e3-46ac-9ac1-8e0a3ab1b54e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:39.891393 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fc7ce9-94e3-46ac-9ac1-8e0a3ab1b54e service neutron] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:39.927396 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1211/2434] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:27:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 00:27:44.120259 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40023e24-ea3e-41b1-9c54-a2b90de8e323 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:44.124650 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40023e24-ea3e-41b1-9c54-a2b90de8e323 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:44.125200 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40023e24-ea3e-41b1-9c54-a2b90de8e323 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:44.157915 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-40023e24-ea3e-41b1-9c54-a2b90de8e323 None None] MFA Rules not processed for user `601aa9e547aa4d42bef6753b26f48eaa`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:27:44.159470 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-40023e24-ea3e-41b1-9c54-a2b90de8e323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:44.167618 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1224/2435] 10.222.0.47 () {58 vars in 1009 bytes} [Wed Aug 31 00:27:44 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:27:44.209518 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fc7ce9-94e3-46ac-9ac1-8e0a3ab1b54e service neutron] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:44.235434 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fc7ce9-94e3-46ac-9ac1-8e0a3ab1b54e service neutron] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:44.263871 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a2b96f-3e19-46fe-a869-4c25f901214d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffbfbf19509645f49dbf9566e447c8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:44.265429 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a2b96f-3e19-46fe-a869-4c25f901214d service swift] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:44.265618 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a2b96f-3e19-46fe-a869-4c25f901214d service swift] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:44.265963 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a2b96f-3e19-46fe-a869-4c25f901214d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:44.286230 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a2b96f-3e19-46fe-a869-4c25f901214d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:44.289945 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a2b96f-3e19-46fe-a869-4c25f901214d service swift] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:44.323366 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1212/2436] 10.222.0.47 () {60 vars in 1384 bytes} [Wed Aug 31 00:27:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 00:27:47.432006 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40023e24-ea3e-41b1-9c54-a2b90de8e323 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:47.434366 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-40023e24-ea3e-41b1-9c54-a2b90de8e323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:47.454900 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a2b96f-3e19-46fe-a869-4c25f901214d service swift] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:47.456799 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:27:47.460267 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-23a2b96f-3e19-46fe-a869-4c25f901214d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:47.516458 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a2b96f-3e19-46fe-a869-4c25f901214d service swift] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:47.540140 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02149bd2-6224-4e05-aed9-313e1d7a4af5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:47.540140 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02149bd2-6224-4e05-aed9-313e1d7a4af5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:47.544336 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02149bd2-6224-4e05-aed9-313e1d7a4af5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:47.546123 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02149bd2-6224-4e05-aed9-313e1d7a4af5 admin admin] PATH_INFO: `/v3/users/bc018a253e0a4b0bb96097ce4cc72c21` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:47.553428 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02149bd2-6224-4e05-aed9-313e1d7a4af5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc018a253e0a4b0bb96097ce4cc72c21)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:47.555667 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02149bd2-6224-4e05-aed9-313e1d7a4af5 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:47.658848 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-02149bd2-6224-4e05-aed9-313e1d7a4af5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc018a253e0a4b0bb96097ce4cc72c21'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:47.671592 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-02149bd2-6224-4e05-aed9-313e1d7a4af5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc018a253e0a4b0bb96097ce4cc72c21'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:47.683173 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40023e24-ea3e-41b1-9c54-a2b90de8e323 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:47.686529 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-02149bd2-6224-4e05-aed9-313e1d7a4af5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc018a253e0a4b0bb96097ce4cc72c21'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:47.690896 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db828331-7d11-40bd-af2e-9137c053f82d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f76e01e32264ff7a6a7740ffa0a207d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:47.691817 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db828331-7d11-40bd-af2e-9137c053f82d service placement] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:47.692298 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db828331-7d11-40bd-af2e-9137c053f82d service placement] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:47.693047 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db828331-7d11-40bd-af2e-9137c053f82d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:47.695956 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-db828331-7d11-40bd-af2e-9137c053f82d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:47.712807 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db828331-7d11-40bd-af2e-9137c053f82d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:47.715387 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db828331-7d11-40bd-af2e-9137c053f82d service placement] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:47.735848 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-02149bd2-6224-4e05-aed9-313e1d7a4af5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc018a253e0a4b0bb96097ce4cc72c21'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:47.739009 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-02149bd2-6224-4e05-aed9-313e1d7a4af5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc018a253e0a4b0bb96097ce4cc72c21'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:47.744136 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1225/2437] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:27:47 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 00:27:47.759916 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1213/2438] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 31 00:27:47 2022] DELETE /identity/v3/users/bc018a253e0a4b0bb96097ce4cc72c21 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:27:48.270934 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db828331-7d11-40bd-af2e-9137c053f82d service placement] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:48.333179 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db828331-7d11-40bd-af2e-9137c053f82d service placement] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:48.519006 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061332c1-ada6-4412-a6e7-d90652e03571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:48.519931 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061332c1-ada6-4412-a6e7-d90652e03571 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:48.520672 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061332c1-ada6-4412-a6e7-d90652e03571 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:48.521104 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061332c1-ada6-4412-a6e7-d90652e03571 admin admin] PATH_INFO: `/v3/projects/5d71e648b9ff42fb8b29beabe01a5512` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:48.526541 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061332c1-ada6-4412-a6e7-d90652e03571 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d71e648b9ff42fb8b29beabe01a5512)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:48.531173 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061332c1-ada6-4412-a6e7-d90652e03571 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:48.627624 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-061332c1-ada6-4412-a6e7-d90652e03571 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d71e648b9ff42fb8b29beabe01a5512', 'request_id': 'req-061332c1-ada6-4412-a6e7-d90652e03571'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:48.638753 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-061332c1-ada6-4412-a6e7-d90652e03571 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d71e648b9ff42fb8b29beabe01a5512', 'request_id': 'req-061332c1-ada6-4412-a6e7-d90652e03571'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:48.651325 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-061332c1-ada6-4412-a6e7-d90652e03571 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d71e648b9ff42fb8b29beabe01a5512', 'request_id': 'req-061332c1-ada6-4412-a6e7-d90652e03571'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:48.674288 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-061332c1-ada6-4412-a6e7-d90652e03571 admin admin] The token cache is being invalidate because project 5d71e648b9ff42fb8b29beabe01a5512 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:27:48.674880 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-061332c1-ada6-4412-a6e7-d90652e03571 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:48.675742 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-061332c1-ada6-4412-a6e7-d90652e03571 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:27:48.677881 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1226/2439] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 31 00:27:48 2022] DELETE /identity/v3/projects/5d71e648b9ff42fb8b29beabe01a5512 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:27:48.688515 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad9e7a4-feba-4d9f-b94a-8735507c6158 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:48.689567 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad9e7a4-feba-4d9f-b94a-8735507c6158 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:48.690074 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad9e7a4-feba-4d9f-b94a-8735507c6158 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:48.726425 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-6ad9e7a4-feba-4d9f-b94a-8735507c6158 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:27:48.728519 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-6ad9e7a4-feba-4d9f-b94a-8735507c6158 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:48.736484 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:27:48.890807 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1214/2440] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:27:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:27:48.908067 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf148b8a-d373-41d3-b4d2-819cce731b16 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:48.908399 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf148b8a-d373-41d3-b4d2-819cce731b16 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:48.908664 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf148b8a-d373-41d3-b4d2-819cce731b16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:48.944186 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-cf148b8a-d373-41d3-b4d2-819cce731b16 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:27:48.945632 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-cf148b8a-d373-41d3-b4d2-819cce731b16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:48.971366 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1227/2441] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:27:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:27:48.980227 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad9e7a4-feba-4d9f-b94a-8735507c6158 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:49.072698 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad9e7a4-feba-4d9f-b94a-8735507c6158 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:49.079862 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a10fa3-f492-4f46-90fe-80fad2c91114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:49.080612 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a10fa3-f492-4f46-90fe-80fad2c91114 admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:49.080904 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a10fa3-f492-4f46-90fe-80fad2c91114 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:49.081172 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a10fa3-f492-4f46-90fe-80fad2c91114 admin admin] PATH_INFO: `/v3/domains` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:49.081986 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a10fa3-f492-4f46-90fe-80fad2c91114 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:27:49.082406 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a10fa3-f492-4f46-90fe-80fad2c91114 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:49.084381 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a10fa3-f492-4f46-90fe-80fad2c91114 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:49.109409 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1215/2442] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 31 00:27:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:27:49.115566 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf148b8a-d373-41d3-b4d2-819cce731b16 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:49.126615 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf148b8a-d373-41d3-b4d2-819cce731b16 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:49.132787 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552ac5b4-b409-4ed9-98a2-6049a9e743d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:49.133661 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552ac5b4-b409-4ed9-98a2-6049a9e743d1 admin admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:49.134045 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552ac5b4-b409-4ed9-98a2-6049a9e743d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:49.134433 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552ac5b4-b409-4ed9-98a2-6049a9e743d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:49.137179 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552ac5b4-b409-4ed9-98a2-6049a9e743d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:49.143652 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552ac5b4-b409-4ed9-98a2-6049a9e743d1 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:49.187954 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:27:49.216403 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1228/2443] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 31 00:27:49 2022] POST /identity/v3/projects => generated 371 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:27:49.222699 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a10fa3-f492-4f46-90fe-80fad2c91114 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:49.254746 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a10fa3-f492-4f46-90fe-80fad2c91114 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:49.410739 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4590357c-0f1c-4aa8-9e30-8f1f17481c18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:49.410739 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4590357c-0f1c-4aa8-9e30-8f1f17481c18 admin admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:49.410739 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4590357c-0f1c-4aa8-9e30-8f1f17481c18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:49.410739 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4590357c-0f1c-4aa8-9e30-8f1f17481c18 admin admin] PATH_INFO: `/v3/users` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:49.411670 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4590357c-0f1c-4aa8-9e30-8f1f17481c18 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:49.411670 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4590357c-0f1c-4aa8-9e30-8f1f17481c18 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:49.484199 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1216/2444] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 31 00:27:49 2022] POST /identity/v3/users => generated 286 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:27:49.492200 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552ac5b4-b409-4ed9-98a2-6049a9e743d1 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:49.521691 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552ac5b4-b409-4ed9-98a2-6049a9e743d1 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:49.535882 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10b56aa-e717-4d01-bd2f-ef72eb1814d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:49.538835 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10b56aa-e717-4d01-bd2f-ef72eb1814d1 admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:49.540552 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10b56aa-e717-4d01-bd2f-ef72eb1814d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:49.542335 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10b56aa-e717-4d01-bd2f-ef72eb1814d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:49.543734 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10b56aa-e717-4d01-bd2f-ef72eb1814d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:49.548748 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10b56aa-e717-4d01-bd2f-ef72eb1814d1 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:49.577058 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1229/2445] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 00:27:49 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 00:27:49.583152 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4590357c-0f1c-4aa8-9e30-8f1f17481c18 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:49.599429 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4590357c-0f1c-4aa8-9e30-8f1f17481c18 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:49.605516 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fa65aa-aeaa-49a6-b476-1190eb728d5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:49.613415 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fa65aa-aeaa-49a6-b476-1190eb728d5c admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:49.615046 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fa65aa-aeaa-49a6-b476-1190eb728d5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:49.617187 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fa65aa-aeaa-49a6-b476-1190eb728d5c admin admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:49.618106 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fa65aa-aeaa-49a6-b476-1190eb728d5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:49.620460 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fa65aa-aeaa-49a6-b476-1190eb728d5c admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:49.658562 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1217/2446] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 00:27:49 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 00:27:49.665076 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10b56aa-e717-4d01-bd2f-ef72eb1814d1 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:49.685748 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10b56aa-e717-4d01-bd2f-ef72eb1814d1 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:49.696331 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6921d1be-829a-4508-bab6-407905c8884d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:49.697595 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6921d1be-829a-4508-bab6-407905c8884d admin admin] REQUEST_METHOD: `PUT` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:49.697595 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6921d1be-829a-4508-bab6-407905c8884d admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:49.697977 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6921d1be-829a-4508-bab6-407905c8884d admin admin] PATH_INFO: `/v3/projects/36798c2474c74c4f83a60e7cfddbc69b/users/7b74b618148d414ab44f226c1d752597/roles/fdad79ffbcbb4fa380dc9cf7dd108618` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:49.747486 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6921d1be-829a-4508-bab6-407905c8884d admin admin] RBAC: Authorizing `identity:create_grant(project_id=36798c2474c74c4f83a60e7cfddbc69b, user_id=7b74b618148d414ab44f226c1d752597, role_id=fdad79ffbcbb4fa380dc9cf7dd108618)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:49.757254 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6921d1be-829a-4508-bab6-407905c8884d admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:49.801579 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1230/2447] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 00:27:49 2022] PUT /identity/v3/projects/36798c2474c74c4f83a60e7cfddbc69b/users/7b74b618148d414ab44f226c1d752597/roles/fdad79ffbcbb4fa380dc9cf7dd108618 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:27:49.822234 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0926534-383a-4c57-b0bb-a5a5887a616d None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:49.823193 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0926534-383a-4c57-b0bb-a5a5887a616d None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:49.823193 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0926534-383a-4c57-b0bb-a5a5887a616d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:49.923592 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-c0926534-383a-4c57-b0bb-a5a5887a616d None None] MFA Rules not processed for user `7b74b618148d414ab44f226c1d752597`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:27:49.926198 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-c0926534-383a-4c57-b0bb-a5a5887a616d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:50.169613 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1218/2448] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:27:49 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 348 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:27:50.174789 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6921d1be-829a-4508-bab6-407905c8884d admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:50.283966 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6921d1be-829a-4508-bab6-407905c8884d admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:50.290621 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a707b17b-b182-426a-83dc-49c075234443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:50.291289 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a707b17b-b182-426a-83dc-49c075234443 admin admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:50.291530 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a707b17b-b182-426a-83dc-49c075234443 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:50.291797 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a707b17b-b182-426a-83dc-49c075234443 admin admin] PATH_INFO: `/v3/projects` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:50.292525 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a707b17b-b182-426a-83dc-49c075234443 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:50.295484 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a707b17b-b182-426a-83dc-49c075234443 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:50.345659 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0926534-383a-4c57-b0bb-a5a5887a616d None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:50.354487 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:27:50.354746 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1231/2449] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 31 00:27:50 2022] POST /identity/v3/projects => generated 371 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:27:50.377446 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0926534-383a-4c57-b0bb-a5a5887a616d None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:50.674733 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa65289d-aad3-4838-a2cc-05ee41a4ac79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:50.683583 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa65289d-aad3-4838-a2cc-05ee41a4ac79 admin admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:50.684091 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa65289d-aad3-4838-a2cc-05ee41a4ac79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:50.685733 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa65289d-aad3-4838-a2cc-05ee41a4ac79 admin admin] PATH_INFO: `/v3/users` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:50.686735 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa65289d-aad3-4838-a2cc-05ee41a4ac79 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:50.694652 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa65289d-aad3-4838-a2cc-05ee41a4ac79 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:50.769848 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1219/2450] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 31 00:27:50 2022] POST /identity/v3/users => generated 292 bytes in 425 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:27:50.775705 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a707b17b-b182-426a-83dc-49c075234443 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:50.854231 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a707b17b-b182-426a-83dc-49c075234443 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:50.889343 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c80d77d-2808-44d2-889c-75b10ed96cd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:50.890420 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c80d77d-2808-44d2-889c-75b10ed96cd4 admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:50.901784 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c80d77d-2808-44d2-889c-75b10ed96cd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:50.902463 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c80d77d-2808-44d2-889c-75b10ed96cd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:50.903907 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c80d77d-2808-44d2-889c-75b10ed96cd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:50.913239 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c80d77d-2808-44d2-889c-75b10ed96cd4 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:51.007366 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1232/2451] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 00:27:50 2022] GET /identity/v3/roles => generated 1420 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:27:51.015044 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa65289d-aad3-4838-a2cc-05ee41a4ac79 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:51.066112 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa65289d-aad3-4838-a2cc-05ee41a4ac79 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:51.096346 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029d5b7b-6984-4eda-92d5-bcac0d81dd57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:51.100344 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029d5b7b-6984-4eda-92d5-bcac0d81dd57 admin admin] REQUEST_METHOD: `PUT` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:51.112406 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029d5b7b-6984-4eda-92d5-bcac0d81dd57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:51.112406 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029d5b7b-6984-4eda-92d5-bcac0d81dd57 admin admin] PATH_INFO: `/v3/projects/e2e46200a4104bd6b966b4196526288a/users/aff5f1db14834f02ac3a2a157d37c024/roles/12f6817f9aaa4e2bb477095a6bed5d0f` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:51.174400 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029d5b7b-6984-4eda-92d5-bcac0d81dd57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2e46200a4104bd6b966b4196526288a, user_id=aff5f1db14834f02ac3a2a157d37c024, role_id=12f6817f9aaa4e2bb477095a6bed5d0f)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:51.192966 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029d5b7b-6984-4eda-92d5-bcac0d81dd57 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:51.250250 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1220/2452] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 00:27:51 2022] PUT /identity/v3/projects/e2e46200a4104bd6b966b4196526288a/users/aff5f1db14834f02ac3a2a157d37c024/roles/12f6817f9aaa4e2bb477095a6bed5d0f => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:27:51.252473 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c80d77d-2808-44d2-889c-75b10ed96cd4 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:51.281106 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c80d77d-2808-44d2-889c-75b10ed96cd4 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:51.559987 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ce0060-bfc1-43b5-bc82-c9327edf7543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:51.560686 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ce0060-bfc1-43b5-bc82-c9327edf7543 admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:51.561064 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ce0060-bfc1-43b5-bc82-c9327edf7543 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:51.561277 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ce0060-bfc1-43b5-bc82-c9327edf7543 admin admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:51.561917 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ce0060-bfc1-43b5-bc82-c9327edf7543 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:51.563598 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ce0060-bfc1-43b5-bc82-c9327edf7543 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:51.593899 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1233/2453] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 00:27:51 2022] GET /identity/v3/roles => generated 1420 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:27:51.600316 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029d5b7b-6984-4eda-92d5-bcac0d81dd57 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:51.650609 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029d5b7b-6984-4eda-92d5-bcac0d81dd57 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:51.670978 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d79741c-cc04-4537-aa9a-f44af236bc21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:51.673961 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d79741c-cc04-4537-aa9a-f44af236bc21 admin admin] REQUEST_METHOD: `PUT` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:51.674449 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d79741c-cc04-4537-aa9a-f44af236bc21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:51.674919 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d79741c-cc04-4537-aa9a-f44af236bc21 admin admin] PATH_INFO: `/v3/projects/e2e46200a4104bd6b966b4196526288a/users/aff5f1db14834f02ac3a2a157d37c024/roles/12f6817f9aaa4e2bb477095a6bed5d0f` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:51.686299 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d79741c-cc04-4537-aa9a-f44af236bc21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2e46200a4104bd6b966b4196526288a, user_id=aff5f1db14834f02ac3a2a157d37c024, role_id=12f6817f9aaa4e2bb477095a6bed5d0f)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:51.708062 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d79741c-cc04-4537-aa9a-f44af236bc21 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:51.800813 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1221/2454] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 00:27:51 2022] PUT /identity/v3/projects/e2e46200a4104bd6b966b4196526288a/users/aff5f1db14834f02ac3a2a157d37c024/roles/12f6817f9aaa4e2bb477095a6bed5d0f => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:27:51.821711 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77f11a8-8da2-48c8-932f-5d6c6902527d None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:51.824087 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77f11a8-8da2-48c8-932f-5d6c6902527d None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:51.824781 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77f11a8-8da2-48c8-932f-5d6c6902527d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:51.934420 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-b77f11a8-8da2-48c8-932f-5d6c6902527d None None] MFA Rules not processed for user `aff5f1db14834f02ac3a2a157d37c024`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:27:51.937601 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-b77f11a8-8da2-48c8-932f-5d6c6902527d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:52.057360 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:27:52.224310 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1234/2455] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:27:51 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 406 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:27:52.246672 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d79741c-cc04-4537-aa9a-f44af236bc21 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:52.250934 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-5d79741c-cc04-4537-aa9a-f44af236bc21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:52.401067 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d79741c-cc04-4537-aa9a-f44af236bc21 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:52.407879 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658bcc10-7c1a-4c72-bac7-bd7b4e271dc0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beecda6e9feb400288618745c784989f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:52.408752 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658bcc10-7c1a-4c72-bac7-bd7b4e271dc0 service cinder] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:52.409208 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658bcc10-7c1a-4c72-bac7-bd7b4e271dc0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:52.409520 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658bcc10-7c1a-4c72-bac7-bd7b4e271dc0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:52.454702 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658bcc10-7c1a-4c72-bac7-bd7b4e271dc0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:52.458133 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658bcc10-7c1a-4c72-bac7-bd7b4e271dc0 service cinder] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:52.508367 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1222/2456] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:27:52 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 00:27:52.710088 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77f11a8-8da2-48c8-932f-5d6c6902527d None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:52.726943 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77f11a8-8da2-48c8-932f-5d6c6902527d None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:52.732103 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982b9e1e-1b2a-4fd0-a3ef-898f0771335b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beecda6e9feb400288618745c784989f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:52.733209 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982b9e1e-1b2a-4fd0-a3ef-898f0771335b service cinder] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:52.733533 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982b9e1e-1b2a-4fd0-a3ef-898f0771335b service cinder] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:52.733834 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982b9e1e-1b2a-4fd0-a3ef-898f0771335b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:52.832111 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982b9e1e-1b2a-4fd0-a3ef-898f0771335b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:52.834011 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982b9e1e-1b2a-4fd0-a3ef-898f0771335b service cinder] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:52.848561 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1235/2457] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:27:52 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:27:53.109520 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72937333-bc05-40cb-9881-15bd3c53386c None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:53.110024 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72937333-bc05-40cb-9881-15bd3c53386c None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:53.110515 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72937333-bc05-40cb-9881-15bd3c53386c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:53.184906 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-72937333-bc05-40cb-9881-15bd3c53386c None None] MFA Rules not processed for user `cacf8da1fc48427eacc993769c4f9f3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:27:53.195886 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-72937333-bc05-40cb-9881-15bd3c53386c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:53.354181 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1223/2458] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:27:53 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:28:02.737759 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a504830-41d3-42ca-a8a2-29da4821476b None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:02.738790 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a504830-41d3-42ca-a8a2-29da4821476b None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:02.738790 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a504830-41d3-42ca-a8a2-29da4821476b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:02.761808 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-8a504830-41d3-42ca-a8a2-29da4821476b None None] MFA Rules not processed for user `601aa9e547aa4d42bef6753b26f48eaa`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:28:02.763493 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-8a504830-41d3-42ca-a8a2-29da4821476b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:28:02.859383 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1236/2459] 10.222.0.47 () {58 vars in 1009 bytes} [Wed Aug 31 00:28:02 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:28:02.877462 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72937333-bc05-40cb-9881-15bd3c53386c None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:02.879133 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-72937333-bc05-40cb-9881-15bd3c53386c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:28:02.886561 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:28:03.020868 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72937333-bc05-40cb-9881-15bd3c53386c None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:03.032393 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb92d44-9ac6-4be5-ad04-1e1d9e30ea3c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffbfbf19509645f49dbf9566e447c8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:03.033247 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb92d44-9ac6-4be5-ad04-1e1d9e30ea3c service swift] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:03.033681 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb92d44-9ac6-4be5-ad04-1e1d9e30ea3c service swift] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:03.034159 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb92d44-9ac6-4be5-ad04-1e1d9e30ea3c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:03.051004 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb92d44-9ac6-4be5-ad04-1e1d9e30ea3c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:03.053254 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb92d44-9ac6-4be5-ad04-1e1d9e30ea3c service swift] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:03.068275 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1224/2460] 10.222.0.47 () {60 vars in 1384 bytes} [Wed Aug 31 00:28:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 31 00:28:12.849468 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=72 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:28:13.062681 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=30 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:28:14.887340 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e056106-ff66-4008-8ea4-c1b1d9b901aa None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:14.888135 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e056106-ff66-4008-8ea4-c1b1d9b901aa None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:14.888377 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e056106-ff66-4008-8ea4-c1b1d9b901aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:14.979120 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-1e056106-ff66-4008-8ea4-c1b1d9b901aa None None] MFA Rules not processed for user `601aa9e547aa4d42bef6753b26f48eaa`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:28:14.982943 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-1e056106-ff66-4008-8ea4-c1b1d9b901aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:28:15.060583 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1237/2461] 10.222.0.47 () {58 vars in 967 bytes} [Wed Aug 31 00:28:14 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:28:15.086255 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb92d44-9ac6-4be5-ad04-1e1d9e30ea3c service swift] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:15.143961 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb92d44-9ac6-4be5-ad04-1e1d9e30ea3c service swift] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:15.150402 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129ea09f-88de-409f-8e3b-a1957ae24581 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffbfbf19509645f49dbf9566e447c8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:15.151278 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129ea09f-88de-409f-8e3b-a1957ae24581 service swift] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:15.151609 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129ea09f-88de-409f-8e3b-a1957ae24581 service swift] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:15.152668 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129ea09f-88de-409f-8e3b-a1957ae24581 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:15.163904 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129ea09f-88de-409f-8e3b-a1957ae24581 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:15.165531 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129ea09f-88de-409f-8e3b-a1957ae24581 service swift] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:15.175576 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1225/2462] 10.222.0.47 () {60 vars in 1384 bytes} [Wed Aug 31 00:28:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 00:28:16.494270 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e056106-ff66-4008-8ea4-c1b1d9b901aa None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:16.499381 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-1e056106-ff66-4008-8ea4-c1b1d9b901aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:28:16.714316 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e056106-ff66-4008-8ea4-c1b1d9b901aa None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:16.734582 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716de312-3fe7-4d7c-b577-92b91b80df48 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f76e01e32264ff7a6a7740ffa0a207d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:16.736196 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716de312-3fe7-4d7c-b577-92b91b80df48 service placement] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:16.736912 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716de312-3fe7-4d7c-b577-92b91b80df48 service placement] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:16.737666 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716de312-3fe7-4d7c-b577-92b91b80df48 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:16.741437 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-716de312-3fe7-4d7c-b577-92b91b80df48 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:28:16.761287 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716de312-3fe7-4d7c-b577-92b91b80df48 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:16.764674 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716de312-3fe7-4d7c-b577-92b91b80df48 service placement] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:16.786668 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1238/2463] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:28:16 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:28:25.171308 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=20 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:28:26.775626 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=64 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:28:38.643577 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129ea09f-88de-409f-8e3b-a1957ae24581 service swift] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:38.645512 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-129ea09f-88de-409f-8e3b-a1957ae24581 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:28:38.767153 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129ea09f-88de-409f-8e3b-a1957ae24581 service swift] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:38.771363 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9a6ba6-2c94-4311-8cf4-764e8e654581 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'daae792cd11d4c4ca7aae0558998aced', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:38.772204 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9a6ba6-2c94-4311-8cf4-764e8e654581 service neutron] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:38.772758 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9a6ba6-2c94-4311-8cf4-764e8e654581 service neutron] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:38.773047 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9a6ba6-2c94-4311-8cf4-764e8e654581 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:38.775661 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-1d9a6ba6-2c94-4311-8cf4-764e8e654581 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:28:38.893661 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9a6ba6-2c94-4311-8cf4-764e8e654581 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:38.895157 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9a6ba6-2c94-4311-8cf4-764e8e654581 service neutron] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:38.922316 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1226/2464] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:28:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:28:40.500121 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716de312-3fe7-4d7c-b577-92b91b80df48 service placement] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:40.521182 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716de312-3fe7-4d7c-b577-92b91b80df48 service placement] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:40.530463 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdb0cf8-c04e-4f4c-b00c-a052d2f01a67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:40.531708 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdb0cf8-c04e-4f4c-b00c-a052d2f01a67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:40.532376 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdb0cf8-c04e-4f4c-b00c-a052d2f01a67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:40.532878 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdb0cf8-c04e-4f4c-b00c-a052d2f01a67 admin admin] PATH_INFO: `/v3/users/7b74b618148d414ab44f226c1d752597` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:40.535140 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdb0cf8-c04e-4f4c-b00c-a052d2f01a67 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b74b618148d414ab44f226c1d752597)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:40.538570 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdb0cf8-c04e-4f4c-b00c-a052d2f01a67 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:40.603089 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-cbdb0cf8-c04e-4f4c-b00c-a052d2f01a67 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b74b618148d414ab44f226c1d752597'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:40.613021 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-cbdb0cf8-c04e-4f4c-b00c-a052d2f01a67 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b74b618148d414ab44f226c1d752597'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:40.626067 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-cbdb0cf8-c04e-4f4c-b00c-a052d2f01a67 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b74b618148d414ab44f226c1d752597'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:40.627177 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-cbdb0cf8-c04e-4f4c-b00c-a052d2f01a67 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b74b618148d414ab44f226c1d752597'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:40.647036 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-cbdb0cf8-c04e-4f4c-b00c-a052d2f01a67 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b74b618148d414ab44f226c1d752597'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:40.660986 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1239/2465] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 31 00:28:40 2022] DELETE /identity/v3/users/7b74b618148d414ab44f226c1d752597 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:28:40.666825 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7448530-c7fe-48e5-a610-67ec9cfbd261 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:40.667790 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7448530-c7fe-48e5-a610-67ec9cfbd261 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:40.668131 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7448530-c7fe-48e5-a610-67ec9cfbd261 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:40.711633 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-c7448530-c7fe-48e5-a610-67ec9cfbd261 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:28:40.713067 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-c7448530-c7fe-48e5-a610-67ec9cfbd261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:28:40.828398 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:28:40.856782 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1227/2466] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:28:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:28:40.874108 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdb0cf8-c04e-4f4c-b00c-a052d2f01a67 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:40.877750 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-cbdb0cf8-c04e-4f4c-b00c-a052d2f01a67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:28:41.018484 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdb0cf8-c04e-4f4c-b00c-a052d2f01a67 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:41.026778 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30c369f-a54b-4edb-a839-e1b2c9b7eb86 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'daae792cd11d4c4ca7aae0558998aced', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:41.028064 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30c369f-a54b-4edb-a839-e1b2c9b7eb86 service neutron] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:41.029305 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30c369f-a54b-4edb-a839-e1b2c9b7eb86 service neutron] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:41.029305 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30c369f-a54b-4edb-a839-e1b2c9b7eb86 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:41.049276 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30c369f-a54b-4edb-a839-e1b2c9b7eb86 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:41.052993 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30c369f-a54b-4edb-a839-e1b2c9b7eb86 service neutron] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:41.074511 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1240/2467] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:28:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 00:28:41.699163 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7448530-c7fe-48e5-a610-67ec9cfbd261 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:41.701956 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-c7448530-c7fe-48e5-a610-67ec9cfbd261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:28:41.716653 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7448530-c7fe-48e5-a610-67ec9cfbd261 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:41.729409 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299c86a5-59d3-4081-8ab3-371e74f9ed61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:41.731498 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299c86a5-59d3-4081-8ab3-371e74f9ed61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:41.732582 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299c86a5-59d3-4081-8ab3-371e74f9ed61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:41.733299 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299c86a5-59d3-4081-8ab3-371e74f9ed61 admin admin] PATH_INFO: `/v3/projects/36798c2474c74c4f83a60e7cfddbc69b` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:41.735941 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299c86a5-59d3-4081-8ab3-371e74f9ed61 admin admin] RBAC: Authorizing `identity:delete_project(project_id=36798c2474c74c4f83a60e7cfddbc69b)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:41.739713 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299c86a5-59d3-4081-8ab3-371e74f9ed61 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:41.820931 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-299c86a5-59d3-4081-8ab3-371e74f9ed61 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36798c2474c74c4f83a60e7cfddbc69b', 'request_id': 'req-299c86a5-59d3-4081-8ab3-371e74f9ed61'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:41.829681 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-299c86a5-59d3-4081-8ab3-371e74f9ed61 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36798c2474c74c4f83a60e7cfddbc69b', 'request_id': 'req-299c86a5-59d3-4081-8ab3-371e74f9ed61'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:41.837048 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-299c86a5-59d3-4081-8ab3-371e74f9ed61 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36798c2474c74c4f83a60e7cfddbc69b', 'request_id': 'req-299c86a5-59d3-4081-8ab3-371e74f9ed61'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:41.854397 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-299c86a5-59d3-4081-8ab3-371e74f9ed61 admin admin] The token cache is being invalidate because project 36798c2474c74c4f83a60e7cfddbc69b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81523) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:28:41.855258 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-299c86a5-59d3-4081-8ab3-371e74f9ed61 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:41.855933 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-299c86a5-59d3-4081-8ab3-371e74f9ed61 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:41.857503 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1228/2468] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 31 00:28:41 2022] DELETE /identity/v3/projects/36798c2474c74c4f83a60e7cfddbc69b => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:28:41.861716 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30c369f-a54b-4edb-a839-e1b2c9b7eb86 service neutron] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:41.873522 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30c369f-a54b-4edb-a839-e1b2c9b7eb86 service neutron] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:42.053101 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0973da24-1865-4b81-90e5-2ef0b698e298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:42.054224 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0973da24-1865-4b81-90e5-2ef0b698e298 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:42.054720 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0973da24-1865-4b81-90e5-2ef0b698e298 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:42.056978 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0973da24-1865-4b81-90e5-2ef0b698e298 admin admin] PATH_INFO: `/v3/users/aff5f1db14834f02ac3a2a157d37c024` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:42.062143 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0973da24-1865-4b81-90e5-2ef0b698e298 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aff5f1db14834f02ac3a2a157d37c024)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:42.066307 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0973da24-1865-4b81-90e5-2ef0b698e298 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:42.099930 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:28:42.167155 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-0973da24-1865-4b81-90e5-2ef0b698e298 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aff5f1db14834f02ac3a2a157d37c024'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:42.191005 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-0973da24-1865-4b81-90e5-2ef0b698e298 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aff5f1db14834f02ac3a2a157d37c024'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:42.208098 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-0973da24-1865-4b81-90e5-2ef0b698e298 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aff5f1db14834f02ac3a2a157d37c024'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:42.209044 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-0973da24-1865-4b81-90e5-2ef0b698e298 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aff5f1db14834f02ac3a2a157d37c024'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:42.230527 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-0973da24-1865-4b81-90e5-2ef0b698e298 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aff5f1db14834f02ac3a2a157d37c024'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:42.245207 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1241/2469] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 31 00:28:41 2022] DELETE /identity/v3/users/aff5f1db14834f02ac3a2a157d37c024 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:28:42.758293 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299c86a5-59d3-4081-8ab3-371e74f9ed61 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:42.760440 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-299c86a5-59d3-4081-8ab3-371e74f9ed61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:28:42.816858 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299c86a5-59d3-4081-8ab3-371e74f9ed61 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:42.991087 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164d38e0-b44e-4347-9a9c-5104b749b943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:42.996244 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164d38e0-b44e-4347-9a9c-5104b749b943 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:42.997110 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164d38e0-b44e-4347-9a9c-5104b749b943 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:42.997615 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164d38e0-b44e-4347-9a9c-5104b749b943 admin admin] PATH_INFO: `/v3/projects/e2e46200a4104bd6b966b4196526288a` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:43.002781 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164d38e0-b44e-4347-9a9c-5104b749b943 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2e46200a4104bd6b966b4196526288a)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:43.006628 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164d38e0-b44e-4347-9a9c-5104b749b943 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:43.166013 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-164d38e0-b44e-4347-9a9c-5104b749b943 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2e46200a4104bd6b966b4196526288a', 'request_id': 'req-164d38e0-b44e-4347-9a9c-5104b749b943'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:43.180452 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-164d38e0-b44e-4347-9a9c-5104b749b943 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2e46200a4104bd6b966b4196526288a', 'request_id': 'req-164d38e0-b44e-4347-9a9c-5104b749b943'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:43.195718 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-164d38e0-b44e-4347-9a9c-5104b749b943 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2e46200a4104bd6b966b4196526288a', 'request_id': 'req-164d38e0-b44e-4347-9a9c-5104b749b943'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:43.220777 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-164d38e0-b44e-4347-9a9c-5104b749b943 admin admin] The token cache is being invalidate because project e2e46200a4104bd6b966b4196526288a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81523) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:28:43.221317 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-164d38e0-b44e-4347-9a9c-5104b749b943 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:43.222336 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-164d38e0-b44e-4347-9a9c-5104b749b943 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:43.227982 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1229/2470] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 31 00:28:42 2022] DELETE /identity/v3/projects/e2e46200a4104bd6b966b4196526288a => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:28:43.230086 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12377247-ede1-46d8-a0b9-a7c27349d359 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:43.236461 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12377247-ede1-46d8-a0b9-a7c27349d359 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:43.237142 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12377247-ede1-46d8-a0b9-a7c27349d359 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:43.316332 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-12377247-ede1-46d8-a0b9-a7c27349d359 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:28:43.318750 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-12377247-ede1-46d8-a0b9-a7c27349d359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:28:43.349683 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164d38e0-b44e-4347-9a9c-5104b749b943 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:43.351265 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-164d38e0-b44e-4347-9a9c-5104b749b943 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:28:43.379163 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:28:43.408668 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1242/2471] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:28:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:28:43.419445 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14b0168-161c-4bc0-afec-fa9765834632 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:43.419933 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14b0168-161c-4bc0-afec-fa9765834632 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:43.421399 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14b0168-161c-4bc0-afec-fa9765834632 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:43.458683 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-f14b0168-161c-4bc0-afec-fa9765834632 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:28:43.460919 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-f14b0168-161c-4bc0-afec-fa9765834632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:28:43.476010 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1243/2472] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:28:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:28:43.476389 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164d38e0-b44e-4347-9a9c-5104b749b943 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:43.481157 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14b0168-161c-4bc0-afec-fa9765834632 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:43.483093 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8837c339-5fc5-46ee-998f-e2a5afb340f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:43.484181 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8837c339-5fc5-46ee-998f-e2a5afb340f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:43.484677 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8837c339-5fc5-46ee-998f-e2a5afb340f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:43.484956 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8837c339-5fc5-46ee-998f-e2a5afb340f0 admin admin] PATH_INFO: `/v3/users/b3da9d7af0fd4c1d99973e6b277b16d2` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:43.486196 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8837c339-5fc5-46ee-998f-e2a5afb340f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3da9d7af0fd4c1d99973e6b277b16d2)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:43.490027 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8837c339-5fc5-46ee-998f-e2a5afb340f0 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:43.500611 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14b0168-161c-4bc0-afec-fa9765834632 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:43.511845 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28471b3c-366f-4617-af49-b521b66e76ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:43.513092 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28471b3c-366f-4617-af49-b521b66e76ec admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:43.513686 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28471b3c-366f-4617-af49-b521b66e76ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:43.514283 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28471b3c-366f-4617-af49-b521b66e76ec admin admin] PATH_INFO: `/v3/domains` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:43.515604 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28471b3c-366f-4617-af49-b521b66e76ec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:28:43.516266 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28471b3c-366f-4617-af49-b521b66e76ec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:43.519662 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28471b3c-366f-4617-af49-b521b66e76ec admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:43.551762 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1244/2473] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 31 00:28:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:28:43.553501 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28471b3c-366f-4617-af49-b521b66e76ec admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:43.560537 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-8837c339-5fc5-46ee-998f-e2a5afb340f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3da9d7af0fd4c1d99973e6b277b16d2'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:43.573924 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28471b3c-366f-4617-af49-b521b66e76ec admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:43.575745 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-8837c339-5fc5-46ee-998f-e2a5afb340f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3da9d7af0fd4c1d99973e6b277b16d2'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:43.583185 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed277d7b-4e4a-4a20-bca9-aabc415ecd69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:43.584274 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed277d7b-4e4a-4a20-bca9-aabc415ecd69 admin admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:43.584741 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed277d7b-4e4a-4a20-bca9-aabc415ecd69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:43.585377 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed277d7b-4e4a-4a20-bca9-aabc415ecd69 admin admin] PATH_INFO: `/v3/projects` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:43.586505 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed277d7b-4e4a-4a20-bca9-aabc415ecd69 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:43.591185 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed277d7b-4e4a-4a20-bca9-aabc415ecd69 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:43.593453 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-8837c339-5fc5-46ee-998f-e2a5afb340f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3da9d7af0fd4c1d99973e6b277b16d2'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:43.621458 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-8837c339-5fc5-46ee-998f-e2a5afb340f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3da9d7af0fd4c1d99973e6b277b16d2'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:43.623039 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-8837c339-5fc5-46ee-998f-e2a5afb340f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3da9d7af0fd4c1d99973e6b277b16d2'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:43.635419 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1230/2474] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 31 00:28:43 2022] DELETE /identity/v3/users/b3da9d7af0fd4c1d99973e6b277b16d2 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:28:43.639078 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1245/2475] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 31 00:28:43 2022] POST /identity/v3/projects => generated 379 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:28:43.645768 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8837c339-5fc5-46ee-998f-e2a5afb340f0 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:43.648936 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-8837c339-5fc5-46ee-998f-e2a5afb340f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:28:43.764565 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8837c339-5fc5-46ee-998f-e2a5afb340f0 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:43.819720 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:28:43.875259 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1872d5e2-01f5-4b35-bf89-893b61dd32ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:43.876341 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1872d5e2-01f5-4b35-bf89-893b61dd32ac admin admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:43.876829 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1872d5e2-01f5-4b35-bf89-893b61dd32ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:43.877330 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1872d5e2-01f5-4b35-bf89-893b61dd32ac admin admin] PATH_INFO: `/v3/users` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:43.879097 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1872d5e2-01f5-4b35-bf89-893b61dd32ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:43.883555 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1872d5e2-01f5-4b35-bf89-893b61dd32ac admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:43.905919 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed277d7b-4e4a-4a20-bca9-aabc415ecd69 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:43.909734 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-ed277d7b-4e4a-4a20-bca9-aabc415ecd69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:28:43.927003 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1231/2476] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 31 00:28:43 2022] POST /identity/v3/users => generated 290 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:28:43.933249 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1872d5e2-01f5-4b35-bf89-893b61dd32ac admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:43.953607 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1872d5e2-01f5-4b35-bf89-893b61dd32ac admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:43.954648 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed277d7b-4e4a-4a20-bca9-aabc415ecd69 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:43.961191 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f68e0c-589a-4d98-8f93-4ebbb5280977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:43.961994 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab48b13-b01a-45f3-a8cd-3ec469773336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:43.962431 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f68e0c-589a-4d98-8f93-4ebbb5280977 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:43.962632 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f68e0c-589a-4d98-8f93-4ebbb5280977 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:43.962921 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f68e0c-589a-4d98-8f93-4ebbb5280977 admin admin] PATH_INFO: `/v3/projects/dbe3f343119e4f10828c98ef17e8da5c` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:43.963108 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab48b13-b01a-45f3-a8cd-3ec469773336 admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:43.963383 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab48b13-b01a-45f3-a8cd-3ec469773336 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:43.963805 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab48b13-b01a-45f3-a8cd-3ec469773336 admin admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:43.964712 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f68e0c-589a-4d98-8f93-4ebbb5280977 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dbe3f343119e4f10828c98ef17e8da5c)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:43.965085 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab48b13-b01a-45f3-a8cd-3ec469773336 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:43.967037 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab48b13-b01a-45f3-a8cd-3ec469773336 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:43.967253 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f68e0c-589a-4d98-8f93-4ebbb5280977 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:43.987299 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1232/2477] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 00:28:43 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:28:43.988315 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab48b13-b01a-45f3-a8cd-3ec469773336 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:44.001678 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab48b13-b01a-45f3-a8cd-3ec469773336 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:44.007655 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c166901e-b411-47ce-9462-aa508418823c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:44.008501 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c166901e-b411-47ce-9462-aa508418823c admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:44.008760 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c166901e-b411-47ce-9462-aa508418823c admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:44.008915 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c166901e-b411-47ce-9462-aa508418823c admin admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:44.009644 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c166901e-b411-47ce-9462-aa508418823c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:44.009973 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:28:44.011685 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c166901e-b411-47ce-9462-aa508418823c admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:44.027021 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1233/2478] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 00:28:43 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:28:44.031404 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c166901e-b411-47ce-9462-aa508418823c admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:44.039614 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-82f68e0c-589a-4d98-8f93-4ebbb5280977 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dbe3f343119e4f10828c98ef17e8da5c', 'request_id': 'req-82f68e0c-589a-4d98-8f93-4ebbb5280977'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:44.043018 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c166901e-b411-47ce-9462-aa508418823c admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:44.048707 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-82f68e0c-589a-4d98-8f93-4ebbb5280977 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dbe3f343119e4f10828c98ef17e8da5c', 'request_id': 'req-82f68e0c-589a-4d98-8f93-4ebbb5280977'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:44.059004 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-82f68e0c-589a-4d98-8f93-4ebbb5280977 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dbe3f343119e4f10828c98ef17e8da5c', 'request_id': 'req-82f68e0c-589a-4d98-8f93-4ebbb5280977'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:44.085400 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-82f68e0c-589a-4d98-8f93-4ebbb5280977 admin admin] The token cache is being invalidate because project dbe3f343119e4f10828c98ef17e8da5c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:28:44.085400 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-82f68e0c-589a-4d98-8f93-4ebbb5280977 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:44.086092 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-82f68e0c-589a-4d98-8f93-4ebbb5280977 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:44.087312 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1246/2479] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 31 00:28:43 2022] DELETE /identity/v3/projects/dbe3f343119e4f10828c98ef17e8da5c => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:28:44.094367 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c50c70-f195-48fe-8478-c1bf5d31eb8f None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:44.094758 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c50c70-f195-48fe-8478-c1bf5d31eb8f None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:44.095038 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c50c70-f195-48fe-8478-c1bf5d31eb8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:44.118677 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-24c50c70-f195-48fe-8478-c1bf5d31eb8f None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:28:44.120263 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-24c50c70-f195-48fe-8478-c1bf5d31eb8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:28:44.131633 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cec2cdb-f2b9-4b84-9ebf-606052f816df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:44.132805 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cec2cdb-f2b9-4b84-9ebf-606052f816df admin admin] REQUEST_METHOD: `PUT` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:44.133217 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cec2cdb-f2b9-4b84-9ebf-606052f816df admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:44.133639 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cec2cdb-f2b9-4b84-9ebf-606052f816df admin admin] PATH_INFO: `/v3/projects/0720dbe824e54d28a1aac2a44883036f/users/06b57daba686490fb86733b526c3579f/roles/fdad79ffbcbb4fa380dc9cf7dd108618` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:44.160190 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cec2cdb-f2b9-4b84-9ebf-606052f816df admin admin] RBAC: Authorizing `identity:create_grant(project_id=0720dbe824e54d28a1aac2a44883036f, user_id=06b57daba686490fb86733b526c3579f, role_id=fdad79ffbcbb4fa380dc9cf7dd108618)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:44.167822 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cec2cdb-f2b9-4b84-9ebf-606052f816df admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:44.196756 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1234/2480] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 00:28:44 2022] PUT /identity/v3/projects/0720dbe824e54d28a1aac2a44883036f/users/06b57daba686490fb86733b526c3579f/roles/fdad79ffbcbb4fa380dc9cf7dd108618 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:28:44.209933 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1247/2481] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:28:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:28:44.212171 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520b8a01-055c-450b-b2ac-26fd927f5547 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:44.212771 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520b8a01-055c-450b-b2ac-26fd927f5547 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:44.213170 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520b8a01-055c-450b-b2ac-26fd927f5547 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:44.219713 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0195aa1-e5fb-452f-9e59-39e10a1fa1e3 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:44.220575 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0195aa1-e5fb-452f-9e59-39e10a1fa1e3 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:44.221255 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0195aa1-e5fb-452f-9e59-39e10a1fa1e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:44.252973 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-520b8a01-055c-450b-b2ac-26fd927f5547 None None] MFA Rules not processed for user `06b57daba686490fb86733b526c3579f`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:28:44.254899 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-520b8a01-055c-450b-b2ac-26fd927f5547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:28:44.258136 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-e0195aa1-e5fb-452f-9e59-39e10a1fa1e3 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:28:44.260014 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-e0195aa1-e5fb-452f-9e59-39e10a1fa1e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:28:44.344980 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1248/2482] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:28:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:28:44.350175 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0195aa1-e5fb-452f-9e59-39e10a1fa1e3 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:44.361749 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0195aa1-e5fb-452f-9e59-39e10a1fa1e3 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:44.366835 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2ba136-ec5a-4bbe-a343-7e2809a57c05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:44.367462 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2ba136-ec5a-4bbe-a343-7e2809a57c05 admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:44.367744 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2ba136-ec5a-4bbe-a343-7e2809a57c05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:44.368019 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2ba136-ec5a-4bbe-a343-7e2809a57c05 admin admin] PATH_INFO: `/v3/domains` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:44.368723 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2ba136-ec5a-4bbe-a343-7e2809a57c05 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:28:44.369177 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2ba136-ec5a-4bbe-a343-7e2809a57c05 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:44.371578 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2ba136-ec5a-4bbe-a343-7e2809a57c05 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:44.385569 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1235/2483] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:28:44 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:28:44.389796 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1249/2484] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 31 00:28:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:28:44.391815 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520b8a01-055c-450b-b2ac-26fd927f5547 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:44.394913 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-520b8a01-055c-450b-b2ac-26fd927f5547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:28:44.395861 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2ba136-ec5a-4bbe-a343-7e2809a57c05 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:44.411944 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2ba136-ec5a-4bbe-a343-7e2809a57c05 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:44.412315 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520b8a01-055c-450b-b2ac-26fd927f5547 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:44.417937 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e51dbd-93c7-4e79-a145-89d8da71cc81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:44.418500 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5248231-e99b-4263-ae03-a5c21594393e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:44.418696 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e51dbd-93c7-4e79-a145-89d8da71cc81 admin admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:44.418877 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e51dbd-93c7-4e79-a145-89d8da71cc81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:44.419157 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e51dbd-93c7-4e79-a145-89d8da71cc81 admin admin] PATH_INFO: `/v3/projects` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:44.419397 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5248231-e99b-4263-ae03-a5c21594393e admin admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:44.419781 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5248231-e99b-4263-ae03-a5c21594393e admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:44.420061 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5248231-e99b-4263-ae03-a5c21594393e admin admin] PATH_INFO: `/v3/projects` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:44.420808 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e51dbd-93c7-4e79-a145-89d8da71cc81 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:44.421010 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5248231-e99b-4263-ae03-a5c21594393e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:44.423159 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e51dbd-93c7-4e79-a145-89d8da71cc81 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:44.423413 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5248231-e99b-4263-ae03-a5c21594393e admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:44.443651 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:28:44.464208 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1250/2485] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 31 00:28:44 2022] POST /identity/v3/projects => generated 371 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:28:44.468722 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e51dbd-93c7-4e79-a145-89d8da71cc81 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:44.474254 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1236/2486] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 31 00:28:44 2022] POST /identity/v3/projects => generated 381 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:28:44.480277 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5248231-e99b-4263-ae03-a5c21594393e admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:44.497790 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=92,keystone:DELETE=6,keystone:INSERT=2 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:28:44.573325 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e51dbd-93c7-4e79-a145-89d8da71cc81 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:44.591746 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5248231-e99b-4263-ae03-a5c21594393e admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:44.599846 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ce4e97-4af5-42f0-aadb-67e3f4dadf49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:44.601038 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ce4e97-4af5-42f0-aadb-67e3f4dadf49 admin admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:44.601710 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ce4e97-4af5-42f0-aadb-67e3f4dadf49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:44.602161 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ce4e97-4af5-42f0-aadb-67e3f4dadf49 admin admin] PATH_INFO: `/v3/users` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:44.603364 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ce4e97-4af5-42f0-aadb-67e3f4dadf49 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:44.607775 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ce4e97-4af5-42f0-aadb-67e3f4dadf49 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:44.645406 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1237/2487] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 31 00:28:44 2022] POST /identity/v3/users => generated 297 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:28:44.649874 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ce4e97-4af5-42f0-aadb-67e3f4dadf49 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:44.661603 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ce4e97-4af5-42f0-aadb-67e3f4dadf49 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:44.673521 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daa087d-8125-45ea-850d-1c82f1c37155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:44.675305 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daa087d-8125-45ea-850d-1c82f1c37155 admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:44.675901 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daa087d-8125-45ea-850d-1c82f1c37155 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:44.677462 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daa087d-8125-45ea-850d-1c82f1c37155 admin admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:44.679324 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4daa087d-8125-45ea-850d-1c82f1c37155 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:44.683534 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4daa087d-8125-45ea-850d-1c82f1c37155 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:44.686257 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157262db-0a42-4014-84a4-98119525d754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:44.687336 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157262db-0a42-4014-84a4-98119525d754 admin admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:44.687887 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157262db-0a42-4014-84a4-98119525d754 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:44.688397 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157262db-0a42-4014-84a4-98119525d754 admin admin] PATH_INFO: `/v3/users` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:44.689506 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157262db-0a42-4014-84a4-98119525d754 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:44.693184 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157262db-0a42-4014-84a4-98119525d754 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:44.709412 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1238/2488] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 00:28:44 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 00:28:44.715035 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daa087d-8125-45ea-850d-1c82f1c37155 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:44.726925 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daa087d-8125-45ea-850d-1c82f1c37155 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:44.736763 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2699bc-a8c3-4508-9685-9fb788f1cb6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:44.738366 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2699bc-a8c3-4508-9685-9fb788f1cb6f admin admin] REQUEST_METHOD: `PUT` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:44.739103 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2699bc-a8c3-4508-9685-9fb788f1cb6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:44.739824 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1251/2489] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 31 00:28:44 2022] POST /identity/v3/users => generated 286 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:28:44.740223 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2699bc-a8c3-4508-9685-9fb788f1cb6f admin admin] PATH_INFO: `/v3/projects/e26bc71abc1947779299273898374dbb/users/fd102292c51c4a0596554f80eafec137/roles/12f6817f9aaa4e2bb477095a6bed5d0f` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:44.746297 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157262db-0a42-4014-84a4-98119525d754 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:44.766739 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157262db-0a42-4014-84a4-98119525d754 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:44.769631 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2699bc-a8c3-4508-9685-9fb788f1cb6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e26bc71abc1947779299273898374dbb, user_id=fd102292c51c4a0596554f80eafec137, role_id=12f6817f9aaa4e2bb477095a6bed5d0f)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:44.772861 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2699bc-a8c3-4508-9685-9fb788f1cb6f admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:44.774462 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cedeb8-5f17-423d-b9af-a82b269a4ed9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:44.775576 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cedeb8-5f17-423d-b9af-a82b269a4ed9 admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:44.776038 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cedeb8-5f17-423d-b9af-a82b269a4ed9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:44.777331 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cedeb8-5f17-423d-b9af-a82b269a4ed9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:44.778603 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cedeb8-5f17-423d-b9af-a82b269a4ed9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:44.781995 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cedeb8-5f17-423d-b9af-a82b269a4ed9 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:44.801540 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1239/2491] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 00:28:44 2022] PUT /identity/v3/projects/e26bc71abc1947779299273898374dbb/users/fd102292c51c4a0596554f80eafec137/roles/12f6817f9aaa4e2bb477095a6bed5d0f => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:28:44.804741 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1252/2491] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 00:28:44 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:28:44.806159 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2699bc-a8c3-4508-9685-9fb788f1cb6f admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:44.806718 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cedeb8-5f17-423d-b9af-a82b269a4ed9 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:44.817559 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cedeb8-5f17-423d-b9af-a82b269a4ed9 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:44.920044 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76537fb1-85e5-4f65-9dc0-00e1c91b94c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:44.920971 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76537fb1-85e5-4f65-9dc0-00e1c91b94c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:44.921365 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76537fb1-85e5-4f65-9dc0-00e1c91b94c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:44.921757 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76537fb1-85e5-4f65-9dc0-00e1c91b94c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:44.922526 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76537fb1-85e5-4f65-9dc0-00e1c91b94c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:44.924586 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76537fb1-85e5-4f65-9dc0-00e1c91b94c0 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:44.933682 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2699bc-a8c3-4508-9685-9fb788f1cb6f admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:44.939054 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1253/2492] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 00:28:44 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 00:28:44.939951 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76537fb1-85e5-4f65-9dc0-00e1c91b94c0 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:44.942389 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-76537fb1-85e5-4f65-9dc0-00e1c91b94c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:28:44.949496 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4b4bbe-d55d-49d9-893b-06bf115798e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:44.950679 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4b4bbe-d55d-49d9-893b-06bf115798e9 admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:44.951177 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4b4bbe-d55d-49d9-893b-06bf115798e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:44.951666 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4b4bbe-d55d-49d9-893b-06bf115798e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:44.952942 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4b4bbe-d55d-49d9-893b-06bf115798e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:44.956322 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4b4bbe-d55d-49d9-893b-06bf115798e9 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:44.978416 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1240/2493] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 00:28:44 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:28:44.980600 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4b4bbe-d55d-49d9-893b-06bf115798e9 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:45.002828 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4b4bbe-d55d-49d9-893b-06bf115798e9 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:45.011904 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30ed235-923b-42af-924a-2e4bd80dc55f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:45.013188 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30ed235-923b-42af-924a-2e4bd80dc55f admin admin] REQUEST_METHOD: `PUT` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:45.013728 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30ed235-923b-42af-924a-2e4bd80dc55f admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:45.014219 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30ed235-923b-42af-924a-2e4bd80dc55f admin admin] PATH_INFO: `/v3/projects/e26bc71abc1947779299273898374dbb/users/fd102292c51c4a0596554f80eafec137/roles/12f6817f9aaa4e2bb477095a6bed5d0f` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:45.018213 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30ed235-923b-42af-924a-2e4bd80dc55f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e26bc71abc1947779299273898374dbb, user_id=fd102292c51c4a0596554f80eafec137, role_id=12f6817f9aaa4e2bb477095a6bed5d0f)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:45.022077 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:28:45.024388 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30ed235-923b-42af-924a-2e4bd80dc55f admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:45.043554 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1241/2494] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 00:28:44 2022] PUT /identity/v3/projects/e26bc71abc1947779299273898374dbb/users/fd102292c51c4a0596554f80eafec137/roles/12f6817f9aaa4e2bb477095a6bed5d0f => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:28:45.045338 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30ed235-923b-42af-924a-2e4bd80dc55f admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:45.058732 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76537fb1-85e5-4f65-9dc0-00e1c91b94c0 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:45.122254 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:28:45.156740 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad1f141-8267-4e23-b362-d4ea268b2b99 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'daae792cd11d4c4ca7aae0558998aced', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:45.157481 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad1f141-8267-4e23-b362-d4ea268b2b99 service neutron] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:45.157838 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad1f141-8267-4e23-b362-d4ea268b2b99 service neutron] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:45.158177 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad1f141-8267-4e23-b362-d4ea268b2b99 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:45.160509 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-fad1f141-8267-4e23-b362-d4ea268b2b99 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:28:45.170082 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30ed235-923b-42af-924a-2e4bd80dc55f admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:45.177673 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a6956f-8186-48b8-98b6-c5ca6f7de75c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:45.178739 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a6956f-8186-48b8-98b6-c5ca6f7de75c admin admin] REQUEST_METHOD: `PUT` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:45.179193 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a6956f-8186-48b8-98b6-c5ca6f7de75c admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:45.179540 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a6956f-8186-48b8-98b6-c5ca6f7de75c admin admin] PATH_INFO: `/v3/projects/9be311dad5aa45d88d32fa7065ba72c9/users/15d6f9c21aac456b9fa06f76042f7ff3/roles/fdad79ffbcbb4fa380dc9cf7dd108618` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:45.201882 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a6956f-8186-48b8-98b6-c5ca6f7de75c admin admin] RBAC: Authorizing `identity:create_grant(project_id=9be311dad5aa45d88d32fa7065ba72c9, user_id=15d6f9c21aac456b9fa06f76042f7ff3, role_id=fdad79ffbcbb4fa380dc9cf7dd108618)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:45.206268 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a6956f-8186-48b8-98b6-c5ca6f7de75c admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:45.228745 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1242/2495] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 00:28:45 2022] PUT /identity/v3/projects/9be311dad5aa45d88d32fa7065ba72c9/users/15d6f9c21aac456b9fa06f76042f7ff3/roles/fdad79ffbcbb4fa380dc9cf7dd108618 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:28:45.233862 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c8ef9f-bf73-47a9-9ca7-86e0fb7ff9e8 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:45.234631 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c8ef9f-bf73-47a9-9ca7-86e0fb7ff9e8 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:45.235658 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c8ef9f-bf73-47a9-9ca7-86e0fb7ff9e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:45.268547 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad1f141-8267-4e23-b362-d4ea268b2b99 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:45.270015 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad1f141-8267-4e23-b362-d4ea268b2b99 service neutron] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:45.278024 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-45c8ef9f-bf73-47a9-9ca7-86e0fb7ff9e8 None None] MFA Rules not processed for user `fd102292c51c4a0596554f80eafec137`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:28:45.279402 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-45c8ef9f-bf73-47a9-9ca7-86e0fb7ff9e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:28:45.284224 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1254/2496] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:28:44 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:28:45.286106 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa407a9-0c0b-4c04-9a6a-5008f954abb9 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:45.286585 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa407a9-0c0b-4c04-9a6a-5008f954abb9 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:45.286929 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa407a9-0c0b-4c04-9a6a-5008f954abb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:45.332901 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-1aa407a9-0c0b-4c04-9a6a-5008f954abb9 None None] MFA Rules not processed for user `15d6f9c21aac456b9fa06f76042f7ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:28:45.334537 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-1aa407a9-0c0b-4c04-9a6a-5008f954abb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:28:45.399071 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1243/2497] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:28:45 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:28:45.414222 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c8ef9f-bf73-47a9-9ca7-86e0fb7ff9e8 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:45.418778 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-45c8ef9f-bf73-47a9-9ca7-86e0fb7ff9e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:28:45.442560 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1255/2498] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:28:45 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:28:45.460887 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa407a9-0c0b-4c04-9a6a-5008f954abb9 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:45.462878 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-1aa407a9-0c0b-4c04-9a6a-5008f954abb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:28:45.531178 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:28:45.547541 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c8ef9f-bf73-47a9-9ca7-86e0fb7ff9e8 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:45.551691 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8a0298-3e68-49fb-93e5-9459c7885789 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beecda6e9feb400288618745c784989f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:45.552365 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8a0298-3e68-49fb-93e5-9459c7885789 service cinder] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:45.552644 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8a0298-3e68-49fb-93e5-9459c7885789 service cinder] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:45.552948 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8a0298-3e68-49fb-93e5-9459c7885789 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:45.565729 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8a0298-3e68-49fb-93e5-9459c7885789 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:45.567514 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8a0298-3e68-49fb-93e5-9459c7885789 service cinder] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:45.584556 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1244/2499] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:28:45 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:28:45.633832 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa407a9-0c0b-4c04-9a6a-5008f954abb9 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:45.641570 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058a8d70-5ed4-46c8-ba9c-f67d4ee9d26d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea002bf49c248dbae7147665fa10fd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:45.642266 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058a8d70-5ed4-46c8-ba9c-f67d4ee9d26d service nova] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:45.642681 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058a8d70-5ed4-46c8-ba9c-f67d4ee9d26d service nova] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:45.643050 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058a8d70-5ed4-46c8-ba9c-f67d4ee9d26d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:45.654502 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058a8d70-5ed4-46c8-ba9c-f67d4ee9d26d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:45.655245 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058a8d70-5ed4-46c8-ba9c-f67d4ee9d26d service nova] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:45.668219 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1256/2500] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:28:45 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:28:45.709359 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8a0298-3e68-49fb-93e5-9459c7885789 service cinder] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:45.712991 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-ca8a0298-3e68-49fb-93e5-9459c7885789 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:28:45.748733 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8a0298-3e68-49fb-93e5-9459c7885789 service cinder] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:45.753778 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de581eb-e65d-4188-88f4-ca90f8c145a7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beecda6e9feb400288618745c784989f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:45.754416 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de581eb-e65d-4188-88f4-ca90f8c145a7 service cinder] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:45.754690 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de581eb-e65d-4188-88f4-ca90f8c145a7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:45.754960 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de581eb-e65d-4188-88f4-ca90f8c145a7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:45.781913 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:28:45.833189 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de581eb-e65d-4188-88f4-ca90f8c145a7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:45.834950 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de581eb-e65d-4188-88f4-ca90f8c145a7 service cinder] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:45.848736 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1245/2501] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:28:45 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:28:48.994228 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058a8d70-5ed4-46c8-ba9c-f67d4ee9d26d service nova] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:49.137771 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058a8d70-5ed4-46c8-ba9c-f67d4ee9d26d service nova] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:49.150776 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d3b65f-f76d-432a-91e0-bf50efea68c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:49.153263 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d3b65f-f76d-432a-91e0-bf50efea68c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:49.154051 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d3b65f-f76d-432a-91e0-bf50efea68c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:49.154660 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d3b65f-f76d-432a-91e0-bf50efea68c1 admin admin] PATH_INFO: `/v3/users/15d6f9c21aac456b9fa06f76042f7ff3` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:49.158697 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d3b65f-f76d-432a-91e0-bf50efea68c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=15d6f9c21aac456b9fa06f76042f7ff3)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:49.166613 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d3b65f-f76d-432a-91e0-bf50efea68c1 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:49.302668 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-53d3b65f-f76d-432a-91e0-bf50efea68c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15d6f9c21aac456b9fa06f76042f7ff3'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:49.325375 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-53d3b65f-f76d-432a-91e0-bf50efea68c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15d6f9c21aac456b9fa06f76042f7ff3'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:49.343150 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-53d3b65f-f76d-432a-91e0-bf50efea68c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15d6f9c21aac456b9fa06f76042f7ff3'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:49.344473 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-53d3b65f-f76d-432a-91e0-bf50efea68c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15d6f9c21aac456b9fa06f76042f7ff3'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:49.373505 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-53d3b65f-f76d-432a-91e0-bf50efea68c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15d6f9c21aac456b9fa06f76042f7ff3'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:49.383593 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1257/2502] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 31 00:28:48 2022] DELETE /identity/v3/users/15d6f9c21aac456b9fa06f76042f7ff3 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:28:49.392471 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8001da-c29a-48ca-93de-6356e245ae2e None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:49.394382 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8001da-c29a-48ca-93de-6356e245ae2e None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:49.395853 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8001da-c29a-48ca-93de-6356e245ae2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:49.457723 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-eb8001da-c29a-48ca-93de-6356e245ae2e None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:28:49.461002 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-eb8001da-c29a-48ca-93de-6356e245ae2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:28:49.569753 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1246/2503] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:28:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:28:49.589834 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d3b65f-f76d-432a-91e0-bf50efea68c1 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:49.592367 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-53d3b65f-f76d-432a-91e0-bf50efea68c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:28:49.652514 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:28:49.724208 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d3b65f-f76d-432a-91e0-bf50efea68c1 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:49.730186 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400dc6cd-dab7-423b-b5c1-5fc1e5e792f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'daae792cd11d4c4ca7aae0558998aced', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:49.731130 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400dc6cd-dab7-423b-b5c1-5fc1e5e792f2 service neutron] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:49.731626 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400dc6cd-dab7-423b-b5c1-5fc1e5e792f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:49.732089 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400dc6cd-dab7-423b-b5c1-5fc1e5e792f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:49.753287 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400dc6cd-dab7-423b-b5c1-5fc1e5e792f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:49.756938 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400dc6cd-dab7-423b-b5c1-5fc1e5e792f2 service neutron] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:49.782488 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1258/2504] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:28:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 00:28:50.221389 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8001da-c29a-48ca-93de-6356e245ae2e None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:50.223924 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-eb8001da-c29a-48ca-93de-6356e245ae2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:28:50.238202 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8001da-c29a-48ca-93de-6356e245ae2e None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:50.244527 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6353cdae-060c-411b-86d1-207d4d7a695d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:50.245581 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6353cdae-060c-411b-86d1-207d4d7a695d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:50.245873 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6353cdae-060c-411b-86d1-207d4d7a695d admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:50.246157 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6353cdae-060c-411b-86d1-207d4d7a695d admin admin] PATH_INFO: `/v3/projects/9be311dad5aa45d88d32fa7065ba72c9` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:50.248121 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6353cdae-060c-411b-86d1-207d4d7a695d admin admin] RBAC: Authorizing `identity:delete_project(project_id=9be311dad5aa45d88d32fa7065ba72c9)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:50.250381 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6353cdae-060c-411b-86d1-207d4d7a695d admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:50.311149 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-6353cdae-060c-411b-86d1-207d4d7a695d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9be311dad5aa45d88d32fa7065ba72c9', 'request_id': 'req-6353cdae-060c-411b-86d1-207d4d7a695d'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:50.321246 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-6353cdae-060c-411b-86d1-207d4d7a695d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9be311dad5aa45d88d32fa7065ba72c9', 'request_id': 'req-6353cdae-060c-411b-86d1-207d4d7a695d'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:50.330209 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-6353cdae-060c-411b-86d1-207d4d7a695d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9be311dad5aa45d88d32fa7065ba72c9', 'request_id': 'req-6353cdae-060c-411b-86d1-207d4d7a695d'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:50.349962 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-6353cdae-060c-411b-86d1-207d4d7a695d admin admin] The token cache is being invalidate because project 9be311dad5aa45d88d32fa7065ba72c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81523) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:28:50.350264 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-6353cdae-060c-411b-86d1-207d4d7a695d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:50.350982 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-6353cdae-060c-411b-86d1-207d4d7a695d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:50.352618 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1247/2505] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 31 00:28:50 2022] DELETE /identity/v3/projects/9be311dad5aa45d88d32fa7065ba72c9 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:28:50.358518 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1573139a-70d1-4234-9f39-44c4be73e7f6 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:50.359467 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1573139a-70d1-4234-9f39-44c4be73e7f6 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:50.359745 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1573139a-70d1-4234-9f39-44c4be73e7f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:50.382479 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-1573139a-70d1-4234-9f39-44c4be73e7f6 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:28:50.383819 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-1573139a-70d1-4234-9f39-44c4be73e7f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:28:50.478365 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1259/2506] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:28:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:28:50.493956 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17aa6f82-da09-498c-8b2f-4cc9a3eccf34 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:50.494802 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17aa6f82-da09-498c-8b2f-4cc9a3eccf34 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:50.495010 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17aa6f82-da09-498c-8b2f-4cc9a3eccf34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:50.533680 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-17aa6f82-da09-498c-8b2f-4cc9a3eccf34 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:28:50.536438 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-17aa6f82-da09-498c-8b2f-4cc9a3eccf34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:28:50.563657 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1248/2507] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:28:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:28:50.571633 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1573139a-70d1-4234-9f39-44c4be73e7f6 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:50.587059 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1573139a-70d1-4234-9f39-44c4be73e7f6 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:50.595901 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab10aca0-f387-45fc-9d4f-9bdfccfcf207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:50.596975 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab10aca0-f387-45fc-9d4f-9bdfccfcf207 admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:50.597441 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab10aca0-f387-45fc-9d4f-9bdfccfcf207 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:50.597915 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab10aca0-f387-45fc-9d4f-9bdfccfcf207 admin admin] PATH_INFO: `/v3/domains` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:50.599119 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab10aca0-f387-45fc-9d4f-9bdfccfcf207 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:28:50.599675 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab10aca0-f387-45fc-9d4f-9bdfccfcf207 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:50.602547 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab10aca0-f387-45fc-9d4f-9bdfccfcf207 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:50.627340 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1260/2508] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 31 00:28:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:28:50.632317 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17aa6f82-da09-498c-8b2f-4cc9a3eccf34 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:50.644318 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17aa6f82-da09-498c-8b2f-4cc9a3eccf34 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:50.650368 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a931b70-fd4b-481c-acc7-4881a3fdc160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:50.651135 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a931b70-fd4b-481c-acc7-4881a3fdc160 admin admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:50.651500 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a931b70-fd4b-481c-acc7-4881a3fdc160 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:50.651800 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a931b70-fd4b-481c-acc7-4881a3fdc160 admin admin] PATH_INFO: `/v3/projects` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:50.652770 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a931b70-fd4b-481c-acc7-4881a3fdc160 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:50.656890 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a931b70-fd4b-481c-acc7-4881a3fdc160 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:50.704228 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1249/2509] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 31 00:28:50 2022] POST /identity/v3/projects => generated 407 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:28:50.710559 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab10aca0-f387-45fc-9d4f-9bdfccfcf207 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:50.724477 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab10aca0-f387-45fc-9d4f-9bdfccfcf207 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:50.824943 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a257c7a-cb40-41a7-ae14-160b523ddce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:50.825584 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a257c7a-cb40-41a7-ae14-160b523ddce1 admin admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:50.825876 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a257c7a-cb40-41a7-ae14-160b523ddce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:50.826149 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a257c7a-cb40-41a7-ae14-160b523ddce1 admin admin] PATH_INFO: `/v3/users` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:50.827057 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a257c7a-cb40-41a7-ae14-160b523ddce1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:50.829109 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a257c7a-cb40-41a7-ae14-160b523ddce1 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:50.856257 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1261/2510] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 31 00:28:50 2022] POST /identity/v3/users => generated 304 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:28:50.860914 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a931b70-fd4b-481c-acc7-4881a3fdc160 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:50.873298 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a931b70-fd4b-481c-acc7-4881a3fdc160 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:50.878506 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a5344a-f75d-4c68-9f8d-1415b6298b35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:50.879270 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a5344a-f75d-4c68-9f8d-1415b6298b35 admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:50.880370 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a5344a-f75d-4c68-9f8d-1415b6298b35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:50.880649 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a5344a-f75d-4c68-9f8d-1415b6298b35 admin admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:50.881365 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a5344a-f75d-4c68-9f8d-1415b6298b35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:50.883324 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a5344a-f75d-4c68-9f8d-1415b6298b35 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:50.895626 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1250/2511] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 00:28:50 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 00:28:50.900949 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a257c7a-cb40-41a7-ae14-160b523ddce1 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:50.916921 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a257c7a-cb40-41a7-ae14-160b523ddce1 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:50.922967 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103eee9a-fbb1-46ae-a1ed-c65fd6e6f311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:50.923600 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103eee9a-fbb1-46ae-a1ed-c65fd6e6f311 admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:50.923880 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103eee9a-fbb1-46ae-a1ed-c65fd6e6f311 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:50.924247 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103eee9a-fbb1-46ae-a1ed-c65fd6e6f311 admin admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:50.924935 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103eee9a-fbb1-46ae-a1ed-c65fd6e6f311 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:50.926601 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103eee9a-fbb1-46ae-a1ed-c65fd6e6f311 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:50.940106 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1262/2512] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 00:28:50 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:28:50.945184 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a5344a-f75d-4c68-9f8d-1415b6298b35 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:50.953054 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:28:50.957849 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a5344a-f75d-4c68-9f8d-1415b6298b35 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:50.967378 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61234467-c8a2-48f6-b60f-d5b89438260f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:50.968981 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61234467-c8a2-48f6-b60f-d5b89438260f admin admin] REQUEST_METHOD: `PUT` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:50.969689 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61234467-c8a2-48f6-b60f-d5b89438260f admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:50.970384 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61234467-c8a2-48f6-b60f-d5b89438260f admin admin] PATH_INFO: `/v3/projects/ecc46348e69041688c0db8edadbf512d/users/308d68e7f916445aa957d8f34fa83f65/roles/fdad79ffbcbb4fa380dc9cf7dd108618` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:50.990103 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61234467-c8a2-48f6-b60f-d5b89438260f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ecc46348e69041688c0db8edadbf512d, user_id=308d68e7f916445aa957d8f34fa83f65, role_id=fdad79ffbcbb4fa380dc9cf7dd108618)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:50.995894 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61234467-c8a2-48f6-b60f-d5b89438260f admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:51.015112 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1251/2513] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 00:28:50 2022] PUT /identity/v3/projects/ecc46348e69041688c0db8edadbf512d/users/308d68e7f916445aa957d8f34fa83f65/roles/fdad79ffbcbb4fa380dc9cf7dd108618 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:28:51.031690 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d6a748-9e13-4e87-8613-4f33f835023b None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:51.032034 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d6a748-9e13-4e87-8613-4f33f835023b None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:51.032287 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d6a748-9e13-4e87-8613-4f33f835023b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:51.074007 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-e8d6a748-9e13-4e87-8613-4f33f835023b None None] MFA Rules not processed for user `308d68e7f916445aa957d8f34fa83f65`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:28:51.075209 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-e8d6a748-9e13-4e87-8613-4f33f835023b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:28:51.100627 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:28:51.161138 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1263/2514] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:28:51 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:28:51.166755 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61234467-c8a2-48f6-b60f-d5b89438260f admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:51.270921 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61234467-c8a2-48f6-b60f-d5b89438260f admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:51.285573 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5170a7f1-a9a5-4c43-aff1-7ad57155ebd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:51.287960 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5170a7f1-a9a5-4c43-aff1-7ad57155ebd6 admin admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:51.288383 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5170a7f1-a9a5-4c43-aff1-7ad57155ebd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:51.288876 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5170a7f1-a9a5-4c43-aff1-7ad57155ebd6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:51.290985 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5170a7f1-a9a5-4c43-aff1-7ad57155ebd6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:51.295243 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5170a7f1-a9a5-4c43-aff1-7ad57155ebd6 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:51.363068 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1252/2515] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 31 00:28:51 2022] POST /identity/v3/projects => generated 407 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:28:51.369374 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d6a748-9e13-4e87-8613-4f33f835023b None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:51.391816 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d6a748-9e13-4e87-8613-4f33f835023b None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:51.483409 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3239b0b2-c84c-4274-821c-b852679f9e69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:51.484262 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3239b0b2-c84c-4274-821c-b852679f9e69 admin admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:51.484646 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3239b0b2-c84c-4274-821c-b852679f9e69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:51.485027 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3239b0b2-c84c-4274-821c-b852679f9e69 admin admin] PATH_INFO: `/v3/users` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:51.485801 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3239b0b2-c84c-4274-821c-b852679f9e69 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:51.487887 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3239b0b2-c84c-4274-821c-b852679f9e69 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:51.515821 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1264/2516] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 31 00:28:51 2022] POST /identity/v3/users => generated 310 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:28:51.520125 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5170a7f1-a9a5-4c43-aff1-7ad57155ebd6 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:51.533453 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5170a7f1-a9a5-4c43-aff1-7ad57155ebd6 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:51.538928 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc540a3-d181-4346-aeb0-10e9a5ce68e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:51.539308 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc540a3-d181-4346-aeb0-10e9a5ce68e0 admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:51.539588 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc540a3-d181-4346-aeb0-10e9a5ce68e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:51.539865 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc540a3-d181-4346-aeb0-10e9a5ce68e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:51.540560 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc540a3-d181-4346-aeb0-10e9a5ce68e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:51.542315 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc540a3-d181-4346-aeb0-10e9a5ce68e0 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:51.555027 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1253/2517] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 00:28:51 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 00:28:51.560241 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3239b0b2-c84c-4274-821c-b852679f9e69 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:51.580700 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3239b0b2-c84c-4274-821c-b852679f9e69 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:51.585918 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3575c13-32d3-4634-9124-5988f023ed00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:51.586609 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3575c13-32d3-4634-9124-5988f023ed00 admin admin] REQUEST_METHOD: `PUT` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:51.586891 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3575c13-32d3-4634-9124-5988f023ed00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:51.587170 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3575c13-32d3-4634-9124-5988f023ed00 admin admin] PATH_INFO: `/v3/projects/bed0ffe4d8a4418285fd4b02e56e805f/users/9d356981388a40d6a2efa745ab039f37/roles/12f6817f9aaa4e2bb477095a6bed5d0f` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:51.606884 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3575c13-32d3-4634-9124-5988f023ed00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bed0ffe4d8a4418285fd4b02e56e805f, user_id=9d356981388a40d6a2efa745ab039f37, role_id=12f6817f9aaa4e2bb477095a6bed5d0f)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:51.609671 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3575c13-32d3-4634-9124-5988f023ed00 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:51.627396 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1265/2518] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 00:28:51 2022] PUT /identity/v3/projects/bed0ffe4d8a4418285fd4b02e56e805f/users/9d356981388a40d6a2efa745ab039f37/roles/12f6817f9aaa4e2bb477095a6bed5d0f => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:28:51.632391 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc540a3-d181-4346-aeb0-10e9a5ce68e0 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:51.648496 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc540a3-d181-4346-aeb0-10e9a5ce68e0 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:51.729972 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec789ee3-1e4f-4fba-a855-5cf3606878c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:51.731136 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec789ee3-1e4f-4fba-a855-5cf3606878c3 admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:51.731567 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec789ee3-1e4f-4fba-a855-5cf3606878c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:51.731972 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec789ee3-1e4f-4fba-a855-5cf3606878c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:51.732948 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec789ee3-1e4f-4fba-a855-5cf3606878c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:51.735348 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec789ee3-1e4f-4fba-a855-5cf3606878c3 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:51.754227 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1254/2519] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 00:28:51 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:28:51.759074 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3575c13-32d3-4634-9124-5988f023ed00 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:51.778875 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3575c13-32d3-4634-9124-5988f023ed00 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:51.786835 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc7e071-71a0-4554-ada3-4bba6e25be7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:51.787791 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc7e071-71a0-4554-ada3-4bba6e25be7f admin admin] REQUEST_METHOD: `PUT` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:51.788343 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc7e071-71a0-4554-ada3-4bba6e25be7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:51.788880 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc7e071-71a0-4554-ada3-4bba6e25be7f admin admin] PATH_INFO: `/v3/projects/bed0ffe4d8a4418285fd4b02e56e805f/users/9d356981388a40d6a2efa745ab039f37/roles/12f6817f9aaa4e2bb477095a6bed5d0f` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:51.792142 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc7e071-71a0-4554-ada3-4bba6e25be7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=bed0ffe4d8a4418285fd4b02e56e805f, user_id=9d356981388a40d6a2efa745ab039f37, role_id=12f6817f9aaa4e2bb477095a6bed5d0f)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:51.797393 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc7e071-71a0-4554-ada3-4bba6e25be7f admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:51.818338 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1266/2520] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 00:28:51 2022] PUT /identity/v3/projects/bed0ffe4d8a4418285fd4b02e56e805f/users/9d356981388a40d6a2efa745ab039f37/roles/12f6817f9aaa4e2bb477095a6bed5d0f => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:28:51.830838 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae108d7-5407-4710-90c6-1954afe3ac8d None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:51.831201 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae108d7-5407-4710-90c6-1954afe3ac8d None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:51.831363 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae108d7-5407-4710-90c6-1954afe3ac8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:51.877865 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-0ae108d7-5407-4710-90c6-1954afe3ac8d None None] MFA Rules not processed for user `9d356981388a40d6a2efa745ab039f37`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:28:51.879335 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-0ae108d7-5407-4710-90c6-1954afe3ac8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:28:51.947084 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:28:52.006766 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1255/2521] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:28:51 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:28:52.027174 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc7e071-71a0-4554-ada3-4bba6e25be7f admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:52.029972 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-1bc7e071-71a0-4554-ada3-4bba6e25be7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:28:52.108281 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc7e071-71a0-4554-ada3-4bba6e25be7f admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:52.111935 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396d8c1b-47a1-4c36-af13-f15085345d58 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beecda6e9feb400288618745c784989f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:52.112595 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396d8c1b-47a1-4c36-af13-f15085345d58 service cinder] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:52.112871 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396d8c1b-47a1-4c36-af13-f15085345d58 service cinder] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:52.113174 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396d8c1b-47a1-4c36-af13-f15085345d58 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:52.124296 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396d8c1b-47a1-4c36-af13-f15085345d58 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:52.126009 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396d8c1b-47a1-4c36-af13-f15085345d58 service cinder] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:52.140774 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1267/2522] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:28:52 2022] GET /identity/v3/auth/tokens => generated 3351 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:28:52.354953 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae108d7-5407-4710-90c6-1954afe3ac8d None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:52.369132 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae108d7-5407-4710-90c6-1954afe3ac8d None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:52.374964 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a107076-e4cb-4372-96eb-095260287a03 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beecda6e9feb400288618745c784989f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:52.375679 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a107076-e4cb-4372-96eb-095260287a03 service cinder] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:52.376121 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a107076-e4cb-4372-96eb-095260287a03 service cinder] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:52.376586 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a107076-e4cb-4372-96eb-095260287a03 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:52.488986 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a107076-e4cb-4372-96eb-095260287a03 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:52.491891 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a107076-e4cb-4372-96eb-095260287a03 service cinder] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:52.521046 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1256/2523] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:28:52 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 00:28:58.415676 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396d8c1b-47a1-4c36-af13-f15085345d58 service cinder] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:58.417524 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-396d8c1b-47a1-4c36-af13-f15085345d58 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:28:58.436276 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:28:58.524020 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396d8c1b-47a1-4c36-af13-f15085345d58 service cinder] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:58.532194 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3b9da6-71ba-4afb-8fad-df7d62de9bb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:58.533274 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3b9da6-71ba-4afb-8fad-df7d62de9bb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:58.533725 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3b9da6-71ba-4afb-8fad-df7d62de9bb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:58.534189 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3b9da6-71ba-4afb-8fad-df7d62de9bb6 admin admin] PATH_INFO: `/v3/users/06b57daba686490fb86733b526c3579f` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:58.536244 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3b9da6-71ba-4afb-8fad-df7d62de9bb6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=06b57daba686490fb86733b526c3579f)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:58.539867 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3b9da6-71ba-4afb-8fad-df7d62de9bb6 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:58.615302 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-1e3b9da6-71ba-4afb-8fad-df7d62de9bb6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06b57daba686490fb86733b526c3579f'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:58.627466 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-1e3b9da6-71ba-4afb-8fad-df7d62de9bb6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06b57daba686490fb86733b526c3579f'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:58.637991 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-1e3b9da6-71ba-4afb-8fad-df7d62de9bb6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06b57daba686490fb86733b526c3579f'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:58.638842 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-1e3b9da6-71ba-4afb-8fad-df7d62de9bb6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06b57daba686490fb86733b526c3579f'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:58.658018 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-1e3b9da6-71ba-4afb-8fad-df7d62de9bb6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06b57daba686490fb86733b526c3579f'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:58.665510 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1268/2524] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 31 00:28:58 2022] DELETE /identity/v3/users/06b57daba686490fb86733b526c3579f => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:28:58.670488 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef4dc2c-efad-4bde-beed-d3b0794f2f96 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:58.671213 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef4dc2c-efad-4bde-beed-d3b0794f2f96 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:58.671213 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef4dc2c-efad-4bde-beed-d3b0794f2f96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:58.697793 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-6ef4dc2c-efad-4bde-beed-d3b0794f2f96 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:28:58.700000 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-6ef4dc2c-efad-4bde-beed-d3b0794f2f96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:28:58.781142 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1257/2525] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:28:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:28:58.793345 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3b9da6-71ba-4afb-8fad-df7d62de9bb6 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:58.795009 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-1e3b9da6-71ba-4afb-8fad-df7d62de9bb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:28:58.864210 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3b9da6-71ba-4afb-8fad-df7d62de9bb6 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:58.868271 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4661590-c761-4fa9-b2c0-a947ad529639 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'daae792cd11d4c4ca7aae0558998aced', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:58.868974 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4661590-c761-4fa9-b2c0-a947ad529639 service neutron] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:58.869326 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4661590-c761-4fa9-b2c0-a947ad529639 service neutron] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:58.869682 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4661590-c761-4fa9-b2c0-a947ad529639 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:58.882140 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4661590-c761-4fa9-b2c0-a947ad529639 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:58.884392 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4661590-c761-4fa9-b2c0-a947ad529639 service neutron] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:58.897212 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1269/2526] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:28:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 00:28:59.236019 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef4dc2c-efad-4bde-beed-d3b0794f2f96 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:59.238415 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-6ef4dc2c-efad-4bde-beed-d3b0794f2f96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:28:59.260062 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef4dc2c-efad-4bde-beed-d3b0794f2f96 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:59.269327 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b24cda-a5fc-4cad-8c3d-cc5182368dd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:59.271065 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b24cda-a5fc-4cad-8c3d-cc5182368dd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:59.271065 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b24cda-a5fc-4cad-8c3d-cc5182368dd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:59.271712 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b24cda-a5fc-4cad-8c3d-cc5182368dd3 admin admin] PATH_INFO: `/v3/projects/0720dbe824e54d28a1aac2a44883036f` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:59.273976 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b24cda-a5fc-4cad-8c3d-cc5182368dd3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0720dbe824e54d28a1aac2a44883036f)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:59.278947 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b24cda-a5fc-4cad-8c3d-cc5182368dd3 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:59.367944 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-53b24cda-a5fc-4cad-8c3d-cc5182368dd3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0720dbe824e54d28a1aac2a44883036f', 'request_id': 'req-53b24cda-a5fc-4cad-8c3d-cc5182368dd3'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:59.376102 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-53b24cda-a5fc-4cad-8c3d-cc5182368dd3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0720dbe824e54d28a1aac2a44883036f', 'request_id': 'req-53b24cda-a5fc-4cad-8c3d-cc5182368dd3'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:59.382681 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-53b24cda-a5fc-4cad-8c3d-cc5182368dd3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0720dbe824e54d28a1aac2a44883036f', 'request_id': 'req-53b24cda-a5fc-4cad-8c3d-cc5182368dd3'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:59.394102 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:28:59.400266 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-53b24cda-a5fc-4cad-8c3d-cc5182368dd3 admin admin] The token cache is being invalidate because project 0720dbe824e54d28a1aac2a44883036f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81523) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:28:59.401667 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-53b24cda-a5fc-4cad-8c3d-cc5182368dd3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:59.403304 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-53b24cda-a5fc-4cad-8c3d-cc5182368dd3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:59.405789 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1258/2527] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 31 00:28:59 2022] DELETE /identity/v3/projects/0720dbe824e54d28a1aac2a44883036f => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:28:59.410321 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4661590-c761-4fa9-b2c0-a947ad529639 service neutron] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:59.421393 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4661590-c761-4fa9-b2c0-a947ad529639 service neutron] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:59.463582 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:28:59.498540 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e43d8e4-13c1-46ba-9202-3d1cd75c0ff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:59.499226 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e43d8e4-13c1-46ba-9202-3d1cd75c0ff4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:59.499509 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e43d8e4-13c1-46ba-9202-3d1cd75c0ff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:59.499787 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e43d8e4-13c1-46ba-9202-3d1cd75c0ff4 admin admin] PATH_INFO: `/v3/users/fd102292c51c4a0596554f80eafec137` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:59.501256 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e43d8e4-13c1-46ba-9202-3d1cd75c0ff4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd102292c51c4a0596554f80eafec137)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:59.503378 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e43d8e4-13c1-46ba-9202-3d1cd75c0ff4 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:59.564326 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-8e43d8e4-13c1-46ba-9202-3d1cd75c0ff4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd102292c51c4a0596554f80eafec137'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:59.574180 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-8e43d8e4-13c1-46ba-9202-3d1cd75c0ff4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd102292c51c4a0596554f80eafec137'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:59.582913 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-8e43d8e4-13c1-46ba-9202-3d1cd75c0ff4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd102292c51c4a0596554f80eafec137'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:59.583696 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-8e43d8e4-13c1-46ba-9202-3d1cd75c0ff4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd102292c51c4a0596554f80eafec137'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:59.598909 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-8e43d8e4-13c1-46ba-9202-3d1cd75c0ff4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd102292c51c4a0596554f80eafec137'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:28:59.608787 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1270/2528] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 31 00:28:59 2022] DELETE /identity/v3/users/fd102292c51c4a0596554f80eafec137 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:29:00.022893 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b24cda-a5fc-4cad-8c3d-cc5182368dd3 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:00.025690 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-53b24cda-a5fc-4cad-8c3d-cc5182368dd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:00.047358 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b24cda-a5fc-4cad-8c3d-cc5182368dd3 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:00.131665 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8737895a-338b-4e83-a647-d611f728a60a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:00.133461 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8737895a-338b-4e83-a647-d611f728a60a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:00.133461 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8737895a-338b-4e83-a647-d611f728a60a admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:00.133461 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8737895a-338b-4e83-a647-d611f728a60a admin admin] PATH_INFO: `/v3/projects/e26bc71abc1947779299273898374dbb` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:00.134568 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8737895a-338b-4e83-a647-d611f728a60a admin admin] RBAC: Authorizing `identity:delete_project(project_id=e26bc71abc1947779299273898374dbb)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:00.137156 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8737895a-338b-4e83-a647-d611f728a60a admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:00.201420 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-8737895a-338b-4e83-a647-d611f728a60a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e26bc71abc1947779299273898374dbb', 'request_id': 'req-8737895a-338b-4e83-a647-d611f728a60a'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:00.209126 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-8737895a-338b-4e83-a647-d611f728a60a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e26bc71abc1947779299273898374dbb', 'request_id': 'req-8737895a-338b-4e83-a647-d611f728a60a'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:00.216357 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-8737895a-338b-4e83-a647-d611f728a60a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e26bc71abc1947779299273898374dbb', 'request_id': 'req-8737895a-338b-4e83-a647-d611f728a60a'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:00.232510 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-8737895a-338b-4e83-a647-d611f728a60a admin admin] The token cache is being invalidate because project e26bc71abc1947779299273898374dbb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81523) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:29:00.232850 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-8737895a-338b-4e83-a647-d611f728a60a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:00.234326 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-8737895a-338b-4e83-a647-d611f728a60a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:00.235614 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1259/2529] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 31 00:29:00 2022] DELETE /identity/v3/projects/e26bc71abc1947779299273898374dbb => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:29:00.242641 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55c303e-921e-4ae8-bfcc-3cc4fd3851e7 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:00.242917 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55c303e-921e-4ae8-bfcc-3cc4fd3851e7 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:00.243322 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55c303e-921e-4ae8-bfcc-3cc4fd3851e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:00.277836 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-d55c303e-921e-4ae8-bfcc-3cc4fd3851e7 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:29:00.279201 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-d55c303e-921e-4ae8-bfcc-3cc4fd3851e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:00.349730 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1271/2530] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:29:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:29:00.359199 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2188cda8-5ca5-4a45-b467-f95731634435 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:00.359499 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2188cda8-5ca5-4a45-b467-f95731634435 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:00.359753 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2188cda8-5ca5-4a45-b467-f95731634435 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:00.383566 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-2188cda8-5ca5-4a45-b467-f95731634435 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:29:00.385075 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-2188cda8-5ca5-4a45-b467-f95731634435 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:00.395727 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1260/2531] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:29:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:29:00.401478 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55c303e-921e-4ae8-bfcc-3cc4fd3851e7 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:00.414457 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55c303e-921e-4ae8-bfcc-3cc4fd3851e7 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:00.421557 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ed88cc-9880-407b-bcc8-b7f78e5fbb69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:00.422613 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ed88cc-9880-407b-bcc8-b7f78e5fbb69 admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:00.422964 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ed88cc-9880-407b-bcc8-b7f78e5fbb69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:00.423429 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ed88cc-9880-407b-bcc8-b7f78e5fbb69 admin admin] PATH_INFO: `/v3/domains` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:00.424649 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ed88cc-9880-407b-bcc8-b7f78e5fbb69 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:29:00.425154 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ed88cc-9880-407b-bcc8-b7f78e5fbb69 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:00.428107 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ed88cc-9880-407b-bcc8-b7f78e5fbb69 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:00.446068 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1272/2532] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 31 00:29:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:29:00.455622 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2188cda8-5ca5-4a45-b467-f95731634435 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:00.474842 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2188cda8-5ca5-4a45-b467-f95731634435 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:00.483860 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e886dff-ec94-4491-8c9c-d66f5f8abed8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:00.484847 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e886dff-ec94-4491-8c9c-d66f5f8abed8 admin admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:00.485425 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e886dff-ec94-4491-8c9c-d66f5f8abed8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:00.485694 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e886dff-ec94-4491-8c9c-d66f5f8abed8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:00.486685 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e886dff-ec94-4491-8c9c-d66f5f8abed8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:00.490088 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e886dff-ec94-4491-8c9c-d66f5f8abed8 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:00.536887 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1261/2533] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 31 00:29:00 2022] POST /identity/v3/projects => generated 363 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:29:00.544415 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ed88cc-9880-407b-bcc8-b7f78e5fbb69 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:00.575091 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ed88cc-9880-407b-bcc8-b7f78e5fbb69 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:00.675447 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:29:00.685709 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e886dff-ec94-4491-8c9c-d66f5f8abed8 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:00.689103 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-3e886dff-ec94-4491-8c9c-d66f5f8abed8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:00.713215 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d0744a-26b7-4165-ba55-e0c51167796e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:00.714535 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d0744a-26b7-4165-ba55-e0c51167796e admin admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:00.715024 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d0744a-26b7-4165-ba55-e0c51167796e admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:00.715515 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d0744a-26b7-4165-ba55-e0c51167796e admin admin] PATH_INFO: `/v3/users` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:00.716427 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d0744a-26b7-4165-ba55-e0c51167796e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:00.718700 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d0744a-26b7-4165-ba55-e0c51167796e admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:00.757156 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1273/2534] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 31 00:29:00 2022] POST /identity/v3/users => generated 282 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:29:00.764231 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d0744a-26b7-4165-ba55-e0c51167796e admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:00.786408 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d0744a-26b7-4165-ba55-e0c51167796e admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:00.796071 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b02b68-74a6-4d61-a413-1c806bbc1171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:00.797869 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b02b68-74a6-4d61-a413-1c806bbc1171 admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:00.798344 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b02b68-74a6-4d61-a413-1c806bbc1171 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:00.798817 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b02b68-74a6-4d61-a413-1c806bbc1171 admin admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:00.800050 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b02b68-74a6-4d61-a413-1c806bbc1171 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:00.803240 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b02b68-74a6-4d61-a413-1c806bbc1171 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:00.813709 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e886dff-ec94-4491-8c9c-d66f5f8abed8 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:00.819630 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1274/2535] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 00:29:00 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 00:29:00.822813 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884f6d87-a33c-4c83-b748-ee27a92efa9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:00.824375 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884f6d87-a33c-4c83-b748-ee27a92efa9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:00.824617 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884f6d87-a33c-4c83-b748-ee27a92efa9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:00.824809 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884f6d87-a33c-4c83-b748-ee27a92efa9d admin admin] PATH_INFO: `/v3/users/308d68e7f916445aa957d8f34fa83f65` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:00.826164 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b02b68-74a6-4d61-a413-1c806bbc1171 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:00.826827 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884f6d87-a33c-4c83-b748-ee27a92efa9d admin admin] RBAC: Authorizing `identity:delete_user(user_id=308d68e7f916445aa957d8f34fa83f65)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:00.829949 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884f6d87-a33c-4c83-b748-ee27a92efa9d admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:00.832394 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:29:00.846436 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b02b68-74a6-4d61-a413-1c806bbc1171 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:00.855775 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1577f40e-103b-4b92-bd5e-6f86d2e8ee82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:00.857488 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1577f40e-103b-4b92-bd5e-6f86d2e8ee82 admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:00.858173 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1577f40e-103b-4b92-bd5e-6f86d2e8ee82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:00.858682 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1577f40e-103b-4b92-bd5e-6f86d2e8ee82 admin admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:00.860373 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1577f40e-103b-4b92-bd5e-6f86d2e8ee82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:00.864236 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1577f40e-103b-4b92-bd5e-6f86d2e8ee82 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:00.888547 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1275/2536] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 00:29:00 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 00:29:00.890357 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1577f40e-103b-4b92-bd5e-6f86d2e8ee82 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:00.903826 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1577f40e-103b-4b92-bd5e-6f86d2e8ee82 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:00.909247 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba43cef-87e3-4bdf-8384-b42264f2e775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:00.909999 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba43cef-87e3-4bdf-8384-b42264f2e775 admin admin] REQUEST_METHOD: `PUT` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:00.910306 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba43cef-87e3-4bdf-8384-b42264f2e775 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:00.910618 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba43cef-87e3-4bdf-8384-b42264f2e775 admin admin] PATH_INFO: `/v3/projects/59f91ea9c31b47669a9af471549c0027/users/def8e7ed6e024b1db0cd1f712b1f5711/roles/fdad79ffbcbb4fa380dc9cf7dd108618` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:00.914907 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-884f6d87-a33c-4c83-b748-ee27a92efa9d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '308d68e7f916445aa957d8f34fa83f65'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:00.926735 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-884f6d87-a33c-4c83-b748-ee27a92efa9d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '308d68e7f916445aa957d8f34fa83f65'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:00.928968 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba43cef-87e3-4bdf-8384-b42264f2e775 admin admin] RBAC: Authorizing `identity:create_grant(project_id=59f91ea9c31b47669a9af471549c0027, user_id=def8e7ed6e024b1db0cd1f712b1f5711, role_id=fdad79ffbcbb4fa380dc9cf7dd108618)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:00.931996 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba43cef-87e3-4bdf-8384-b42264f2e775 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:00.937565 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-884f6d87-a33c-4c83-b748-ee27a92efa9d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '308d68e7f916445aa957d8f34fa83f65'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:00.955837 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1276/2537] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 00:29:00 2022] PUT /identity/v3/projects/59f91ea9c31b47669a9af471549c0027/users/def8e7ed6e024b1db0cd1f712b1f5711/roles/fdad79ffbcbb4fa380dc9cf7dd108618 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:29:00.956059 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-884f6d87-a33c-4c83-b748-ee27a92efa9d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '308d68e7f916445aa957d8f34fa83f65'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:00.956714 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-884f6d87-a33c-4c83-b748-ee27a92efa9d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '308d68e7f916445aa957d8f34fa83f65'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:00.964137 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1262/2538] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 31 00:29:00 2022] DELETE /identity/v3/users/308d68e7f916445aa957d8f34fa83f65 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:29:00.968967 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917404ae-a10b-425c-8ea8-475e8d0d8cde None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:00.968967 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917404ae-a10b-425c-8ea8-475e8d0d8cde None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:00.969267 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917404ae-a10b-425c-8ea8-475e8d0d8cde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:00.975374 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e8127a-bae7-4a11-ba89-ebe814061531 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:00.976118 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e8127a-bae7-4a11-ba89-ebe814061531 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:00.976472 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e8127a-bae7-4a11-ba89-ebe814061531 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:00.990636 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-917404ae-a10b-425c-8ea8-475e8d0d8cde None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:29:00.993212 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-917404ae-a10b-425c-8ea8-475e8d0d8cde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:01.015972 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-a0e8127a-bae7-4a11-ba89-ebe814061531 None None] MFA Rules not processed for user `def8e7ed6e024b1db0cd1f712b1f5711`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:29:01.017492 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-a0e8127a-bae7-4a11-ba89-ebe814061531 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:01.083386 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1277/2539] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:29:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:29:01.093073 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917404ae-a10b-425c-8ea8-475e8d0d8cde None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:01.094575 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-917404ae-a10b-425c-8ea8-475e8d0d8cde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:01.154245 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1263/2540] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:29:00 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:29:01.160429 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e8127a-bae7-4a11-ba89-ebe814061531 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:01.168619 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-a0e8127a-bae7-4a11-ba89-ebe814061531 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:01.184736 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e8127a-bae7-4a11-ba89-ebe814061531 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:01.188404 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917404ae-a10b-425c-8ea8-475e8d0d8cde None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:01.190452 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24024fb8-c50a-4c64-abae-7e9c6095f04d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:01.191173 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24024fb8-c50a-4c64-abae-7e9c6095f04d admin admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:01.191528 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24024fb8-c50a-4c64-abae-7e9c6095f04d admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:01.191763 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24024fb8-c50a-4c64-abae-7e9c6095f04d admin admin] PATH_INFO: `/v3/projects` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:01.192501 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24024fb8-c50a-4c64-abae-7e9c6095f04d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:01.194472 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24024fb8-c50a-4c64-abae-7e9c6095f04d admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:01.195443 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aff11af-4a5a-4300-9266-962362ed9998 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'daae792cd11d4c4ca7aae0558998aced', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:01.196563 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aff11af-4a5a-4300-9266-962362ed9998 service neutron] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:01.197143 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aff11af-4a5a-4300-9266-962362ed9998 service neutron] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:01.197714 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aff11af-4a5a-4300-9266-962362ed9998 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:01.217813 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aff11af-4a5a-4300-9266-962362ed9998 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:01.221170 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aff11af-4a5a-4300-9266-962362ed9998 service neutron] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:01.237850 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1278/2541] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:29:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:29:01.249763 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1264/2542] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 31 00:29:01 2022] POST /identity/v3/projects => generated 365 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:29:01.256434 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aff11af-4a5a-4300-9266-962362ed9998 service neutron] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:01.278791 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aff11af-4a5a-4300-9266-962362ed9998 service neutron] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:01.366039 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:29:01.473435 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a265437f-9536-4ab4-b355-103be6bd955d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:01.474775 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a265437f-9536-4ab4-b355-103be6bd955d admin admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:01.475557 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a265437f-9536-4ab4-b355-103be6bd955d admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:01.476321 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a265437f-9536-4ab4-b355-103be6bd955d admin admin] PATH_INFO: `/v3/users` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:01.477396 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a265437f-9536-4ab4-b355-103be6bd955d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:01.480336 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a265437f-9536-4ab4-b355-103be6bd955d admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:01.513370 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1279/2543] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 31 00:29:01 2022] POST /identity/v3/users => generated 289 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:29:01.519061 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24024fb8-c50a-4c64-abae-7e9c6095f04d admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:01.554246 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24024fb8-c50a-4c64-abae-7e9c6095f04d admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:01.564718 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba4ae90-cb9a-4bfe-aa12-d72dd9660bac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:01.565996 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba4ae90-cb9a-4bfe-aa12-d72dd9660bac admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:01.566646 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba4ae90-cb9a-4bfe-aa12-d72dd9660bac admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:01.567295 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba4ae90-cb9a-4bfe-aa12-d72dd9660bac admin admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:01.568823 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba4ae90-cb9a-4bfe-aa12-d72dd9660bac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:01.573948 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba4ae90-cb9a-4bfe-aa12-d72dd9660bac admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:01.597349 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1265/2544] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 00:29:01 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:29:01.603934 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a265437f-9536-4ab4-b355-103be6bd955d admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:01.626464 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a265437f-9536-4ab4-b355-103be6bd955d admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:01.635525 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31d49f5-db95-4b45-b44b-adf884a261f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:01.637496 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31d49f5-db95-4b45-b44b-adf884a261f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:01.638240 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31d49f5-db95-4b45-b44b-adf884a261f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:01.638506 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31d49f5-db95-4b45-b44b-adf884a261f0 admin admin] PATH_INFO: `/v3/projects/a22a231e06834ba287eaea8cfcb0b547/users/903bcee6ad0541598013b7b70fbcdcb2/roles/12f6817f9aaa4e2bb477095a6bed5d0f` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:01.665367 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31d49f5-db95-4b45-b44b-adf884a261f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a22a231e06834ba287eaea8cfcb0b547, user_id=903bcee6ad0541598013b7b70fbcdcb2, role_id=12f6817f9aaa4e2bb477095a6bed5d0f)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:01.669292 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31d49f5-db95-4b45-b44b-adf884a261f0 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:01.700993 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1280/2545] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 00:29:01 2022] PUT /identity/v3/projects/a22a231e06834ba287eaea8cfcb0b547/users/903bcee6ad0541598013b7b70fbcdcb2/roles/12f6817f9aaa4e2bb477095a6bed5d0f => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:29:01.707184 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba4ae90-cb9a-4bfe-aa12-d72dd9660bac admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:01.729375 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba4ae90-cb9a-4bfe-aa12-d72dd9660bac admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:01.790313 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31d49f5-db95-4b45-b44b-adf884a261f0 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:01.793368 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-d31d49f5-db95-4b45-b44b-adf884a261f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:01.822753 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:29:01.888030 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18949ba0-248e-41f4-9fd1-e8242bda61b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:01.889230 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18949ba0-248e-41f4-9fd1-e8242bda61b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:01.889742 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18949ba0-248e-41f4-9fd1-e8242bda61b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:01.890246 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18949ba0-248e-41f4-9fd1-e8242bda61b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:01.893786 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18949ba0-248e-41f4-9fd1-e8242bda61b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:01.900376 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18949ba0-248e-41f4-9fd1-e8242bda61b7 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:01.952925 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1266/2546] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 00:29:01 2022] GET /identity/v3/roles => generated 1420 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:29:01.959836 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18949ba0-248e-41f4-9fd1-e8242bda61b7 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:01.986244 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18949ba0-248e-41f4-9fd1-e8242bda61b7 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:01.996490 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5de49db-69d9-43de-8a5e-ab1082c2df9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:02.000810 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5de49db-69d9-43de-8a5e-ab1082c2df9b admin admin] REQUEST_METHOD: `PUT` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:02.001401 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5de49db-69d9-43de-8a5e-ab1082c2df9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:02.001997 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5de49db-69d9-43de-8a5e-ab1082c2df9b admin admin] PATH_INFO: `/v3/projects/a22a231e06834ba287eaea8cfcb0b547/users/903bcee6ad0541598013b7b70fbcdcb2/roles/12f6817f9aaa4e2bb477095a6bed5d0f` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:02.006081 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5de49db-69d9-43de-8a5e-ab1082c2df9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a22a231e06834ba287eaea8cfcb0b547, user_id=903bcee6ad0541598013b7b70fbcdcb2, role_id=12f6817f9aaa4e2bb477095a6bed5d0f)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:02.012442 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5de49db-69d9-43de-8a5e-ab1082c2df9b admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:02.034916 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1267/2547] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 00:29:01 2022] PUT /identity/v3/projects/a22a231e06834ba287eaea8cfcb0b547/users/903bcee6ad0541598013b7b70fbcdcb2/roles/12f6817f9aaa4e2bb477095a6bed5d0f => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:29:02.055443 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e55e7c-b591-4607-907d-35a6f4472ff7 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:02.055897 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e55e7c-b591-4607-907d-35a6f4472ff7 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:02.056267 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e55e7c-b591-4607-907d-35a6f4472ff7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:02.077290 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31d49f5-db95-4b45-b44b-adf884a261f0 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:02.110184 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-42e55e7c-b591-4607-907d-35a6f4472ff7 None None] MFA Rules not processed for user `903bcee6ad0541598013b7b70fbcdcb2`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:29:02.112382 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-42e55e7c-b591-4607-907d-35a6f4472ff7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:02.246784 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eee4692-ce51-4075-b046-b8315621d258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:02.247905 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eee4692-ce51-4075-b046-b8315621d258 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:02.248453 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eee4692-ce51-4075-b046-b8315621d258 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:02.248964 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eee4692-ce51-4075-b046-b8315621d258 admin admin] PATH_INFO: `/v3/projects/ecc46348e69041688c0db8edadbf512d` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:02.251486 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eee4692-ce51-4075-b046-b8315621d258 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ecc46348e69041688c0db8edadbf512d)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:02.255175 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eee4692-ce51-4075-b046-b8315621d258 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:02.302694 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1268/2548] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:29:02 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:29:02.323699 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e55e7c-b591-4607-907d-35a6f4472ff7 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:02.326378 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-42e55e7c-b591-4607-907d-35a6f4472ff7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:02.366679 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:29:02.381322 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-8eee4692-ce51-4075-b046-b8315621d258 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ecc46348e69041688c0db8edadbf512d', 'request_id': 'req-8eee4692-ce51-4075-b046-b8315621d258'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:02.401762 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-8eee4692-ce51-4075-b046-b8315621d258 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ecc46348e69041688c0db8edadbf512d', 'request_id': 'req-8eee4692-ce51-4075-b046-b8315621d258'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:02.415028 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-8eee4692-ce51-4075-b046-b8315621d258 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ecc46348e69041688c0db8edadbf512d', 'request_id': 'req-8eee4692-ce51-4075-b046-b8315621d258'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:02.440592 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e55e7c-b591-4607-907d-35a6f4472ff7 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:02.445401 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-8eee4692-ce51-4075-b046-b8315621d258 admin admin] The token cache is being invalidate because project ecc46348e69041688c0db8edadbf512d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:29:02.446109 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-8eee4692-ce51-4075-b046-b8315621d258 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:02.447580 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-8eee4692-ce51-4075-b046-b8315621d258 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:02.452256 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1281/2549] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 31 00:29:01 2022] DELETE /identity/v3/projects/ecc46348e69041688c0db8edadbf512d => generated 0 bytes in 662 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:29:02.458457 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eee4692-ce51-4075-b046-b8315621d258 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:02.461382 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-8eee4692-ce51-4075-b046-b8315621d258 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:02.521939 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505ccdd1-b84e-45f7-9547-c926973d79ff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beecda6e9feb400288618745c784989f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:02.522841 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505ccdd1-b84e-45f7-9547-c926973d79ff service cinder] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:02.523121 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505ccdd1-b84e-45f7-9547-c926973d79ff service cinder] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:02.523393 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505ccdd1-b84e-45f7-9547-c926973d79ff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:02.525365 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-505ccdd1-b84e-45f7-9547-c926973d79ff service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:02.547853 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:29:02.595431 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eee4692-ce51-4075-b046-b8315621d258 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:02.603445 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bce01af-5f02-45b2-b58a-a12cc3c2aa4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:02.606267 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bce01af-5f02-45b2-b58a-a12cc3c2aa4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:02.606902 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bce01af-5f02-45b2-b58a-a12cc3c2aa4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:02.607357 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bce01af-5f02-45b2-b58a-a12cc3c2aa4d admin admin] PATH_INFO: `/v3/users/9d356981388a40d6a2efa745ab039f37` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:02.609604 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bce01af-5f02-45b2-b58a-a12cc3c2aa4d admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d356981388a40d6a2efa745ab039f37)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:02.613982 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bce01af-5f02-45b2-b58a-a12cc3c2aa4d admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:02.670882 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505ccdd1-b84e-45f7-9547-c926973d79ff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:02.674348 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505ccdd1-b84e-45f7-9547-c926973d79ff service cinder] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:02.700619 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1269/2550] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:29:02 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:29:02.743413 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-5bce01af-5f02-45b2-b58a-a12cc3c2aa4d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d356981388a40d6a2efa745ab039f37'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:02.770533 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-5bce01af-5f02-45b2-b58a-a12cc3c2aa4d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d356981388a40d6a2efa745ab039f37'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:02.796863 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-5bce01af-5f02-45b2-b58a-a12cc3c2aa4d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d356981388a40d6a2efa745ab039f37'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:02.814030 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-5bce01af-5f02-45b2-b58a-a12cc3c2aa4d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d356981388a40d6a2efa745ab039f37'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:02.847328 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-5bce01af-5f02-45b2-b58a-a12cc3c2aa4d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d356981388a40d6a2efa745ab039f37'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:02.866923 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1282/2551] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 31 00:29:02 2022] DELETE /identity/v3/users/9d356981388a40d6a2efa745ab039f37 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:29:03.437728 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505ccdd1-b84e-45f7-9547-c926973d79ff service cinder] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:03.457554 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505ccdd1-b84e-45f7-9547-c926973d79ff service cinder] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:03.459512 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bce01af-5f02-45b2-b58a-a12cc3c2aa4d admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:03.461762 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-5bce01af-5f02-45b2-b58a-a12cc3c2aa4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:03.583170 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:29:03.596657 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff016e9-aac6-442a-bc38-4ee7f389a1d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:03.597805 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff016e9-aac6-442a-bc38-4ee7f389a1d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:03.598393 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff016e9-aac6-442a-bc38-4ee7f389a1d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:03.599334 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff016e9-aac6-442a-bc38-4ee7f389a1d7 admin admin] PATH_INFO: `/v3/projects/bed0ffe4d8a4418285fd4b02e56e805f` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:03.602063 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff016e9-aac6-442a-bc38-4ee7f389a1d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bed0ffe4d8a4418285fd4b02e56e805f)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:03.606456 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff016e9-aac6-442a-bc38-4ee7f389a1d7 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:03.606759 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bce01af-5f02-45b2-b58a-a12cc3c2aa4d admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:03.612857 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f105b4e-f43c-4f61-a1a6-9fa543e1d9e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:03.613500 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f105b4e-f43c-4f61-a1a6-9fa543e1d9e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:03.613799 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f105b4e-f43c-4f61-a1a6-9fa543e1d9e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:03.614063 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f105b4e-f43c-4f61-a1a6-9fa543e1d9e1 admin admin] PATH_INFO: `/v3/users/def8e7ed6e024b1db0cd1f712b1f5711` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:03.615670 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f105b4e-f43c-4f61-a1a6-9fa543e1d9e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=def8e7ed6e024b1db0cd1f712b1f5711)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:03.620207 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f105b4e-f43c-4f61-a1a6-9fa543e1d9e1 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:03.706249 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-1ff016e9-aac6-442a-bc38-4ee7f389a1d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bed0ffe4d8a4418285fd4b02e56e805f', 'request_id': 'req-1ff016e9-aac6-442a-bc38-4ee7f389a1d7'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:03.718992 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-7f105b4e-f43c-4f61-a1a6-9fa543e1d9e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'def8e7ed6e024b1db0cd1f712b1f5711'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:03.719419 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-1ff016e9-aac6-442a-bc38-4ee7f389a1d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bed0ffe4d8a4418285fd4b02e56e805f', 'request_id': 'req-1ff016e9-aac6-442a-bc38-4ee7f389a1d7'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:03.732040 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-1ff016e9-aac6-442a-bc38-4ee7f389a1d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bed0ffe4d8a4418285fd4b02e56e805f', 'request_id': 'req-1ff016e9-aac6-442a-bc38-4ee7f389a1d7'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:03.734897 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-7f105b4e-f43c-4f61-a1a6-9fa543e1d9e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'def8e7ed6e024b1db0cd1f712b1f5711'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:03.755484 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-7f105b4e-f43c-4f61-a1a6-9fa543e1d9e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'def8e7ed6e024b1db0cd1f712b1f5711'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:03.757110 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-7f105b4e-f43c-4f61-a1a6-9fa543e1d9e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'def8e7ed6e024b1db0cd1f712b1f5711'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:03.757737 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-1ff016e9-aac6-442a-bc38-4ee7f389a1d7 admin admin] The token cache is being invalidate because project bed0ffe4d8a4418285fd4b02e56e805f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81523) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:29:03.758040 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-1ff016e9-aac6-442a-bc38-4ee7f389a1d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:03.758800 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-1ff016e9-aac6-442a-bc38-4ee7f389a1d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:03.761293 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1270/2552] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 31 00:29:03 2022] DELETE /identity/v3/projects/bed0ffe4d8a4418285fd4b02e56e805f => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:29:03.767380 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60333954-52e8-4446-a343-d8f2af6c951f None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:03.767661 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60333954-52e8-4446-a343-d8f2af6c951f None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:03.767921 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60333954-52e8-4446-a343-d8f2af6c951f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:03.789383 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-7f105b4e-f43c-4f61-a1a6-9fa543e1d9e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'def8e7ed6e024b1db0cd1f712b1f5711'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:03.792678 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-60333954-52e8-4446-a343-d8f2af6c951f None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:29:03.793968 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-60333954-52e8-4446-a343-d8f2af6c951f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:03.804251 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1283/2553] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 31 00:29:03 2022] DELETE /identity/v3/users/def8e7ed6e024b1db0cd1f712b1f5711 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:29:03.812694 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e87fa1-e585-47c0-8932-c1f77e0162ec None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:03.814374 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e87fa1-e585-47c0-8932-c1f77e0162ec None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:03.815116 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e87fa1-e585-47c0-8932-c1f77e0162ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:03.853110 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-e1e87fa1-e585-47c0-8932-c1f77e0162ec None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:29:03.854841 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:29:03.856070 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-e1e87fa1-e585-47c0-8932-c1f77e0162ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:03.927237 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1271/2554] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:29:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:29:03.940119 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a45723f-0048-4cca-baf6-7dee5016b07a None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:03.940510 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a45723f-0048-4cca-baf6-7dee5016b07a None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:03.940932 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a45723f-0048-4cca-baf6-7dee5016b07a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:03.990441 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-0a45723f-0048-4cca-baf6-7dee5016b07a None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:29:03.993158 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-0a45723f-0048-4cca-baf6-7dee5016b07a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:03.998000 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1284/2555] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:29:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:29:04.009004 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e87fa1-e585-47c0-8932-c1f77e0162ec None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:04.010643 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-e1e87fa1-e585-47c0-8932-c1f77e0162ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:04.012877 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1272/2556] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:29:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:29:04.019137 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a45723f-0048-4cca-baf6-7dee5016b07a None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:04.037973 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a45723f-0048-4cca-baf6-7dee5016b07a None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:04.046351 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cd4726-b30e-47f7-91ca-2c9a131a0360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:04.047420 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cd4726-b30e-47f7-91ca-2c9a131a0360 admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:04.048590 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cd4726-b30e-47f7-91ca-2c9a131a0360 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:04.048939 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cd4726-b30e-47f7-91ca-2c9a131a0360 admin admin] PATH_INFO: `/v3/domains` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:04.050221 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cd4726-b30e-47f7-91ca-2c9a131a0360 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:29:04.050944 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cd4726-b30e-47f7-91ca-2c9a131a0360 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:04.053056 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cd4726-b30e-47f7-91ca-2c9a131a0360 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:04.071785 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1273/2557] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 31 00:29:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:29:04.076955 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cd4726-b30e-47f7-91ca-2c9a131a0360 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:04.090508 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cd4726-b30e-47f7-91ca-2c9a131a0360 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:04.097644 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d57c2ae-83ea-450a-a054-5f980eed18f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:04.097644 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d57c2ae-83ea-450a-a054-5f980eed18f5 admin admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:04.098175 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d57c2ae-83ea-450a-a054-5f980eed18f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:04.098175 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d57c2ae-83ea-450a-a054-5f980eed18f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:04.099015 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d57c2ae-83ea-450a-a054-5f980eed18f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:04.101377 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d57c2ae-83ea-450a-a054-5f980eed18f5 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:04.132509 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e87fa1-e585-47c0-8932-c1f77e0162ec None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:04.139193 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fc787e-0d6c-4fef-8918-411606da5ab3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'daae792cd11d4c4ca7aae0558998aced', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:04.140312 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fc787e-0d6c-4fef-8918-411606da5ab3 service neutron] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:04.140803 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fc787e-0d6c-4fef-8918-411606da5ab3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:04.141291 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fc787e-0d6c-4fef-8918-411606da5ab3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:04.143564 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1274/2558] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 31 00:29:04 2022] POST /identity/v3/projects => generated 381 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:29:04.149870 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d57c2ae-83ea-450a-a054-5f980eed18f5 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:04.165838 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fc787e-0d6c-4fef-8918-411606da5ab3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:04.169960 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fc787e-0d6c-4fef-8918-411606da5ab3 service neutron] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:04.189633 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1285/2559] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:29:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 00:29:04.278197 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d57c2ae-83ea-450a-a054-5f980eed18f5 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:04.306038 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4757161c-f32e-4ea8-a585-7dc9e6fa0e67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:04.310183 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4757161c-f32e-4ea8-a585-7dc9e6fa0e67 admin admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:04.312450 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4757161c-f32e-4ea8-a585-7dc9e6fa0e67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:04.313222 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4757161c-f32e-4ea8-a585-7dc9e6fa0e67 admin admin] PATH_INFO: `/v3/users` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:04.314309 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4757161c-f32e-4ea8-a585-7dc9e6fa0e67 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:04.317579 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4757161c-f32e-4ea8-a585-7dc9e6fa0e67 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:04.351690 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1275/2560] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 31 00:29:04 2022] POST /identity/v3/users => generated 291 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:29:04.358257 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fc787e-0d6c-4fef-8918-411606da5ab3 service neutron] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:04.378391 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fc787e-0d6c-4fef-8918-411606da5ab3 service neutron] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:04.389080 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f40825c-9a45-4a8a-8fc8-be0321cca402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:04.390452 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f40825c-9a45-4a8a-8fc8-be0321cca402 admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:04.390956 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f40825c-9a45-4a8a-8fc8-be0321cca402 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:04.391522 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f40825c-9a45-4a8a-8fc8-be0321cca402 admin admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:04.392952 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f40825c-9a45-4a8a-8fc8-be0321cca402 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:04.396610 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f40825c-9a45-4a8a-8fc8-be0321cca402 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:04.421776 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1286/2561] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 00:29:04 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:29:04.426608 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4757161c-f32e-4ea8-a585-7dc9e6fa0e67 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:04.440776 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4757161c-f32e-4ea8-a585-7dc9e6fa0e67 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:04.446634 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6671f4bb-005f-44a2-b3a3-b1f4499c7f7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:04.447034 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6671f4bb-005f-44a2-b3a3-b1f4499c7f7c admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:04.447193 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6671f4bb-005f-44a2-b3a3-b1f4499c7f7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:04.447469 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6671f4bb-005f-44a2-b3a3-b1f4499c7f7c admin admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:04.448946 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6671f4bb-005f-44a2-b3a3-b1f4499c7f7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:04.450666 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6671f4bb-005f-44a2-b3a3-b1f4499c7f7c admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:04.467173 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1276/2562] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 00:29:04 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:29:04.470348 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f40825c-9a45-4a8a-8fc8-be0321cca402 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:04.482941 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:29:04.492803 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f40825c-9a45-4a8a-8fc8-be0321cca402 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:04.502305 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca258b1c-c0ac-42d7-bd96-cba82712329c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:04.503019 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca258b1c-c0ac-42d7-bd96-cba82712329c admin admin] REQUEST_METHOD: `PUT` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:04.503196 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca258b1c-c0ac-42d7-bd96-cba82712329c admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:04.503413 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca258b1c-c0ac-42d7-bd96-cba82712329c admin admin] PATH_INFO: `/v3/projects/d76012ed05a44aca8d643c6966ab10e0/users/bd5d92110ca94460b836f76f85d515ea/roles/fdad79ffbcbb4fa380dc9cf7dd108618` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:04.527322 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca258b1c-c0ac-42d7-bd96-cba82712329c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d76012ed05a44aca8d643c6966ab10e0, user_id=bd5d92110ca94460b836f76f85d515ea, role_id=fdad79ffbcbb4fa380dc9cf7dd108618)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:04.532522 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca258b1c-c0ac-42d7-bd96-cba82712329c admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:04.559855 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1287/2563] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 00:29:04 2022] PUT /identity/v3/projects/d76012ed05a44aca8d643c6966ab10e0/users/bd5d92110ca94460b836f76f85d515ea/roles/fdad79ffbcbb4fa380dc9cf7dd108618 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:29:04.571633 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b54f48-49c3-4c49-9c6f-01a78844f1a5 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:04.572227 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b54f48-49c3-4c49-9c6f-01a78844f1a5 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:04.572675 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b54f48-49c3-4c49-9c6f-01a78844f1a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:04.631153 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-46b54f48-49c3-4c49-9c6f-01a78844f1a5 None None] MFA Rules not processed for user `bd5d92110ca94460b836f76f85d515ea`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:29:04.633299 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-46b54f48-49c3-4c49-9c6f-01a78844f1a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:04.701530 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca258b1c-c0ac-42d7-bd96-cba82712329c admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:04.703959 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-ca258b1c-c0ac-42d7-bd96-cba82712329c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:04.804028 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1277/2564] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:29:04 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:29:04.805151 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b54f48-49c3-4c49-9c6f-01a78844f1a5 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:04.815776 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:29:04.846302 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca258b1c-c0ac-42d7-bd96-cba82712329c admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:04.852080 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbfee42-62b9-4591-b8bb-3b2d5b00d0c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:04.853065 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbfee42-62b9-4591-b8bb-3b2d5b00d0c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:04.853065 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbfee42-62b9-4591-b8bb-3b2d5b00d0c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:04.853420 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbfee42-62b9-4591-b8bb-3b2d5b00d0c5 admin admin] PATH_INFO: `/v3/projects/59f91ea9c31b47669a9af471549c0027` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:04.855636 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbfee42-62b9-4591-b8bb-3b2d5b00d0c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=59f91ea9c31b47669a9af471549c0027)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:04.857270 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbfee42-62b9-4591-b8bb-3b2d5b00d0c5 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:04.910435 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b54f48-49c3-4c49-9c6f-01a78844f1a5 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:04.915660 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b143fd4b-e7d0-4d65-ba2b-098967013177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:04.916335 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b143fd4b-e7d0-4d65-ba2b-098967013177 admin admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:04.916621 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b143fd4b-e7d0-4d65-ba2b-098967013177 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:04.917644 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b143fd4b-e7d0-4d65-ba2b-098967013177 admin admin] PATH_INFO: `/v3/projects` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:04.918394 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b143fd4b-e7d0-4d65-ba2b-098967013177 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:04.921113 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b143fd4b-e7d0-4d65-ba2b-098967013177 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:04.938253 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-3fbfee42-62b9-4591-b8bb-3b2d5b00d0c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59f91ea9c31b47669a9af471549c0027', 'request_id': 'req-3fbfee42-62b9-4591-b8bb-3b2d5b00d0c5'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:04.946768 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-3fbfee42-62b9-4591-b8bb-3b2d5b00d0c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59f91ea9c31b47669a9af471549c0027', 'request_id': 'req-3fbfee42-62b9-4591-b8bb-3b2d5b00d0c5'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:04.954586 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-3fbfee42-62b9-4591-b8bb-3b2d5b00d0c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59f91ea9c31b47669a9af471549c0027', 'request_id': 'req-3fbfee42-62b9-4591-b8bb-3b2d5b00d0c5'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:04.960632 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1278/2565] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 31 00:29:04 2022] POST /identity/v3/projects => generated 381 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:29:04.966834 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b143fd4b-e7d0-4d65-ba2b-098967013177 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:04.972208 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-3fbfee42-62b9-4591-b8bb-3b2d5b00d0c5 admin admin] The token cache is being invalidate because project 59f91ea9c31b47669a9af471549c0027 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:29:04.972808 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-3fbfee42-62b9-4591-b8bb-3b2d5b00d0c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:04.973565 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-3fbfee42-62b9-4591-b8bb-3b2d5b00d0c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:04.978152 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1288/2566] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 31 00:29:04 2022] DELETE /identity/v3/projects/59f91ea9c31b47669a9af471549c0027 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:29:04.980477 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbfee42-62b9-4591-b8bb-3b2d5b00d0c5 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:04.982893 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-3fbfee42-62b9-4591-b8bb-3b2d5b00d0c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:05.086213 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbfee42-62b9-4591-b8bb-3b2d5b00d0c5 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:05.100575 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:29:05.132636 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b143fd4b-e7d0-4d65-ba2b-098967013177 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:05.140903 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e185e4-8e74-49fc-9edb-9a5e40bf44df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:05.142135 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e185e4-8e74-49fc-9edb-9a5e40bf44df admin admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:05.142700 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e185e4-8e74-49fc-9edb-9a5e40bf44df admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:05.143267 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e185e4-8e74-49fc-9edb-9a5e40bf44df admin admin] PATH_INFO: `/v3/users` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:05.144555 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e185e4-8e74-49fc-9edb-9a5e40bf44df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:05.148654 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e185e4-8e74-49fc-9edb-9a5e40bf44df admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:05.198612 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1279/2567] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 31 00:29:04 2022] POST /identity/v3/users => generated 297 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:29:05.201702 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e185e4-8e74-49fc-9edb-9a5e40bf44df admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:05.204687 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7968dcd7-4806-447b-92a0-46e92de7eaa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:05.205822 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7968dcd7-4806-447b-92a0-46e92de7eaa7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:05.206546 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7968dcd7-4806-447b-92a0-46e92de7eaa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:05.206969 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7968dcd7-4806-447b-92a0-46e92de7eaa7 admin admin] PATH_INFO: `/v3/users/903bcee6ad0541598013b7b70fbcdcb2` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:05.208317 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-69e185e4-8e74-49fc-9edb-9a5e40bf44df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:05.208920 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7968dcd7-4806-447b-92a0-46e92de7eaa7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=903bcee6ad0541598013b7b70fbcdcb2)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:05.213856 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7968dcd7-4806-447b-92a0-46e92de7eaa7 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:05.228956 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e185e4-8e74-49fc-9edb-9a5e40bf44df admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:05.238191 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35aff8ac-f6d9-4617-90e0-93173e219f74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:05.239101 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aff8ac-f6d9-4617-90e0-93173e219f74 admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:05.239495 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aff8ac-f6d9-4617-90e0-93173e219f74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:05.239943 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aff8ac-f6d9-4617-90e0-93173e219f74 admin admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:05.241320 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35aff8ac-f6d9-4617-90e0-93173e219f74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:05.244646 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35aff8ac-f6d9-4617-90e0-93173e219f74 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:05.263274 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1280/2568] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 00:29:05 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:29:05.268484 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35aff8ac-f6d9-4617-90e0-93173e219f74 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:05.289578 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35aff8ac-f6d9-4617-90e0-93173e219f74 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:05.295019 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-7968dcd7-4806-447b-92a0-46e92de7eaa7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '903bcee6ad0541598013b7b70fbcdcb2'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:05.299348 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7999735c-a18e-4c05-918c-b81359b5ef27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:05.300745 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7999735c-a18e-4c05-918c-b81359b5ef27 admin admin] REQUEST_METHOD: `PUT` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:05.301662 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7999735c-a18e-4c05-918c-b81359b5ef27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:05.301662 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7999735c-a18e-4c05-918c-b81359b5ef27 admin admin] PATH_INFO: `/v3/projects/ac87ea4e914142c6bbd23e1df9f6a2ee/users/d916c7a78bc242729b4618696352c9d0/roles/12f6817f9aaa4e2bb477095a6bed5d0f` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:05.321100 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-7968dcd7-4806-447b-92a0-46e92de7eaa7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '903bcee6ad0541598013b7b70fbcdcb2'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:05.338498 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7999735c-a18e-4c05-918c-b81359b5ef27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac87ea4e914142c6bbd23e1df9f6a2ee, user_id=d916c7a78bc242729b4618696352c9d0, role_id=12f6817f9aaa4e2bb477095a6bed5d0f)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:05.343220 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-7968dcd7-4806-447b-92a0-46e92de7eaa7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '903bcee6ad0541598013b7b70fbcdcb2'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:05.344445 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-7968dcd7-4806-447b-92a0-46e92de7eaa7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '903bcee6ad0541598013b7b70fbcdcb2'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:05.345708 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7999735c-a18e-4c05-918c-b81359b5ef27 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:05.371986 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-7968dcd7-4806-447b-92a0-46e92de7eaa7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '903bcee6ad0541598013b7b70fbcdcb2'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:05.391612 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1281/2569] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 00:29:05 2022] PUT /identity/v3/projects/ac87ea4e914142c6bbd23e1df9f6a2ee/users/d916c7a78bc242729b4618696352c9d0/roles/12f6817f9aaa4e2bb477095a6bed5d0f => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:29:05.393675 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1289/2570] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 31 00:29:04 2022] DELETE /identity/v3/users/903bcee6ad0541598013b7b70fbcdcb2 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:29:05.398669 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7999735c-a18e-4c05-918c-b81359b5ef27 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:05.401614 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-7999735c-a18e-4c05-918c-b81359b5ef27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:05.520891 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:29:05.560588 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7999735c-a18e-4c05-918c-b81359b5ef27 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:05.667981 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35026a09-4426-4758-a8c6-97b123aea9e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:05.668886 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35026a09-4426-4758-a8c6-97b123aea9e3 admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:05.669225 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35026a09-4426-4758-a8c6-97b123aea9e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:05.669587 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35026a09-4426-4758-a8c6-97b123aea9e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:05.670297 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35026a09-4426-4758-a8c6-97b123aea9e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:05.672438 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35026a09-4426-4758-a8c6-97b123aea9e3 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:05.686027 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1282/2571] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 00:29:05 2022] GET /identity/v3/roles => generated 1420 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:29:05.690692 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7968dcd7-4806-447b-92a0-46e92de7eaa7 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:05.706856 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7968dcd7-4806-447b-92a0-46e92de7eaa7 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:05.730952 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb78a5b3-8551-4c41-ac31-f3aa080ef0fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:05.733488 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb78a5b3-8551-4c41-ac31-f3aa080ef0fb admin admin] REQUEST_METHOD: `PUT` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:05.735174 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb78a5b3-8551-4c41-ac31-f3aa080ef0fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:05.735691 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb78a5b3-8551-4c41-ac31-f3aa080ef0fb admin admin] PATH_INFO: `/v3/projects/ac87ea4e914142c6bbd23e1df9f6a2ee/users/d916c7a78bc242729b4618696352c9d0/roles/12f6817f9aaa4e2bb477095a6bed5d0f` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:05.744560 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb78a5b3-8551-4c41-ac31-f3aa080ef0fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac87ea4e914142c6bbd23e1df9f6a2ee, user_id=d916c7a78bc242729b4618696352c9d0, role_id=12f6817f9aaa4e2bb477095a6bed5d0f)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:05.750858 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb78a5b3-8551-4c41-ac31-f3aa080ef0fb admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:05.776867 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1290/2572] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 00:29:05 2022] PUT /identity/v3/projects/ac87ea4e914142c6bbd23e1df9f6a2ee/users/d916c7a78bc242729b4618696352c9d0/roles/12f6817f9aaa4e2bb477095a6bed5d0f => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:29:05.789205 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaea6c6-f5fa-42a6-8ca5-c54624ac8bea None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:05.790270 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaea6c6-f5fa-42a6-8ca5-c54624ac8bea None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:05.790270 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaea6c6-f5fa-42a6-8ca5-c54624ac8bea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:05.836000 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-8eaea6c6-f5fa-42a6-8ca5-c54624ac8bea None None] MFA Rules not processed for user `d916c7a78bc242729b4618696352c9d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:29:05.837367 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-8eaea6c6-f5fa-42a6-8ca5-c54624ac8bea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:05.924549 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1283/2573] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:29:05 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:29:05.937549 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb78a5b3-8551-4c41-ac31-f3aa080ef0fb admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:05.939911 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-cb78a5b3-8551-4c41-ac31-f3aa080ef0fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:05.966436 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaea6c6-f5fa-42a6-8ca5-c54624ac8bea None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:05.968931 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-8eaea6c6-f5fa-42a6-8ca5-c54624ac8bea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:06.034960 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb78a5b3-8551-4c41-ac31-f3aa080ef0fb admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:06.038972 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a668f295-38f5-4b5c-ba8f-d43143233940 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beecda6e9feb400288618745c784989f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:06.039607 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a668f295-38f5-4b5c-ba8f-d43143233940 service cinder] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:06.039893 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a668f295-38f5-4b5c-ba8f-d43143233940 service cinder] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:06.040298 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a668f295-38f5-4b5c-ba8f-d43143233940 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:06.051380 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a668f295-38f5-4b5c-ba8f-d43143233940 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:06.052878 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a668f295-38f5-4b5c-ba8f-d43143233940 service cinder] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:06.065564 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1291/2574] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:29:05 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:29:06.111376 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaea6c6-f5fa-42a6-8ca5-c54624ac8bea None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:06.119710 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe04d3a-7456-4979-abbe-254f4d96613a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:06.121407 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe04d3a-7456-4979-abbe-254f4d96613a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:06.121913 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe04d3a-7456-4979-abbe-254f4d96613a admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:06.122414 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe04d3a-7456-4979-abbe-254f4d96613a admin admin] PATH_INFO: `/v3/projects/a22a231e06834ba287eaea8cfcb0b547` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:06.125494 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe04d3a-7456-4979-abbe-254f4d96613a admin admin] RBAC: Authorizing `identity:delete_project(project_id=a22a231e06834ba287eaea8cfcb0b547)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:06.128654 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe04d3a-7456-4979-abbe-254f4d96613a admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:06.160278 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:29:06.160605 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a668f295-38f5-4b5c-ba8f-d43143233940 service cinder] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:06.174901 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a668f295-38f5-4b5c-ba8f-d43143233940 service cinder] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:06.180103 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed970df9-cf3b-4606-aaa8-0e9f357ae615 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beecda6e9feb400288618745c784989f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:06.181196 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed970df9-cf3b-4606-aaa8-0e9f357ae615 service cinder] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:06.181483 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed970df9-cf3b-4606-aaa8-0e9f357ae615 service cinder] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:06.181926 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed970df9-cf3b-4606-aaa8-0e9f357ae615 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:06.185220 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-ed970df9-cf3b-4606-aaa8-0e9f357ae615 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:06.213943 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-dfe04d3a-7456-4979-abbe-254f4d96613a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a22a231e06834ba287eaea8cfcb0b547', 'request_id': 'req-dfe04d3a-7456-4979-abbe-254f4d96613a'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:06.220789 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:29:06.223617 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-dfe04d3a-7456-4979-abbe-254f4d96613a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a22a231e06834ba287eaea8cfcb0b547', 'request_id': 'req-dfe04d3a-7456-4979-abbe-254f4d96613a'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:06.233166 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-dfe04d3a-7456-4979-abbe-254f4d96613a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a22a231e06834ba287eaea8cfcb0b547', 'request_id': 'req-dfe04d3a-7456-4979-abbe-254f4d96613a'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:06.251752 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-dfe04d3a-7456-4979-abbe-254f4d96613a admin admin] The token cache is being invalidate because project a22a231e06834ba287eaea8cfcb0b547 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81523) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:29:06.252057 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-dfe04d3a-7456-4979-abbe-254f4d96613a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:06.252782 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-dfe04d3a-7456-4979-abbe-254f4d96613a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:06.254389 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1284/2575] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 31 00:29:05 2022] DELETE /identity/v3/projects/a22a231e06834ba287eaea8cfcb0b547 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:29:06.260313 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1fff8d-b4ff-4bae-b428-35596c27c556 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:06.261249 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1fff8d-b4ff-4bae-b428-35596c27c556 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:06.261680 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1fff8d-b4ff-4bae-b428-35596c27c556 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:06.284328 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed970df9-cf3b-4606-aaa8-0e9f357ae615 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:06.285815 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed970df9-cf3b-4606-aaa8-0e9f357ae615 service cinder] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:06.288475 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-0f1fff8d-b4ff-4bae-b428-35596c27c556 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:29:06.290249 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-0f1fff8d-b4ff-4bae-b428-35596c27c556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:06.299086 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1292/2576] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:29:06 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 00:29:06.373764 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1285/2577] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:29:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:29:06.385054 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c003b0-caa8-4a2e-a18c-ca0c772fe17d None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:06.385689 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c003b0-caa8-4a2e-a18c-ca0c772fe17d None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:06.386132 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c003b0-caa8-4a2e-a18c-ca0c772fe17d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:06.418071 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-03c003b0-caa8-4a2e-a18c-ca0c772fe17d None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:29:06.420720 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-03c003b0-caa8-4a2e-a18c-ca0c772fe17d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:06.435710 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1293/2578] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:29:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:29:06.442557 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1fff8d-b4ff-4bae-b428-35596c27c556 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:06.462814 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1fff8d-b4ff-4bae-b428-35596c27c556 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:06.473028 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05518346-0372-441f-8d90-91bcefd8e4ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:06.474192 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05518346-0372-441f-8d90-91bcefd8e4ac admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:06.477520 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05518346-0372-441f-8d90-91bcefd8e4ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:06.477520 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05518346-0372-441f-8d90-91bcefd8e4ac admin admin] PATH_INFO: `/v3/domains` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:06.477520 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05518346-0372-441f-8d90-91bcefd8e4ac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:29:06.477520 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05518346-0372-441f-8d90-91bcefd8e4ac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:06.481173 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05518346-0372-441f-8d90-91bcefd8e4ac admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:06.505042 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1286/2579] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 31 00:29:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:29:06.509832 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c003b0-caa8-4a2e-a18c-ca0c772fe17d None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:06.530176 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c003b0-caa8-4a2e-a18c-ca0c772fe17d None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:06.544814 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c74fe5-c5d9-4a4d-bd8e-b5f33af71b23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:06.545663 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c74fe5-c5d9-4a4d-bd8e-b5f33af71b23 admin admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:06.546406 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c74fe5-c5d9-4a4d-bd8e-b5f33af71b23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:06.546983 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c74fe5-c5d9-4a4d-bd8e-b5f33af71b23 admin admin] PATH_INFO: `/v3/projects` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:06.549076 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c74fe5-c5d9-4a4d-bd8e-b5f33af71b23 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:06.551463 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c74fe5-c5d9-4a4d-bd8e-b5f33af71b23 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:06.602420 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1294/2580] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 31 00:29:06 2022] POST /identity/v3/projects => generated 363 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:29:06.608353 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05518346-0372-441f-8d90-91bcefd8e4ac admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:06.630540 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05518346-0372-441f-8d90-91bcefd8e4ac admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:06.752925 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8d4e73-7d73-424a-90c1-8da19ecd0c0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:06.753694 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8d4e73-7d73-424a-90c1-8da19ecd0c0b admin admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:06.754070 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8d4e73-7d73-424a-90c1-8da19ecd0c0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:06.754452 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8d4e73-7d73-424a-90c1-8da19ecd0c0b admin admin] PATH_INFO: `/v3/users` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:06.755283 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8d4e73-7d73-424a-90c1-8da19ecd0c0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:06.758223 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8d4e73-7d73-424a-90c1-8da19ecd0c0b admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:06.781701 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c74fe5-c5d9-4a4d-bd8e-b5f33af71b23 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:06.782872 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1287/2581] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 31 00:29:06 2022] POST /identity/v3/users => generated 282 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:29:06.784105 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-a5c74fe5-c5d9-4a4d-bd8e-b5f33af71b23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:06.788883 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8d4e73-7d73-424a-90c1-8da19ecd0c0b admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:06.802018 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8d4e73-7d73-424a-90c1-8da19ecd0c0b admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:06.804747 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c74fe5-c5d9-4a4d-bd8e-b5f33af71b23 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:06.807214 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7288e1f-0671-4d7c-a142-b6b8c00ab6b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:06.808537 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7288e1f-0671-4d7c-a142-b6b8c00ab6b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:06.808818 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7288e1f-0671-4d7c-a142-b6b8c00ab6b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:06.809093 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7288e1f-0671-4d7c-a142-b6b8c00ab6b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:06.810045 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7288e1f-0671-4d7c-a142-b6b8c00ab6b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:06.812778 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dc7939-06c6-4c2e-b0f8-996e66594d03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:06.813128 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7288e1f-0671-4d7c-a142-b6b8c00ab6b7 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:06.813681 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dc7939-06c6-4c2e-b0f8-996e66594d03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:06.814056 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dc7939-06c6-4c2e-b0f8-996e66594d03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:06.814424 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dc7939-06c6-4c2e-b0f8-996e66594d03 admin admin] PATH_INFO: `/v3/users/bd5d92110ca94460b836f76f85d515ea` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:06.816015 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78dc7939-06c6-4c2e-b0f8-996e66594d03 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd5d92110ca94460b836f76f85d515ea)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:06.818774 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78dc7939-06c6-4c2e-b0f8-996e66594d03 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:06.834171 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1288/2582] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 00:29:06 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 00:29:06.839167 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7288e1f-0671-4d7c-a142-b6b8c00ab6b7 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:06.850773 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7288e1f-0671-4d7c-a142-b6b8c00ab6b7 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:06.856826 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07762d8-21f1-4c99-b19f-91c52abd8416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:06.857748 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07762d8-21f1-4c99-b19f-91c52abd8416 admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:06.857748 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07762d8-21f1-4c99-b19f-91c52abd8416 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:06.858076 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07762d8-21f1-4c99-b19f-91c52abd8416 admin admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:06.858737 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07762d8-21f1-4c99-b19f-91c52abd8416 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:06.860912 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07762d8-21f1-4c99-b19f-91c52abd8416 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:06.870354 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:29:06.877990 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1289/2583] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 00:29:06 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 00:29:06.883021 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07762d8-21f1-4c99-b19f-91c52abd8416 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:06.904033 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07762d8-21f1-4c99-b19f-91c52abd8416 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:06.904464 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-78dc7939-06c6-4c2e-b0f8-996e66594d03 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd5d92110ca94460b836f76f85d515ea'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:06.911989 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e530406e-48dc-4b08-8684-c1a4800f3b52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:06.913296 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e530406e-48dc-4b08-8684-c1a4800f3b52 admin admin] REQUEST_METHOD: `PUT` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:06.914338 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e530406e-48dc-4b08-8684-c1a4800f3b52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:06.914810 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e530406e-48dc-4b08-8684-c1a4800f3b52 admin admin] PATH_INFO: `/v3/projects/ac287c87cfe8462e83ff18e52ddf4e6f/users/75d7f0079f5c4a20b4a070f6f203e562/roles/fdad79ffbcbb4fa380dc9cf7dd108618` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:06.914931 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-78dc7939-06c6-4c2e-b0f8-996e66594d03 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd5d92110ca94460b836f76f85d515ea'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:06.928001 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-78dc7939-06c6-4c2e-b0f8-996e66594d03 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd5d92110ca94460b836f76f85d515ea'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:06.929151 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-78dc7939-06c6-4c2e-b0f8-996e66594d03 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd5d92110ca94460b836f76f85d515ea'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:06.941286 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e530406e-48dc-4b08-8684-c1a4800f3b52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac287c87cfe8462e83ff18e52ddf4e6f, user_id=75d7f0079f5c4a20b4a070f6f203e562, role_id=fdad79ffbcbb4fa380dc9cf7dd108618)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:06.946340 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e530406e-48dc-4b08-8684-c1a4800f3b52 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:06.954229 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-78dc7939-06c6-4c2e-b0f8-996e66594d03 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd5d92110ca94460b836f76f85d515ea'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:06.966136 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1290/2584] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 00:29:06 2022] PUT /identity/v3/projects/ac287c87cfe8462e83ff18e52ddf4e6f/users/75d7f0079f5c4a20b4a070f6f203e562/roles/fdad79ffbcbb4fa380dc9cf7dd108618 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:29:06.966773 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1295/2585] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 31 00:29:06 2022] DELETE /identity/v3/users/bd5d92110ca94460b836f76f85d515ea => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:29:06.975360 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fb452d-e36c-4a7d-bf50-e56bf5d0c674 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:06.976370 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fb452d-e36c-4a7d-bf50-e56bf5d0c674 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:06.977216 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fb452d-e36c-4a7d-bf50-e56bf5d0c674 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:07.006243 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b0030c-33f0-4837-b816-31000312717d None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:07.007421 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b0030c-33f0-4837-b816-31000312717d None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:07.008407 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b0030c-33f0-4837-b816-31000312717d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:07.009433 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-c7fb452d-e36c-4a7d-bf50-e56bf5d0c674 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:29:07.011339 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-c7fb452d-e36c-4a7d-bf50-e56bf5d0c674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:07.062466 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-d9b0030c-33f0-4837-b816-31000312717d None None] MFA Rules not processed for user `75d7f0079f5c4a20b4a070f6f203e562`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:29:07.063725 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-d9b0030c-33f0-4837-b816-31000312717d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:07.101649 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1291/2586] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:29:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:29:07.113157 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fb452d-e36c-4a7d-bf50-e56bf5d0c674 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:07.114669 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-c7fb452d-e36c-4a7d-bf50-e56bf5d0c674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:07.171929 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:29:07.184857 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fb452d-e36c-4a7d-bf50-e56bf5d0c674 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:07.190282 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf88120-fd0f-46fc-8c0a-eb8fa4698a46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'daae792cd11d4c4ca7aae0558998aced', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:07.190928 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf88120-fd0f-46fc-8c0a-eb8fa4698a46 service neutron] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:07.191209 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf88120-fd0f-46fc-8c0a-eb8fa4698a46 service neutron] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:07.191481 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf88120-fd0f-46fc-8c0a-eb8fa4698a46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:07.202981 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf88120-fd0f-46fc-8c0a-eb8fa4698a46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:07.204495 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf88120-fd0f-46fc-8c0a-eb8fa4698a46 service neutron] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:07.211985 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1296/2587] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:29:07 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:29:07.217685 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b0030c-33f0-4837-b816-31000312717d None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:07.219813 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-d9b0030c-33f0-4837-b816-31000312717d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:07.222225 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1292/2588] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:29:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 00:29:07.238529 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b0030c-33f0-4837-b816-31000312717d None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:07.247327 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4277613e-51fa-45d8-ada3-617c04fe9abf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:07.249398 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4277613e-51fa-45d8-ada3-617c04fe9abf admin admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:07.249889 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4277613e-51fa-45d8-ada3-617c04fe9abf admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:07.250378 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4277613e-51fa-45d8-ada3-617c04fe9abf admin admin] PATH_INFO: `/v3/projects` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:07.251533 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4277613e-51fa-45d8-ada3-617c04fe9abf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:07.255510 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4277613e-51fa-45d8-ada3-617c04fe9abf admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:07.294838 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1297/2589] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 31 00:29:07 2022] POST /identity/v3/projects => generated 365 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:29:07.301359 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf88120-fd0f-46fc-8c0a-eb8fa4698a46 service neutron] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:07.313991 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf88120-fd0f-46fc-8c0a-eb8fa4698a46 service neutron] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:07.398310 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4277613e-51fa-45d8-ada3-617c04fe9abf admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:07.402525 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-4277613e-51fa-45d8-ada3-617c04fe9abf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:07.406170 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c55f32-c06b-493c-b14c-2c4191e9dfa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:07.406887 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c55f32-c06b-493c-b14c-2c4191e9dfa9 admin admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:07.407370 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c55f32-c06b-493c-b14c-2c4191e9dfa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:07.407683 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c55f32-c06b-493c-b14c-2c4191e9dfa9 admin admin] PATH_INFO: `/v3/users` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:07.408614 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c55f32-c06b-493c-b14c-2c4191e9dfa9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:07.410856 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c55f32-c06b-493c-b14c-2c4191e9dfa9 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:07.451158 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1293/2590] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 31 00:29:07 2022] POST /identity/v3/users => generated 289 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:29:07.459012 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c55f32-c06b-493c-b14c-2c4191e9dfa9 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:07.485754 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c55f32-c06b-493c-b14c-2c4191e9dfa9 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:07.509605 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ccfee1-b36f-4ca0-ac2f-56af76e170ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:07.511910 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ccfee1-b36f-4ca0-ac2f-56af76e170ed admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:07.512525 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ccfee1-b36f-4ca0-ac2f-56af76e170ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:07.514579 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ccfee1-b36f-4ca0-ac2f-56af76e170ed admin admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:07.516375 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ccfee1-b36f-4ca0-ac2f-56af76e170ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:07.518979 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4277613e-51fa-45d8-ada3-617c04fe9abf admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:07.519672 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ccfee1-b36f-4ca0-ac2f-56af76e170ed admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:07.524335 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:29:07.529719 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c96099e-47a6-48d9-bc81-89425b74223b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'daae792cd11d4c4ca7aae0558998aced', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:07.530612 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c96099e-47a6-48d9-bc81-89425b74223b service neutron] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:07.530904 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c96099e-47a6-48d9-bc81-89425b74223b service neutron] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:07.532065 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c96099e-47a6-48d9-bc81-89425b74223b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:07.534422 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-0c96099e-47a6-48d9-bc81-89425b74223b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:07.551257 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1294/2591] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 00:29:07 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 00:29:07.553062 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ccfee1-b36f-4ca0-ac2f-56af76e170ed admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:07.581072 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ccfee1-b36f-4ca0-ac2f-56af76e170ed admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:07.594205 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4b8f5c-a39f-48b5-9b05-643a747fc6ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:07.595841 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4b8f5c-a39f-48b5-9b05-643a747fc6ee admin admin] REQUEST_METHOD: `PUT` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:07.596499 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4b8f5c-a39f-48b5-9b05-643a747fc6ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:07.597024 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4b8f5c-a39f-48b5-9b05-643a747fc6ee admin admin] PATH_INFO: `/v3/projects/6555d12414bd458ea89f6ffba5271f7d/users/e5adcea59e984eb09a40530e86cac0ee/roles/12f6817f9aaa4e2bb477095a6bed5d0f` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:07.631223 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4b8f5c-a39f-48b5-9b05-643a747fc6ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=6555d12414bd458ea89f6ffba5271f7d, user_id=e5adcea59e984eb09a40530e86cac0ee, role_id=12f6817f9aaa4e2bb477095a6bed5d0f)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:07.638775 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4b8f5c-a39f-48b5-9b05-643a747fc6ee admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:07.664411 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1295/2592] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 00:29:07 2022] PUT /identity/v3/projects/6555d12414bd458ea89f6ffba5271f7d/users/e5adcea59e984eb09a40530e86cac0ee/roles/12f6817f9aaa4e2bb477095a6bed5d0f => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:29:07.671036 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4b8f5c-a39f-48b5-9b05-643a747fc6ee admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:07.690824 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c96099e-47a6-48d9-bc81-89425b74223b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:07.692521 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c96099e-47a6-48d9-bc81-89425b74223b service neutron] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:07.712462 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1298/2593] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:29:07 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:29:07.792179 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4b8f5c-a39f-48b5-9b05-643a747fc6ee admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:07.813230 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713093fa-be4b-4430-b601-fef5ff139df6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:07.815601 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713093fa-be4b-4430-b601-fef5ff139df6 admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:07.815601 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713093fa-be4b-4430-b601-fef5ff139df6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:07.815601 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713093fa-be4b-4430-b601-fef5ff139df6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:07.817525 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713093fa-be4b-4430-b601-fef5ff139df6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:07.822634 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713093fa-be4b-4430-b601-fef5ff139df6 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:07.852204 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1296/2594] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 00:29:07 2022] GET /identity/v3/roles => generated 1420 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:29:07.861893 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c96099e-47a6-48d9-bc81-89425b74223b service neutron] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:07.886137 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c96099e-47a6-48d9-bc81-89425b74223b service neutron] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:07.902778 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c34ecd-6c8c-45ce-ad39-76f0b5c48ac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:07.903616 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c34ecd-6c8c-45ce-ad39-76f0b5c48ac6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:07.903990 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c34ecd-6c8c-45ce-ad39-76f0b5c48ac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:07.904404 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c34ecd-6c8c-45ce-ad39-76f0b5c48ac6 admin admin] PATH_INFO: `/v3/projects/6555d12414bd458ea89f6ffba5271f7d/users/e5adcea59e984eb09a40530e86cac0ee/roles/12f6817f9aaa4e2bb477095a6bed5d0f` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:07.908055 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c34ecd-6c8c-45ce-ad39-76f0b5c48ac6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6555d12414bd458ea89f6ffba5271f7d, user_id=e5adcea59e984eb09a40530e86cac0ee, role_id=12f6817f9aaa4e2bb477095a6bed5d0f)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:07.910180 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c34ecd-6c8c-45ce-ad39-76f0b5c48ac6 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:07.934745 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1299/2595] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 00:29:07 2022] PUT /identity/v3/projects/6555d12414bd458ea89f6ffba5271f7d/users/e5adcea59e984eb09a40530e86cac0ee/roles/12f6817f9aaa4e2bb477095a6bed5d0f => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:29:07.935961 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713093fa-be4b-4430-b601-fef5ff139df6 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:07.955595 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b79fd6-0211-4ede-a7e1-29d2d76b3fcb None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:07.956120 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b79fd6-0211-4ede-a7e1-29d2d76b3fcb None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:07.956704 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b79fd6-0211-4ede-a7e1-29d2d76b3fcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:08.025717 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713093fa-be4b-4430-b601-fef5ff139df6 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:08.027091 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-f6b79fd6-0211-4ede-a7e1-29d2d76b3fcb None None] MFA Rules not processed for user `e5adcea59e984eb09a40530e86cac0ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:29:08.029706 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-f6b79fd6-0211-4ede-a7e1-29d2d76b3fcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:08.095806 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823d5f87-5b9f-49d8-955f-cc4214a558cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'daae792cd11d4c4ca7aae0558998aced', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:08.096542 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823d5f87-5b9f-49d8-955f-cc4214a558cf service neutron] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:08.096902 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823d5f87-5b9f-49d8-955f-cc4214a558cf service neutron] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:08.097175 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823d5f87-5b9f-49d8-955f-cc4214a558cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:08.099300 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-823d5f87-5b9f-49d8-955f-cc4214a558cf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:08.149626 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:29:08.167328 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:29:08.178708 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1300/2596] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:29:07 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:29:08.182988 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b79fd6-0211-4ede-a7e1-29d2d76b3fcb None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:08.188991 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-f6b79fd6-0211-4ede-a7e1-29d2d76b3fcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:08.195264 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823d5f87-5b9f-49d8-955f-cc4214a558cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:08.199477 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823d5f87-5b9f-49d8-955f-cc4214a558cf service neutron] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:08.214551 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b79fd6-0211-4ede-a7e1-29d2d76b3fcb None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:08.220466 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982afcc3-3e7d-4852-b406-d622387cb311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:08.221493 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982afcc3-3e7d-4852-b406-d622387cb311 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:08.221853 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1297/2597] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:29:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 00:29:08.222166 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982afcc3-3e7d-4852-b406-d622387cb311 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:08.222602 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982afcc3-3e7d-4852-b406-d622387cb311 admin admin] PATH_INFO: `/v3/projects/d76012ed05a44aca8d643c6966ab10e0` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:08.223396 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823d5f87-5b9f-49d8-955f-cc4214a558cf service neutron] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:08.224473 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982afcc3-3e7d-4852-b406-d622387cb311 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d76012ed05a44aca8d643c6966ab10e0)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:08.225746 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-823d5f87-5b9f-49d8-955f-cc4214a558cf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:08.227468 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982afcc3-3e7d-4852-b406-d622387cb311 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:08.306882 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-982afcc3-3e7d-4852-b406-d622387cb311 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd76012ed05a44aca8d643c6966ab10e0', 'request_id': 'req-982afcc3-3e7d-4852-b406-d622387cb311'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:08.319559 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-982afcc3-3e7d-4852-b406-d622387cb311 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd76012ed05a44aca8d643c6966ab10e0', 'request_id': 'req-982afcc3-3e7d-4852-b406-d622387cb311'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:08.331520 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-982afcc3-3e7d-4852-b406-d622387cb311 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd76012ed05a44aca8d643c6966ab10e0', 'request_id': 'req-982afcc3-3e7d-4852-b406-d622387cb311'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:08.342179 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823d5f87-5b9f-49d8-955f-cc4214a558cf service neutron] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:08.356583 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-982afcc3-3e7d-4852-b406-d622387cb311 admin admin] The token cache is being invalidate because project d76012ed05a44aca8d643c6966ab10e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:29:08.357336 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-982afcc3-3e7d-4852-b406-d622387cb311 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:08.359029 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-982afcc3-3e7d-4852-b406-d622387cb311 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:08.362410 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1301/2598] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 31 00:29:08 2022] DELETE /identity/v3/projects/d76012ed05a44aca8d643c6966ab10e0 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:29:08.368499 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982afcc3-3e7d-4852-b406-d622387cb311 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:08.371903 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-982afcc3-3e7d-4852-b406-d622387cb311 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:08.446525 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e2073b-02ea-418a-852c-7604f29d469e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beecda6e9feb400288618745c784989f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:08.447407 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e2073b-02ea-418a-852c-7604f29d469e service cinder] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:08.447739 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e2073b-02ea-418a-852c-7604f29d469e service cinder] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:08.449170 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e2073b-02ea-418a-852c-7604f29d469e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:08.452647 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-54e2073b-02ea-418a-852c-7604f29d469e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:08.458368 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982afcc3-3e7d-4852-b406-d622387cb311 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:08.463934 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b145aa0d-a52e-434a-b353-5c8b9e4782c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:08.465072 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b145aa0d-a52e-434a-b353-5c8b9e4782c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:08.465532 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b145aa0d-a52e-434a-b353-5c8b9e4782c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:08.466032 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b145aa0d-a52e-434a-b353-5c8b9e4782c1 admin admin] PATH_INFO: `/v3/users/d916c7a78bc242729b4618696352c9d0` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:08.467524 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b145aa0d-a52e-434a-b353-5c8b9e4782c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d916c7a78bc242729b4618696352c9d0)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:08.470142 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b145aa0d-a52e-434a-b353-5c8b9e4782c1 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:08.547477 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-b145aa0d-a52e-434a-b353-5c8b9e4782c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd916c7a78bc242729b4618696352c9d0'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:08.555855 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-b145aa0d-a52e-434a-b353-5c8b9e4782c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd916c7a78bc242729b4618696352c9d0'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:08.560985 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e2073b-02ea-418a-852c-7604f29d469e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:08.562556 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e2073b-02ea-418a-852c-7604f29d469e service cinder] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:08.567172 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-b145aa0d-a52e-434a-b353-5c8b9e4782c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd916c7a78bc242729b4618696352c9d0'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:08.568550 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-b145aa0d-a52e-434a-b353-5c8b9e4782c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd916c7a78bc242729b4618696352c9d0'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:08.587148 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1298/2599] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:29:08 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:29:08.588323 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-b145aa0d-a52e-434a-b353-5c8b9e4782c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd916c7a78bc242729b4618696352c9d0'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:08.600086 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1302/2600] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 31 00:29:08 2022] DELETE /identity/v3/users/d916c7a78bc242729b4618696352c9d0 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:29:08.684086 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e2073b-02ea-418a-852c-7604f29d469e service cinder] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:08.685902 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-54e2073b-02ea-418a-852c-7604f29d469e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:08.699731 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e2073b-02ea-418a-852c-7604f29d469e service cinder] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:08.786863 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:29:08.811408 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df974da-73f7-45d0-89d1-88240e0e81ec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beecda6e9feb400288618745c784989f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:08.812321 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df974da-73f7-45d0-89d1-88240e0e81ec service cinder] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:08.812714 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df974da-73f7-45d0-89d1-88240e0e81ec service cinder] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:08.813170 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df974da-73f7-45d0-89d1-88240e0e81ec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:08.816394 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-3df974da-73f7-45d0-89d1-88240e0e81ec service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:08.946374 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df974da-73f7-45d0-89d1-88240e0e81ec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:08.951953 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df974da-73f7-45d0-89d1-88240e0e81ec service cinder] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:08.975205 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1299/2601] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:29:08 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:29:09.537082 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b145aa0d-a52e-434a-b353-5c8b9e4782c1 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:09.539752 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-b145aa0d-a52e-434a-b353-5c8b9e4782c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:09.549806 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:29:09.723134 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b145aa0d-a52e-434a-b353-5c8b9e4782c1 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:09.731500 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9c8ee2-4ab7-47c8-9e07-f37c8e7be899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:09.732740 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9c8ee2-4ab7-47c8-9e07-f37c8e7be899 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:09.733268 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9c8ee2-4ab7-47c8-9e07-f37c8e7be899 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:09.733783 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9c8ee2-4ab7-47c8-9e07-f37c8e7be899 admin admin] PATH_INFO: `/v3/projects/ac87ea4e914142c6bbd23e1df9f6a2ee` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:09.736123 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9c8ee2-4ab7-47c8-9e07-f37c8e7be899 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac87ea4e914142c6bbd23e1df9f6a2ee)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:09.738997 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9c8ee2-4ab7-47c8-9e07-f37c8e7be899 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:09.835449 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-9f9c8ee2-4ab7-47c8-9e07-f37c8e7be899 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac87ea4e914142c6bbd23e1df9f6a2ee', 'request_id': 'req-9f9c8ee2-4ab7-47c8-9e07-f37c8e7be899'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:09.852860 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-9f9c8ee2-4ab7-47c8-9e07-f37c8e7be899 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac87ea4e914142c6bbd23e1df9f6a2ee', 'request_id': 'req-9f9c8ee2-4ab7-47c8-9e07-f37c8e7be899'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:09.868201 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-9f9c8ee2-4ab7-47c8-9e07-f37c8e7be899 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac87ea4e914142c6bbd23e1df9f6a2ee', 'request_id': 'req-9f9c8ee2-4ab7-47c8-9e07-f37c8e7be899'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:09.899729 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-9f9c8ee2-4ab7-47c8-9e07-f37c8e7be899 admin admin] The token cache is being invalidate because project ac87ea4e914142c6bbd23e1df9f6a2ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:29:09.900494 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-9f9c8ee2-4ab7-47c8-9e07-f37c8e7be899 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:09.902043 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-9f9c8ee2-4ab7-47c8-9e07-f37c8e7be899 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:09.908502 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1303/2602] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 31 00:29:09 2022] DELETE /identity/v3/projects/ac87ea4e914142c6bbd23e1df9f6a2ee => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:29:09.911606 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1904a473-a4e0-4a63-814e-65d5c4679804 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:09.912374 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1904a473-a4e0-4a63-814e-65d5c4679804 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:09.912557 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1904a473-a4e0-4a63-814e-65d5c4679804 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:09.952348 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-1904a473-a4e0-4a63-814e-65d5c4679804 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:29:09.954554 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-1904a473-a4e0-4a63-814e-65d5c4679804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:10.051352 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1300/2603] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:29:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:29:10.065327 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfaf414-a86f-43ae-ad0a-230ab6c89b9f None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:10.065761 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfaf414-a86f-43ae-ad0a-230ab6c89b9f None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:10.066192 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfaf414-a86f-43ae-ad0a-230ab6c89b9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:10.102233 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-cbfaf414-a86f-43ae-ad0a-230ab6c89b9f None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:29:10.103509 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-cbfaf414-a86f-43ae-ad0a-230ab6c89b9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:10.118276 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1304/2604] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:29:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:29:10.120895 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1904a473-a4e0-4a63-814e-65d5c4679804 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:10.132623 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1904a473-a4e0-4a63-814e-65d5c4679804 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:10.139356 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f25dda-07c2-4abb-a239-2ae1b808303f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:10.141070 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f25dda-07c2-4abb-a239-2ae1b808303f admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:10.141380 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f25dda-07c2-4abb-a239-2ae1b808303f admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:10.141695 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f25dda-07c2-4abb-a239-2ae1b808303f admin admin] PATH_INFO: `/v3/domains` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:10.142322 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f25dda-07c2-4abb-a239-2ae1b808303f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:29:10.142636 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f25dda-07c2-4abb-a239-2ae1b808303f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:10.144403 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f25dda-07c2-4abb-a239-2ae1b808303f admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:10.168606 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1301/2605] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 31 00:29:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:29:10.170871 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfaf414-a86f-43ae-ad0a-230ab6c89b9f None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:10.183943 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfaf414-a86f-43ae-ad0a-230ab6c89b9f None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:10.190627 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ff33c7-8096-4fc5-b153-8c4adc882cf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:10.191563 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ff33c7-8096-4fc5-b153-8c4adc882cf8 admin admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:10.192185 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ff33c7-8096-4fc5-b153-8c4adc882cf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:10.192665 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ff33c7-8096-4fc5-b153-8c4adc882cf8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:10.193508 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ff33c7-8096-4fc5-b153-8c4adc882cf8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:10.195831 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ff33c7-8096-4fc5-b153-8c4adc882cf8 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:10.235049 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1305/2606] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 31 00:29:10 2022] POST /identity/v3/projects => generated 383 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:29:10.239387 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f25dda-07c2-4abb-a239-2ae1b808303f admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:10.251160 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f25dda-07c2-4abb-a239-2ae1b808303f admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:10.363919 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cbb1f3-6c58-43e4-b5da-a28c16fc7fed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:10.364742 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cbb1f3-6c58-43e4-b5da-a28c16fc7fed admin admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:10.365118 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cbb1f3-6c58-43e4-b5da-a28c16fc7fed admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:10.365513 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cbb1f3-6c58-43e4-b5da-a28c16fc7fed admin admin] PATH_INFO: `/v3/users` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:10.366499 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cbb1f3-6c58-43e4-b5da-a28c16fc7fed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:10.371836 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cbb1f3-6c58-43e4-b5da-a28c16fc7fed admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:10.421597 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1302/2607] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 31 00:29:10 2022] POST /identity/v3/users => generated 292 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:29:10.427221 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ff33c7-8096-4fc5-b153-8c4adc882cf8 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:10.462621 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ff33c7-8096-4fc5-b153-8c4adc882cf8 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:10.480379 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42eb4675-d4aa-4b9c-82ef-93d9c44d709e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:10.481479 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eb4675-d4aa-4b9c-82ef-93d9c44d709e admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:10.481991 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eb4675-d4aa-4b9c-82ef-93d9c44d709e admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:10.482948 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eb4675-d4aa-4b9c-82ef-93d9c44d709e admin admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:10.484239 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42eb4675-d4aa-4b9c-82ef-93d9c44d709e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:10.498714 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42eb4675-d4aa-4b9c-82ef-93d9c44d709e admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:10.524286 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cbb1f3-6c58-43e4-b5da-a28c16fc7fed admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:10.524604 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1306/2608] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 00:29:10 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:29:10.538611 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cbb1f3-6c58-43e4-b5da-a28c16fc7fed admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:10.557784 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2431742a-519c-4d8e-a5f6-6ebf3707123a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:10.558649 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2431742a-519c-4d8e-a5f6-6ebf3707123a admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:10.558649 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2431742a-519c-4d8e-a5f6-6ebf3707123a admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:10.558649 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2431742a-519c-4d8e-a5f6-6ebf3707123a admin admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:10.560845 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2431742a-519c-4d8e-a5f6-6ebf3707123a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:10.562960 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2431742a-519c-4d8e-a5f6-6ebf3707123a admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:10.584225 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1303/2609] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 00:29:10 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:29:10.587507 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42eb4675-d4aa-4b9c-82ef-93d9c44d709e admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:10.617136 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42eb4675-d4aa-4b9c-82ef-93d9c44d709e admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:10.631615 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6e905a-6dbb-4c22-bb27-6589d22a924d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:10.632966 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6e905a-6dbb-4c22-bb27-6589d22a924d admin admin] REQUEST_METHOD: `PUT` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:10.633550 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6e905a-6dbb-4c22-bb27-6589d22a924d admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:10.634053 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6e905a-6dbb-4c22-bb27-6589d22a924d admin admin] PATH_INFO: `/v3/projects/5a371fa97a82488d8c74bce4ec1f8c3a/users/516ac8f812604a14a7a9e5b93d0733b9/roles/fdad79ffbcbb4fa380dc9cf7dd108618` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:10.668408 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6e905a-6dbb-4c22-bb27-6589d22a924d admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a371fa97a82488d8c74bce4ec1f8c3a, user_id=516ac8f812604a14a7a9e5b93d0733b9, role_id=fdad79ffbcbb4fa380dc9cf7dd108618)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:10.671929 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6e905a-6dbb-4c22-bb27-6589d22a924d admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:10.697275 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1307/2610] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 00:29:10 2022] PUT /identity/v3/projects/5a371fa97a82488d8c74bce4ec1f8c3a/users/516ac8f812604a14a7a9e5b93d0733b9/roles/fdad79ffbcbb4fa380dc9cf7dd108618 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:29:10.716527 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc78f96b-e4d3-460c-bdbd-e9a464e79e63 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:10.716527 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc78f96b-e4d3-460c-bdbd-e9a464e79e63 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:10.716527 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc78f96b-e4d3-460c-bdbd-e9a464e79e63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:10.726089 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:29:10.760436 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-bc78f96b-e4d3-460c-bdbd-e9a464e79e63 None None] MFA Rules not processed for user `516ac8f812604a14a7a9e5b93d0733b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:29:10.761895 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-bc78f96b-e4d3-460c-bdbd-e9a464e79e63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:10.902341 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1304/2611] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:29:10 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:29:10.921908 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6e905a-6dbb-4c22-bb27-6589d22a924d admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:10.925679 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-2b6e905a-6dbb-4c22-bb27-6589d22a924d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:11.015661 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:29:11.087129 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6e905a-6dbb-4c22-bb27-6589d22a924d admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:11.101574 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed750065-ead5-487d-9e4f-546c122e92c5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beecda6e9feb400288618745c784989f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:11.103542 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed750065-ead5-487d-9e4f-546c122e92c5 service cinder] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:11.105296 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed750065-ead5-487d-9e4f-546c122e92c5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:11.105986 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed750065-ead5-487d-9e4f-546c122e92c5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:11.129338 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed750065-ead5-487d-9e4f-546c122e92c5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:11.132747 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed750065-ead5-487d-9e4f-546c122e92c5 service cinder] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:11.157994 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1308/2612] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:29:10 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:29:11.188285 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc78f96b-e4d3-460c-bdbd-e9a464e79e63 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:11.372428 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc78f96b-e4d3-460c-bdbd-e9a464e79e63 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:11.419106 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f65d11-302b-4476-9d0e-0d577e4bec8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:11.420471 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f65d11-302b-4476-9d0e-0d577e4bec8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:11.420951 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f65d11-302b-4476-9d0e-0d577e4bec8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:11.421409 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f65d11-302b-4476-9d0e-0d577e4bec8d admin admin] PATH_INFO: `/v3/users/516ac8f812604a14a7a9e5b93d0733b9` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:11.424588 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f65d11-302b-4476-9d0e-0d577e4bec8d admin admin] RBAC: Authorizing `identity:delete_user(user_id=516ac8f812604a14a7a9e5b93d0733b9)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:11.428796 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f65d11-302b-4476-9d0e-0d577e4bec8d admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:11.555742 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-c7f65d11-302b-4476-9d0e-0d577e4bec8d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '516ac8f812604a14a7a9e5b93d0733b9'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:11.567097 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-c7f65d11-302b-4476-9d0e-0d577e4bec8d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '516ac8f812604a14a7a9e5b93d0733b9'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:11.579235 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-c7f65d11-302b-4476-9d0e-0d577e4bec8d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '516ac8f812604a14a7a9e5b93d0733b9'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:11.602571 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-c7f65d11-302b-4476-9d0e-0d577e4bec8d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '516ac8f812604a14a7a9e5b93d0733b9'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:11.603748 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-c7f65d11-302b-4476-9d0e-0d577e4bec8d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '516ac8f812604a14a7a9e5b93d0733b9'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:11.617338 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1305/2613] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 31 00:29:11 2022] DELETE /identity/v3/users/516ac8f812604a14a7a9e5b93d0733b9 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:29:11.624282 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d9d5e0-89fe-4912-a716-fc6d75e1fed6 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:11.625234 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d9d5e0-89fe-4912-a716-fc6d75e1fed6 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:11.625427 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d9d5e0-89fe-4912-a716-fc6d75e1fed6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:11.672488 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-d5d9d5e0-89fe-4912-a716-fc6d75e1fed6 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:29:11.674103 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-d5d9d5e0-89fe-4912-a716-fc6d75e1fed6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:11.769173 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1309/2614] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:29:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:29:11.782396 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f65d11-302b-4476-9d0e-0d577e4bec8d admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:11.784926 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-c7f65d11-302b-4476-9d0e-0d577e4bec8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:11.808878 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:29:11.879495 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f65d11-302b-4476-9d0e-0d577e4bec8d admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:11.887226 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa8ce7e-41bf-4a55-b13e-7d390e3c8fe2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'daae792cd11d4c4ca7aae0558998aced', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:11.888347 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa8ce7e-41bf-4a55-b13e-7d390e3c8fe2 service neutron] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:11.888838 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa8ce7e-41bf-4a55-b13e-7d390e3c8fe2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:11.889366 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa8ce7e-41bf-4a55-b13e-7d390e3c8fe2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:11.929297 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa8ce7e-41bf-4a55-b13e-7d390e3c8fe2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:11.935093 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa8ce7e-41bf-4a55-b13e-7d390e3c8fe2 service neutron] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:11.960718 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1306/2615] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:29:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:29:12.387278 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d9d5e0-89fe-4912-a716-fc6d75e1fed6 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:12.391155 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-d5d9d5e0-89fe-4912-a716-fc6d75e1fed6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:12.410782 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d9d5e0-89fe-4912-a716-fc6d75e1fed6 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:12.417997 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8929af64-5345-4704-ac85-d14e86d3fdf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:12.419875 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8929af64-5345-4704-ac85-d14e86d3fdf9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:12.420197 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8929af64-5345-4704-ac85-d14e86d3fdf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:12.420593 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8929af64-5345-4704-ac85-d14e86d3fdf9 admin admin] PATH_INFO: `/v3/users/75d7f0079f5c4a20b4a070f6f203e562` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:12.422107 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8929af64-5345-4704-ac85-d14e86d3fdf9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=75d7f0079f5c4a20b4a070f6f203e562)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:12.424813 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8929af64-5345-4704-ac85-d14e86d3fdf9 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:12.536862 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-8929af64-5345-4704-ac85-d14e86d3fdf9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75d7f0079f5c4a20b4a070f6f203e562'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:12.550109 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-8929af64-5345-4704-ac85-d14e86d3fdf9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75d7f0079f5c4a20b4a070f6f203e562'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:12.567448 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-8929af64-5345-4704-ac85-d14e86d3fdf9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75d7f0079f5c4a20b4a070f6f203e562'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:12.568292 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-8929af64-5345-4704-ac85-d14e86d3fdf9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75d7f0079f5c4a20b4a070f6f203e562'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:12.608558 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-8929af64-5345-4704-ac85-d14e86d3fdf9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75d7f0079f5c4a20b4a070f6f203e562'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:12.625909 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1310/2616] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 31 00:29:12 2022] DELETE /identity/v3/users/75d7f0079f5c4a20b4a070f6f203e562 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:29:12.633899 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c53ae2-52e6-44ab-984f-1b0e4d21a029 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:12.634747 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c53ae2-52e6-44ab-984f-1b0e4d21a029 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:12.635081 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c53ae2-52e6-44ab-984f-1b0e4d21a029 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:12.687675 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-84c53ae2-52e6-44ab-984f-1b0e4d21a029 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:29:12.689998 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-84c53ae2-52e6-44ab-984f-1b0e4d21a029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:12.802265 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8929af64-5345-4704-ac85-d14e86d3fdf9 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:12.805750 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-8929af64-5345-4704-ac85-d14e86d3fdf9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:12.889034 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:29:12.918304 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8929af64-5345-4704-ac85-d14e86d3fdf9 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:12.920070 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1307/2617] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:29:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:29:12.934633 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c53ae2-52e6-44ab-984f-1b0e4d21a029 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:12.937652 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-84c53ae2-52e6-44ab-984f-1b0e4d21a029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:12.943156 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a04a6d-4572-453f-b213-1f9407b953b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:12.945106 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a04a6d-4572-453f-b213-1f9407b953b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:12.949735 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a04a6d-4572-453f-b213-1f9407b953b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:12.950730 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a04a6d-4572-453f-b213-1f9407b953b4 admin admin] PATH_INFO: `/v3/projects/5a371fa97a82488d8c74bce4ec1f8c3a` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:12.954753 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a04a6d-4572-453f-b213-1f9407b953b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a371fa97a82488d8c74bce4ec1f8c3a)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:12.973707 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a04a6d-4572-453f-b213-1f9407b953b4 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:13.056478 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c53ae2-52e6-44ab-984f-1b0e4d21a029 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:13.062031 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2d2337-f74a-4871-956d-5892f4551d9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'daae792cd11d4c4ca7aae0558998aced', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:13.062847 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2d2337-f74a-4871-956d-5892f4551d9f service neutron] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:13.063136 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2d2337-f74a-4871-956d-5892f4551d9f service neutron] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:13.063418 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2d2337-f74a-4871-956d-5892f4551d9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:13.076977 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2d2337-f74a-4871-956d-5892f4551d9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:13.078513 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2d2337-f74a-4871-956d-5892f4551d9f service neutron] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:13.103036 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1308/2618] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:29:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:29:13.182956 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-35a04a6d-4572-453f-b213-1f9407b953b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a371fa97a82488d8c74bce4ec1f8c3a', 'request_id': 'req-35a04a6d-4572-453f-b213-1f9407b953b4'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:13.200320 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-35a04a6d-4572-453f-b213-1f9407b953b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a371fa97a82488d8c74bce4ec1f8c3a', 'request_id': 'req-35a04a6d-4572-453f-b213-1f9407b953b4'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:13.215554 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-35a04a6d-4572-453f-b213-1f9407b953b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a371fa97a82488d8c74bce4ec1f8c3a', 'request_id': 'req-35a04a6d-4572-453f-b213-1f9407b953b4'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:13.246266 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-35a04a6d-4572-453f-b213-1f9407b953b4 admin admin] The token cache is being invalidate because project 5a371fa97a82488d8c74bce4ec1f8c3a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:29:13.246754 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-35a04a6d-4572-453f-b213-1f9407b953b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:13.247940 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-35a04a6d-4572-453f-b213-1f9407b953b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:13.251888 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1311/2619] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 31 00:29:12 2022] DELETE /identity/v3/projects/5a371fa97a82488d8c74bce4ec1f8c3a => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:29:13.257690 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9ca054-f2d4-4fc0-aa8e-d6f3305945ce None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:13.259049 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9ca054-f2d4-4fc0-aa8e-d6f3305945ce None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:13.259363 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9ca054-f2d4-4fc0-aa8e-d6f3305945ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:13.299313 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-ea9ca054-f2d4-4fc0-aa8e-d6f3305945ce None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:29:13.303284 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-ea9ca054-f2d4-4fc0-aa8e-d6f3305945ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:13.429735 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:29:13.460131 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1309/2620] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:29:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:29:13.478315 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1233de2-a8b9-439f-a6cf-7ea694c4bf63 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:13.478801 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1233de2-a8b9-439f-a6cf-7ea694c4bf63 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:13.480284 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1233de2-a8b9-439f-a6cf-7ea694c4bf63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:13.508705 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-f1233de2-a8b9-439f-a6cf-7ea694c4bf63 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:29:13.511200 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-f1233de2-a8b9-439f-a6cf-7ea694c4bf63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:13.529320 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1312/2621] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:29:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:29:13.536857 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9ca054-f2d4-4fc0-aa8e-d6f3305945ce None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:13.553816 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9ca054-f2d4-4fc0-aa8e-d6f3305945ce None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:13.562260 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1233de2-a8b9-439f-a6cf-7ea694c4bf63 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:13.563739 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-f1233de2-a8b9-439f-a6cf-7ea694c4bf63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:13.564348 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80feee5e-3a04-42f5-95c0-6058e6d42a44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:13.565553 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80feee5e-3a04-42f5-95c0-6058e6d42a44 admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:13.566044 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80feee5e-3a04-42f5-95c0-6058e6d42a44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:13.566452 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80feee5e-3a04-42f5-95c0-6058e6d42a44 admin admin] PATH_INFO: `/v3/domains` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:13.567527 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80feee5e-3a04-42f5-95c0-6058e6d42a44 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:29:13.568057 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80feee5e-3a04-42f5-95c0-6058e6d42a44 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:13.570371 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80feee5e-3a04-42f5-95c0-6058e6d42a44 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:13.592070 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1233de2-a8b9-439f-a6cf-7ea694c4bf63 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:13.592856 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1310/2622] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 31 00:29:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:29:13.593896 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80feee5e-3a04-42f5-95c0-6058e6d42a44 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:13.605551 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba610d5-5289-4597-a541-bea262226d30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:13.607656 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba610d5-5289-4597-a541-bea262226d30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:13.608679 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba610d5-5289-4597-a541-bea262226d30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:13.609238 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba610d5-5289-4597-a541-bea262226d30 admin admin] PATH_INFO: `/v3/projects/ac287c87cfe8462e83ff18e52ddf4e6f` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:13.613105 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba610d5-5289-4597-a541-bea262226d30 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac287c87cfe8462e83ff18e52ddf4e6f)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:13.617706 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80feee5e-3a04-42f5-95c0-6058e6d42a44 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:13.618308 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba610d5-5289-4597-a541-bea262226d30 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:13.627304 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02877f91-1d7d-48cc-8850-e3a8c2758905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:13.628488 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02877f91-1d7d-48cc-8850-e3a8c2758905 admin admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:13.629012 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02877f91-1d7d-48cc-8850-e3a8c2758905 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:13.629558 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02877f91-1d7d-48cc-8850-e3a8c2758905 admin admin] PATH_INFO: `/v3/projects` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:13.640742 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02877f91-1d7d-48cc-8850-e3a8c2758905 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:13.644540 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02877f91-1d7d-48cc-8850-e3a8c2758905 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:13.691643 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1311/2623] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 31 00:29:13 2022] POST /identity/v3/projects => generated 385 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:29:13.694281 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02877f91-1d7d-48cc-8850-e3a8c2758905 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:13.707394 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-5ba610d5-5289-4597-a541-bea262226d30 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac287c87cfe8462e83ff18e52ddf4e6f', 'request_id': 'req-5ba610d5-5289-4597-a541-bea262226d30'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:13.716964 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-5ba610d5-5289-4597-a541-bea262226d30 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac287c87cfe8462e83ff18e52ddf4e6f', 'request_id': 'req-5ba610d5-5289-4597-a541-bea262226d30'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:13.725279 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-5ba610d5-5289-4597-a541-bea262226d30 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac287c87cfe8462e83ff18e52ddf4e6f', 'request_id': 'req-5ba610d5-5289-4597-a541-bea262226d30'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:13.745248 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-5ba610d5-5289-4597-a541-bea262226d30 admin admin] The token cache is being invalidate because project ac287c87cfe8462e83ff18e52ddf4e6f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:29:13.745581 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-5ba610d5-5289-4597-a541-bea262226d30 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:13.746339 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-5ba610d5-5289-4597-a541-bea262226d30 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:13.747988 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1313/2624] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 31 00:29:13 2022] DELETE /identity/v3/projects/ac287c87cfe8462e83ff18e52ddf4e6f => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:29:13.753375 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba610d5-5289-4597-a541-bea262226d30 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:13.755063 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-5ba610d5-5289-4597-a541-bea262226d30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:13.807055 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02877f91-1d7d-48cc-8850-e3a8c2758905 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:13.816423 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5eb7d8a-a4fb-456a-b76f-87d07e0bea1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:13.818127 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5eb7d8a-a4fb-456a-b76f-87d07e0bea1c admin admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:13.818809 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5eb7d8a-a4fb-456a-b76f-87d07e0bea1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:13.819267 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5eb7d8a-a4fb-456a-b76f-87d07e0bea1c admin admin] PATH_INFO: `/v3/users` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:13.820380 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5eb7d8a-a4fb-456a-b76f-87d07e0bea1c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:13.825480 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5eb7d8a-a4fb-456a-b76f-87d07e0bea1c admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:13.826159 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:29:13.868581 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba610d5-5289-4597-a541-bea262226d30 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:13.875295 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca58b033-d9ca-4ecf-b070-0b89757f1e72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:13.876036 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca58b033-d9ca-4ecf-b070-0b89757f1e72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:13.876375 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca58b033-d9ca-4ecf-b070-0b89757f1e72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:13.876666 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca58b033-d9ca-4ecf-b070-0b89757f1e72 admin admin] PATH_INFO: `/v3/users/e5adcea59e984eb09a40530e86cac0ee` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:13.878171 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca58b033-d9ca-4ecf-b070-0b89757f1e72 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5adcea59e984eb09a40530e86cac0ee)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:13.881986 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1312/2625] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 31 00:29:13 2022] POST /identity/v3/users => generated 293 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:29:13.882212 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca58b033-d9ca-4ecf-b070-0b89757f1e72 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:13.883607 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5eb7d8a-a4fb-456a-b76f-87d07e0bea1c admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:13.888282 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-b5eb7d8a-a4fb-456a-b76f-87d07e0bea1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:13.914666 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5eb7d8a-a4fb-456a-b76f-87d07e0bea1c admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:13.926540 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae81d201-b039-41b7-acbd-7dc021c047ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:13.926540 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae81d201-b039-41b7-acbd-7dc021c047ab admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:13.929290 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae81d201-b039-41b7-acbd-7dc021c047ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:13.929290 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae81d201-b039-41b7-acbd-7dc021c047ab admin admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:13.929290 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae81d201-b039-41b7-acbd-7dc021c047ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:13.929960 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae81d201-b039-41b7-acbd-7dc021c047ab admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:13.953558 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1313/2626] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 00:29:13 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 00:29:13.958046 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae81d201-b039-41b7-acbd-7dc021c047ab admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:13.977659 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae81d201-b039-41b7-acbd-7dc021c047ab admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:13.991814 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bfcd6b-3125-46f6-8d86-ff13fb390c53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:13.992811 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bfcd6b-3125-46f6-8d86-ff13fb390c53 admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:13.993135 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bfcd6b-3125-46f6-8d86-ff13fb390c53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:13.993418 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bfcd6b-3125-46f6-8d86-ff13fb390c53 admin admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:13.994234 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bfcd6b-3125-46f6-8d86-ff13fb390c53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:14.000632 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bfcd6b-3125-46f6-8d86-ff13fb390c53 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:14.001783 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-ca58b033-d9ca-4ecf-b070-0b89757f1e72 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5adcea59e984eb09a40530e86cac0ee'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:14.024879 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-ca58b033-d9ca-4ecf-b070-0b89757f1e72 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5adcea59e984eb09a40530e86cac0ee'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:14.034928 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1314/2627] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 00:29:13 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:29:14.036885 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-ca58b033-d9ca-4ecf-b070-0b89757f1e72 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5adcea59e984eb09a40530e86cac0ee'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:14.038155 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-ca58b033-d9ca-4ecf-b070-0b89757f1e72 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5adcea59e984eb09a40530e86cac0ee'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:14.042172 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bfcd6b-3125-46f6-8d86-ff13fb390c53 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:14.045158 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-a8bfcd6b-3125-46f6-8d86-ff13fb390c53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:14.058764 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-ca58b033-d9ca-4ecf-b070-0b89757f1e72 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5adcea59e984eb09a40530e86cac0ee'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:14.066236 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bfcd6b-3125-46f6-8d86-ff13fb390c53 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:14.071249 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1314/2628] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 31 00:29:13 2022] DELETE /identity/v3/users/e5adcea59e984eb09a40530e86cac0ee => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:29:14.076044 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5b10bb-25ad-4e0b-aeba-042a6c5ff87c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:14.076044 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5b10bb-25ad-4e0b-aeba-042a6c5ff87c admin admin] REQUEST_METHOD: `PUT` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:14.076044 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5b10bb-25ad-4e0b-aeba-042a6c5ff87c admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:14.076645 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5b10bb-25ad-4e0b-aeba-042a6c5ff87c admin admin] PATH_INFO: `/v3/projects/a655bce9415b49d994547fff5c199e11/users/1bbf319c68074eac868644558dd024f8/roles/fdad79ffbcbb4fa380dc9cf7dd108618` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:14.107881 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5b10bb-25ad-4e0b-aeba-042a6c5ff87c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a655bce9415b49d994547fff5c199e11, user_id=1bbf319c68074eac868644558dd024f8, role_id=fdad79ffbcbb4fa380dc9cf7dd108618)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:14.114051 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5b10bb-25ad-4e0b-aeba-042a6c5ff87c admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:14.142525 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1315/2629] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 00:29:14 2022] PUT /identity/v3/projects/a655bce9415b49d994547fff5c199e11/users/1bbf319c68074eac868644558dd024f8/roles/fdad79ffbcbb4fa380dc9cf7dd108618 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:29:14.166114 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d3f576-c195-4544-bb8b-bf0c81be3c72 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:14.179481 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d3f576-c195-4544-bb8b-bf0c81be3c72 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:14.180825 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d3f576-c195-4544-bb8b-bf0c81be3c72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:14.264598 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-f4d3f576-c195-4544-bb8b-bf0c81be3c72 None None] MFA Rules not processed for user `1bbf319c68074eac868644558dd024f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:29:14.266633 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-f4d3f576-c195-4544-bb8b-bf0c81be3c72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:14.476519 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1315/2630] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:29:14 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:29:14.500211 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5b10bb-25ad-4e0b-aeba-042a6c5ff87c admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:14.503570 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-af5b10bb-25ad-4e0b-aeba-042a6c5ff87c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:14.665349 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5b10bb-25ad-4e0b-aeba-042a6c5ff87c admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:14.671492 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bdc165-213e-4949-86ae-ce32408c3e35 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beecda6e9feb400288618745c784989f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:14.671798 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bdc165-213e-4949-86ae-ce32408c3e35 service cinder] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:14.671969 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bdc165-213e-4949-86ae-ce32408c3e35 service cinder] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:14.672125 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bdc165-213e-4949-86ae-ce32408c3e35 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:14.685373 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bdc165-213e-4949-86ae-ce32408c3e35 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:14.690696 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bdc165-213e-4949-86ae-ce32408c3e35 service cinder] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:14.709541 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1316/2631] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:29:14 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:29:14.770952 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d3f576-c195-4544-bb8b-bf0c81be3c72 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:14.773526 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-f4d3f576-c195-4544-bb8b-bf0c81be3c72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:15.076479 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d3f576-c195-4544-bb8b-bf0c81be3c72 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:15.094632 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e04d2e-5ff2-4df6-a118-cdf5707a5286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:15.096625 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e04d2e-5ff2-4df6-a118-cdf5707a5286 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:15.096625 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e04d2e-5ff2-4df6-a118-cdf5707a5286 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:15.096998 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e04d2e-5ff2-4df6-a118-cdf5707a5286 admin admin] PATH_INFO: `/v3/projects/6555d12414bd458ea89f6ffba5271f7d` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:15.101642 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e04d2e-5ff2-4df6-a118-cdf5707a5286 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6555d12414bd458ea89f6ffba5271f7d)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:15.116826 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e04d2e-5ff2-4df6-a118-cdf5707a5286 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:15.125098 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:29:15.265870 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-e1e04d2e-5ff2-4df6-a118-cdf5707a5286 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6555d12414bd458ea89f6ffba5271f7d', 'request_id': 'req-e1e04d2e-5ff2-4df6-a118-cdf5707a5286'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:15.285478 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-e1e04d2e-5ff2-4df6-a118-cdf5707a5286 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6555d12414bd458ea89f6ffba5271f7d', 'request_id': 'req-e1e04d2e-5ff2-4df6-a118-cdf5707a5286'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:15.303087 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-e1e04d2e-5ff2-4df6-a118-cdf5707a5286 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6555d12414bd458ea89f6ffba5271f7d', 'request_id': 'req-e1e04d2e-5ff2-4df6-a118-cdf5707a5286'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:15.361002 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-e1e04d2e-5ff2-4df6-a118-cdf5707a5286 admin admin] The token cache is being invalidate because project 6555d12414bd458ea89f6ffba5271f7d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:29:15.361484 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-e1e04d2e-5ff2-4df6-a118-cdf5707a5286 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:15.363151 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-e1e04d2e-5ff2-4df6-a118-cdf5707a5286 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:15.384849 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1316/2632] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 31 00:29:14 2022] DELETE /identity/v3/projects/6555d12414bd458ea89f6ffba5271f7d => generated 0 bytes in 606 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:29:15.385179 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769b3e75-c69c-4881-a29d-f749cf3e1731 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:15.386214 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769b3e75-c69c-4881-a29d-f749cf3e1731 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:15.386713 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769b3e75-c69c-4881-a29d-f749cf3e1731 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:15.482445 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-769b3e75-c69c-4881-a29d-f749cf3e1731 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:29:15.493633 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-769b3e75-c69c-4881-a29d-f749cf3e1731 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:15.504604 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:29:15.666231 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1317/2633] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:29:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:29:15.678875 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f9385e-52b2-4235-a70e-d34498499994 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:15.680451 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f9385e-52b2-4235-a70e-d34498499994 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:15.680451 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f9385e-52b2-4235-a70e-d34498499994 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:15.794234 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-23f9385e-52b2-4235-a70e-d34498499994 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:29:15.801578 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-23f9385e-52b2-4235-a70e-d34498499994 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:15.844075 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1317/2634] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:29:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:29:15.844458 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769b3e75-c69c-4881-a29d-f749cf3e1731 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:15.858775 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769b3e75-c69c-4881-a29d-f749cf3e1731 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:15.896362 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e114b702-f523-4509-8e4e-955d3068fcdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:15.897337 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e114b702-f523-4509-8e4e-955d3068fcdf admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:15.898057 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e114b702-f523-4509-8e4e-955d3068fcdf admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:15.898488 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e114b702-f523-4509-8e4e-955d3068fcdf admin admin] PATH_INFO: `/v3/domains` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:15.899348 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e114b702-f523-4509-8e4e-955d3068fcdf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:29:15.899827 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e114b702-f523-4509-8e4e-955d3068fcdf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:15.906980 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e114b702-f523-4509-8e4e-955d3068fcdf admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:15.944430 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1318/2635] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 31 00:29:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:29:15.957902 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f9385e-52b2-4235-a70e-d34498499994 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:16.011962 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f9385e-52b2-4235-a70e-d34498499994 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:16.029216 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfe3f74-243e-4d31-a8cf-176233534066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:16.030288 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfe3f74-243e-4d31-a8cf-176233534066 admin admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:16.030772 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfe3f74-243e-4d31-a8cf-176233534066 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:16.035175 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfe3f74-243e-4d31-a8cf-176233534066 admin admin] PATH_INFO: `/v3/projects` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:16.042451 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfe3f74-243e-4d31-a8cf-176233534066 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:16.047210 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfe3f74-243e-4d31-a8cf-176233534066 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:16.135084 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1318/2636] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 31 00:29:15 2022] POST /identity/v3/projects => generated 387 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:29:16.142845 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e114b702-f523-4509-8e4e-955d3068fcdf admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:16.173897 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e114b702-f523-4509-8e4e-955d3068fcdf admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:16.455872 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3726bf70-22ae-4700-9005-f55e28fc0449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:16.456558 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3726bf70-22ae-4700-9005-f55e28fc0449 admin admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:16.456843 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3726bf70-22ae-4700-9005-f55e28fc0449 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:16.457117 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3726bf70-22ae-4700-9005-f55e28fc0449 admin admin] PATH_INFO: `/v3/users` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:16.457846 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3726bf70-22ae-4700-9005-f55e28fc0449 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:16.460412 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3726bf70-22ae-4700-9005-f55e28fc0449 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:16.516913 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1319/2637] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 31 00:29:16 2022] POST /identity/v3/users => generated 294 bytes in 369 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:29:16.517904 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfe3f74-243e-4d31-a8cf-176233534066 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:16.539343 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfe3f74-243e-4d31-a8cf-176233534066 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:16.555180 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ec12da-47f1-4481-844a-7341d0d55137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:16.555658 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ec12da-47f1-4481-844a-7341d0d55137 admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:16.555956 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ec12da-47f1-4481-844a-7341d0d55137 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:16.556273 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ec12da-47f1-4481-844a-7341d0d55137 admin admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:16.556957 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ec12da-47f1-4481-844a-7341d0d55137 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:16.558762 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ec12da-47f1-4481-844a-7341d0d55137 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:16.591167 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1319/2638] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 00:29:16 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:29:16.596810 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3726bf70-22ae-4700-9005-f55e28fc0449 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:16.623543 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3726bf70-22ae-4700-9005-f55e28fc0449 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:16.645782 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6089608a-a250-41ca-8daa-7450e9754d9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:16.646827 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6089608a-a250-41ca-8daa-7450e9754d9d admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:16.647321 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6089608a-a250-41ca-8daa-7450e9754d9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:16.648058 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6089608a-a250-41ca-8daa-7450e9754d9d admin admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:16.649262 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6089608a-a250-41ca-8daa-7450e9754d9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:16.676071 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6089608a-a250-41ca-8daa-7450e9754d9d admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:16.741774 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1320/2639] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 00:29:16 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:29:16.753409 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ec12da-47f1-4481-844a-7341d0d55137 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:16.809883 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ec12da-47f1-4481-844a-7341d0d55137 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:16.836757 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd59edd-7930-4951-9221-42a495441bc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:16.837601 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd59edd-7930-4951-9221-42a495441bc0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:16.838100 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd59edd-7930-4951-9221-42a495441bc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:16.838624 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd59edd-7930-4951-9221-42a495441bc0 admin admin] PATH_INFO: `/v3/projects/be8a65a5ac6a4df4800be784447f6886/users/1576c2bcb00449f387f7acff1add77d5/roles/fdad79ffbcbb4fa380dc9cf7dd108618` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:16.921880 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd59edd-7930-4951-9221-42a495441bc0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be8a65a5ac6a4df4800be784447f6886, user_id=1576c2bcb00449f387f7acff1add77d5, role_id=fdad79ffbcbb4fa380dc9cf7dd108618)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:16.929472 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd59edd-7930-4951-9221-42a495441bc0 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:16.966048 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1320/2640] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 00:29:16 2022] PUT /identity/v3/projects/be8a65a5ac6a4df4800be784447f6886/users/1576c2bcb00449f387f7acff1add77d5/roles/fdad79ffbcbb4fa380dc9cf7dd108618 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:29:16.991907 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ce7fdf-bac4-497a-ae9f-37529ff9f6c7 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:16.992275 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ce7fdf-bac4-497a-ae9f-37529ff9f6c7 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:16.992600 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ce7fdf-bac4-497a-ae9f-37529ff9f6c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:17.134967 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-c8ce7fdf-bac4-497a-ae9f-37529ff9f6c7 None None] MFA Rules not processed for user `1576c2bcb00449f387f7acff1add77d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:29:17.138152 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-c8ce7fdf-bac4-497a-ae9f-37529ff9f6c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:17.305682 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1321/2641] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:29:16 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:29:17.312939 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd59edd-7930-4951-9221-42a495441bc0 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:17.567441 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd59edd-7930-4951-9221-42a495441bc0 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:17.585518 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97729da9-a6fb-4661-94e2-190f91ed4673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:17.586777 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97729da9-a6fb-4661-94e2-190f91ed4673 admin admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:17.587360 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97729da9-a6fb-4661-94e2-190f91ed4673 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:17.587933 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97729da9-a6fb-4661-94e2-190f91ed4673 admin admin] PATH_INFO: `/v3/projects` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:17.589923 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97729da9-a6fb-4661-94e2-190f91ed4673 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:17.605174 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97729da9-a6fb-4661-94e2-190f91ed4673 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:17.739262 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1321/2642] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 31 00:29:17 2022] POST /identity/v3/projects => generated 387 bytes in 427 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:29:17.739794 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ce7fdf-bac4-497a-ae9f-37529ff9f6c7 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:17.753872 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:29:17.768305 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ce7fdf-bac4-497a-ae9f-37529ff9f6c7 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:17.934330 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefeed5a-af28-4a33-84cc-f77c488ff070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:17.935469 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefeed5a-af28-4a33-84cc-f77c488ff070 admin admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:17.936106 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefeed5a-af28-4a33-84cc-f77c488ff070 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:17.937180 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefeed5a-af28-4a33-84cc-f77c488ff070 admin admin] PATH_INFO: `/v3/users` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:17.938592 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefeed5a-af28-4a33-84cc-f77c488ff070 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:17.942038 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefeed5a-af28-4a33-84cc-f77c488ff070 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:18.023708 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1322/2643] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 31 00:29:17 2022] POST /identity/v3/users => generated 294 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:29:18.030373 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97729da9-a6fb-4661-94e2-190f91ed4673 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:18.062359 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97729da9-a6fb-4661-94e2-190f91ed4673 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:18.073886 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9939ce0b-9d50-4455-9107-5983cc909fcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:18.074555 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9939ce0b-9d50-4455-9107-5983cc909fcd admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:18.074911 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9939ce0b-9d50-4455-9107-5983cc909fcd admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:18.075336 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9939ce0b-9d50-4455-9107-5983cc909fcd admin admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:18.076022 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9939ce0b-9d50-4455-9107-5983cc909fcd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:18.078803 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9939ce0b-9d50-4455-9107-5983cc909fcd admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:18.090297 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:29:18.103539 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1322/2644] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 00:29:18 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:29:18.110391 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefeed5a-af28-4a33-84cc-f77c488ff070 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:18.181009 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefeed5a-af28-4a33-84cc-f77c488ff070 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:18.184711 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9939ce0b-9d50-4455-9107-5983cc909fcd admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:18.186560 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-9939ce0b-9d50-4455-9107-5983cc909fcd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:18.201424 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9abc3e-a01f-4960-9852-40aafdb7d930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:18.202446 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9abc3e-a01f-4960-9852-40aafdb7d930 admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:18.202956 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9abc3e-a01f-4960-9852-40aafdb7d930 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:18.203430 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9abc3e-a01f-4960-9852-40aafdb7d930 admin admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:18.205003 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9abc3e-a01f-4960-9852-40aafdb7d930 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:18.208510 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9abc3e-a01f-4960-9852-40aafdb7d930 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:18.271745 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1323/2645] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 00:29:18 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:29:18.271745 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9abc3e-a01f-4960-9852-40aafdb7d930 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:18.320299 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9abc3e-a01f-4960-9852-40aafdb7d930 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:18.328312 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ac2926-79df-41a3-b8eb-2423ec1678d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:18.340635 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ac2926-79df-41a3-b8eb-2423ec1678d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:18.341257 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ac2926-79df-41a3-b8eb-2423ec1678d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:18.341746 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ac2926-79df-41a3-b8eb-2423ec1678d0 admin admin] PATH_INFO: `/v3/projects/6d4b0aeebdd6430ca5d33ca373b0a94d/users/1a979de0c9ba40dea9e05b77e6c88ec3/roles/fdad79ffbcbb4fa380dc9cf7dd108618` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:18.369208 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ac2926-79df-41a3-b8eb-2423ec1678d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d4b0aeebdd6430ca5d33ca373b0a94d, user_id=1a979de0c9ba40dea9e05b77e6c88ec3, role_id=fdad79ffbcbb4fa380dc9cf7dd108618)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:18.383523 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9939ce0b-9d50-4455-9107-5983cc909fcd admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:18.387833 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547e4ad8-0742-4f01-8708-bea1ee6f65d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'daae792cd11d4c4ca7aae0558998aced', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:18.388525 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547e4ad8-0742-4f01-8708-bea1ee6f65d2 service neutron] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:18.388812 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547e4ad8-0742-4f01-8708-bea1ee6f65d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:18.389089 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547e4ad8-0742-4f01-8708-bea1ee6f65d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:18.391070 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-547e4ad8-0742-4f01-8708-bea1ee6f65d2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:18.398011 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ac2926-79df-41a3-b8eb-2423ec1678d0 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:18.406920 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547e4ad8-0742-4f01-8708-bea1ee6f65d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:18.408505 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547e4ad8-0742-4f01-8708-bea1ee6f65d2 service neutron] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:18.421174 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1323/2646] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:29:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 00:29:18.422734 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4716d3a1-5c00-4047-b9ad-c6824af5169b None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:18.422929 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4716d3a1-5c00-4047-b9ad-c6824af5169b None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:18.423091 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4716d3a1-5c00-4047-b9ad-c6824af5169b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:18.437955 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1324/2647] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 00:29:18 2022] PUT /identity/v3/projects/6d4b0aeebdd6430ca5d33ca373b0a94d/users/1a979de0c9ba40dea9e05b77e6c88ec3/roles/fdad79ffbcbb4fa380dc9cf7dd108618 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:29:18.445757 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-4716d3a1-5c00-4047-b9ad-c6824af5169b None None] MFA Rules not processed for user `410f2e9dc2db4ffcb5ff0f67b0d00ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:29:18.447294 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-4716d3a1-5c00-4047-b9ad-c6824af5169b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:18.459710 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2060295-5d05-4756-b1db-4c5441e49b5a None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:18.460539 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2060295-5d05-4756-b1db-4c5441e49b5a None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:18.461238 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2060295-5d05-4756-b1db-4c5441e49b5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:18.519641 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1324/2648] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:29:18 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:29:18.569691 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-e2060295-5d05-4756-b1db-4c5441e49b5a None None] MFA Rules not processed for user `1a979de0c9ba40dea9e05b77e6c88ec3`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:29:18.574747 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-e2060295-5d05-4756-b1db-4c5441e49b5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:18.783402 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1325/2649] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:29:18 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:29:18.794672 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4716d3a1-5c00-4047-b9ad-c6824af5169b None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:18.904818 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4716d3a1-5c00-4047-b9ad-c6824af5169b None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:18.910089 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a632a5-61c9-4c25-a869-1c56c18a8c7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:18.910735 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a632a5-61c9-4c25-a869-1c56c18a8c7e admin admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:18.911016 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a632a5-61c9-4c25-a869-1c56c18a8c7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:18.911292 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a632a5-61c9-4c25-a869-1c56c18a8c7e admin admin] PATH_INFO: `/v3/projects` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:18.911957 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a632a5-61c9-4c25-a869-1c56c18a8c7e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:18.914087 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a632a5-61c9-4c25-a869-1c56c18a8c7e admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:18.965208 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1325/2650] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 31 00:29:18 2022] POST /identity/v3/projects => generated 385 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:29:18.970614 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2060295-5d05-4756-b1db-4c5441e49b5a None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:19.003329 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2060295-5d05-4756-b1db-4c5441e49b5a None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:19.121979 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:29:19.160669 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624a7819-27d0-472e-92e9-9f4a8ab0aca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:19.161922 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624a7819-27d0-472e-92e9-9f4a8ab0aca3 admin admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:19.162682 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624a7819-27d0-472e-92e9-9f4a8ab0aca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:19.163229 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624a7819-27d0-472e-92e9-9f4a8ab0aca3 admin admin] PATH_INFO: `/v3/users` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:19.164570 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624a7819-27d0-472e-92e9-9f4a8ab0aca3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:19.169684 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624a7819-27d0-472e-92e9-9f4a8ab0aca3 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:19.220485 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1326/2651] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 31 00:29:18 2022] POST /identity/v3/users => generated 299 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:29:19.222917 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a632a5-61c9-4c25-a869-1c56c18a8c7e admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:19.250615 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a632a5-61c9-4c25-a869-1c56c18a8c7e admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:19.264369 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76d1c14-d78a-40f3-9f15-267821ecdb81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:19.266337 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76d1c14-d78a-40f3-9f15-267821ecdb81 admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:19.268192 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76d1c14-d78a-40f3-9f15-267821ecdb81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:19.269136 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76d1c14-d78a-40f3-9f15-267821ecdb81 admin admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:19.273586 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76d1c14-d78a-40f3-9f15-267821ecdb81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:19.279051 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76d1c14-d78a-40f3-9f15-267821ecdb81 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:19.318082 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1326/2652] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 00:29:19 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:29:19.328103 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624a7819-27d0-472e-92e9-9f4a8ab0aca3 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:19.376445 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624a7819-27d0-472e-92e9-9f4a8ab0aca3 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:19.397608 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567a931a-1700-4a20-b6d5-822689bc9f2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:19.399426 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567a931a-1700-4a20-b6d5-822689bc9f2f admin admin] REQUEST_METHOD: `PUT` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:19.399426 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567a931a-1700-4a20-b6d5-822689bc9f2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:19.405522 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567a931a-1700-4a20-b6d5-822689bc9f2f admin admin] PATH_INFO: `/v3/projects/6d32b099e27544be94816911b8e4f09b/users/cc015c6ce1c442c3980c64c2e99b9cb1/roles/12f6817f9aaa4e2bb477095a6bed5d0f` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:19.478335 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567a931a-1700-4a20-b6d5-822689bc9f2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d32b099e27544be94816911b8e4f09b, user_id=cc015c6ce1c442c3980c64c2e99b9cb1, role_id=12f6817f9aaa4e2bb477095a6bed5d0f)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:19.489881 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567a931a-1700-4a20-b6d5-822689bc9f2f admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:19.519552 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1327/2653] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 00:29:19 2022] PUT /identity/v3/projects/6d32b099e27544be94816911b8e4f09b/users/cc015c6ce1c442c3980c64c2e99b9cb1/roles/12f6817f9aaa4e2bb477095a6bed5d0f => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:29:19.524108 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76d1c14-d78a-40f3-9f15-267821ecdb81 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:19.560270 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76d1c14-d78a-40f3-9f15-267821ecdb81 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:19.612381 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:29:19.729022 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a205358a-33c3-4900-93bb-25c98c4c7c3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:19.730819 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a205358a-33c3-4900-93bb-25c98c4c7c3c admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:19.731300 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a205358a-33c3-4900-93bb-25c98c4c7c3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:19.731764 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a205358a-33c3-4900-93bb-25c98c4c7c3c admin admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:19.732918 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a205358a-33c3-4900-93bb-25c98c4c7c3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:19.736027 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a205358a-33c3-4900-93bb-25c98c4c7c3c admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:19.759475 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1327/2654] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 00:29:19 2022] GET /identity/v3/roles => generated 1420 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:29:19.765908 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567a931a-1700-4a20-b6d5-822689bc9f2f admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:19.790013 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567a931a-1700-4a20-b6d5-822689bc9f2f admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:19.803964 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a966e6e-34e7-4508-94e9-9bdee9e4d514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:19.804967 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a966e6e-34e7-4508-94e9-9bdee9e4d514 admin admin] REQUEST_METHOD: `PUT` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:19.805255 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a966e6e-34e7-4508-94e9-9bdee9e4d514 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:19.808958 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a966e6e-34e7-4508-94e9-9bdee9e4d514 admin admin] PATH_INFO: `/v3/projects/6d32b099e27544be94816911b8e4f09b/users/cc015c6ce1c442c3980c64c2e99b9cb1/roles/12f6817f9aaa4e2bb477095a6bed5d0f` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:19.812188 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a966e6e-34e7-4508-94e9-9bdee9e4d514 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d32b099e27544be94816911b8e4f09b, user_id=cc015c6ce1c442c3980c64c2e99b9cb1, role_id=12f6817f9aaa4e2bb477095a6bed5d0f)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:19.816610 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a966e6e-34e7-4508-94e9-9bdee9e4d514 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:19.834508 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1328/2655] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 00:29:19 2022] PUT /identity/v3/projects/6d32b099e27544be94816911b8e4f09b/users/cc015c6ce1c442c3980c64c2e99b9cb1/roles/12f6817f9aaa4e2bb477095a6bed5d0f => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:29:19.851639 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd16f5dc-b18a-4d7f-a340-3c13647b5c70 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:19.852116 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd16f5dc-b18a-4d7f-a340-3c13647b5c70 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:19.852618 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd16f5dc-b18a-4d7f-a340-3c13647b5c70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:19.908329 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-bd16f5dc-b18a-4d7f-a340-3c13647b5c70 None None] MFA Rules not processed for user `cc015c6ce1c442c3980c64c2e99b9cb1`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:29:19.911490 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-bd16f5dc-b18a-4d7f-a340-3c13647b5c70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:20.076735 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1328/2656] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:29:19 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:29:20.087702 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a966e6e-34e7-4508-94e9-9bdee9e4d514 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:20.089798 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-7a966e6e-34e7-4508-94e9-9bdee9e4d514 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:20.213602 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a966e6e-34e7-4508-94e9-9bdee9e4d514 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:20.218516 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a29699-b0cb-4590-b885-75b23f4317e8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beecda6e9feb400288618745c784989f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:20.219473 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a29699-b0cb-4590-b885-75b23f4317e8 service cinder] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:20.220106 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a29699-b0cb-4590-b885-75b23f4317e8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:20.220611 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a29699-b0cb-4590-b885-75b23f4317e8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:20.235990 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a29699-b0cb-4590-b885-75b23f4317e8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:20.263629 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a29699-b0cb-4590-b885-75b23f4317e8 service cinder] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:20.263629 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1329/2657] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:29:20 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 00:29:20.290577 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd16f5dc-b18a-4d7f-a340-3c13647b5c70 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:20.292601 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-bd16f5dc-b18a-4d7f-a340-3c13647b5c70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:20.444986 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd16f5dc-b18a-4d7f-a340-3c13647b5c70 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:20.453022 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb690ff-7a78-45fe-84c0-e5008ae4102c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:20.453850 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb690ff-7a78-45fe-84c0-e5008ae4102c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:20.454374 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb690ff-7a78-45fe-84c0-e5008ae4102c admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:20.454374 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb690ff-7a78-45fe-84c0-e5008ae4102c admin admin] PATH_INFO: `/v3/users/08fa033114244fc89c82939202f911e7` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:20.455566 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb690ff-7a78-45fe-84c0-e5008ae4102c admin admin] RBAC: Authorizing `identity:delete_user(user_id=08fa033114244fc89c82939202f911e7)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:20.458586 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb690ff-7a78-45fe-84c0-e5008ae4102c admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:20.567335 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:29:20.572607 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-3eb690ff-7a78-45fe-84c0-e5008ae4102c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08fa033114244fc89c82939202f911e7'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:20.589617 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-3eb690ff-7a78-45fe-84c0-e5008ae4102c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08fa033114244fc89c82939202f911e7'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:20.623594 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-3eb690ff-7a78-45fe-84c0-e5008ae4102c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08fa033114244fc89c82939202f911e7'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:20.625035 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-3eb690ff-7a78-45fe-84c0-e5008ae4102c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08fa033114244fc89c82939202f911e7'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:20.647235 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-3eb690ff-7a78-45fe-84c0-e5008ae4102c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08fa033114244fc89c82939202f911e7'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:20.658116 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1329/2658] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 31 00:29:20 2022] DELETE /identity/v3/users/08fa033114244fc89c82939202f911e7 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:29:20.994064 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a29699-b0cb-4590-b885-75b23f4317e8 service cinder] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:21.022974 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a29699-b0cb-4590-b885-75b23f4317e8 service cinder] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:21.196354 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731bd922-bc55-4457-90fb-c61799b418b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:21.197478 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731bd922-bc55-4457-90fb-c61799b418b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:21.198847 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731bd922-bc55-4457-90fb-c61799b418b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:21.199445 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731bd922-bc55-4457-90fb-c61799b418b5 admin admin] PATH_INFO: `/v3/projects/e53c8a6e81fe48d5b9609b921283e64d` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:21.203481 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731bd922-bc55-4457-90fb-c61799b418b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e53c8a6e81fe48d5b9609b921283e64d)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:21.208232 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731bd922-bc55-4457-90fb-c61799b418b5 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:21.462296 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:29:21.483297 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-731bd922-bc55-4457-90fb-c61799b418b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e53c8a6e81fe48d5b9609b921283e64d', 'request_id': 'req-731bd922-bc55-4457-90fb-c61799b418b5'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:21.532553 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-731bd922-bc55-4457-90fb-c61799b418b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e53c8a6e81fe48d5b9609b921283e64d', 'request_id': 'req-731bd922-bc55-4457-90fb-c61799b418b5'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:21.562145 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-731bd922-bc55-4457-90fb-c61799b418b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e53c8a6e81fe48d5b9609b921283e64d', 'request_id': 'req-731bd922-bc55-4457-90fb-c61799b418b5'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:21.612365 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-731bd922-bc55-4457-90fb-c61799b418b5 admin admin] The token cache is being invalidate because project e53c8a6e81fe48d5b9609b921283e64d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81523) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:29:21.614428 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-731bd922-bc55-4457-90fb-c61799b418b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:21.626183 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-731bd922-bc55-4457-90fb-c61799b418b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:21.631211 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1330/2659] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 31 00:29:20 2022] DELETE /identity/v3/projects/e53c8a6e81fe48d5b9609b921283e64d => generated 0 bytes in 637 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:29:21.638093 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d4d0b2-830b-4c35-af2e-d7ef27cbc4c1 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:21.639027 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d4d0b2-830b-4c35-af2e-d7ef27cbc4c1 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:21.639267 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d4d0b2-830b-4c35-af2e-d7ef27cbc4c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:21.679953 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-c8d4d0b2-830b-4c35-af2e-d7ef27cbc4c1 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:29:21.681620 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-c8d4d0b2-830b-4c35-af2e-d7ef27cbc4c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:21.702289 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731bd922-bc55-4457-90fb-c61799b418b5 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:21.704210 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-731bd922-bc55-4457-90fb-c61799b418b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:21.798084 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731bd922-bc55-4457-90fb-c61799b418b5 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:21.803191 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f8286c-d969-4c05-ab01-00d371848cc9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beecda6e9feb400288618745c784989f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:21.803837 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f8286c-d969-4c05-ab01-00d371848cc9 service cinder] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:21.804108 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f8286c-d969-4c05-ab01-00d371848cc9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:21.804811 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f8286c-d969-4c05-ab01-00d371848cc9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:21.808586 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-95f8286c-d969-4c05-ab01-00d371848cc9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:21.813419 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1330/2660] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:29:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:29:21.826286 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8652c9-5802-4001-affe-fccc738d410e None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:21.827156 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8652c9-5802-4001-affe-fccc738d410e None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:21.827505 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8652c9-5802-4001-affe-fccc738d410e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:21.880790 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-3c8652c9-5802-4001-affe-fccc738d410e None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:29:21.882565 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-3c8652c9-5802-4001-affe-fccc738d410e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:21.909967 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1331/2661] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:29:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:29:21.913724 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8652c9-5802-4001-affe-fccc738d410e None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:21.937418 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8652c9-5802-4001-affe-fccc738d410e None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:21.956777 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72e9235-e257-4372-973e-5997b8ee88ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:21.957991 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72e9235-e257-4372-973e-5997b8ee88ff admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:21.958489 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72e9235-e257-4372-973e-5997b8ee88ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:21.958985 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72e9235-e257-4372-973e-5997b8ee88ff admin admin] PATH_INFO: `/v3/domains` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:21.960882 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72e9235-e257-4372-973e-5997b8ee88ff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:29:21.961323 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72e9235-e257-4372-973e-5997b8ee88ff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:21.972035 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f8286c-d969-4c05-ab01-00d371848cc9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:21.973805 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72e9235-e257-4372-973e-5997b8ee88ff admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:21.978198 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f8286c-d969-4c05-ab01-00d371848cc9 service cinder] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:22.008644 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1331/2662] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:29:21 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 00:29:22.026007 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1332/2663] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 31 00:29:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:29:22.037700 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f8286c-d969-4c05-ab01-00d371848cc9 service cinder] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:22.078963 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f8286c-d969-4c05-ab01-00d371848cc9 service cinder] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:22.090529 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63fe206-f856-4597-a081-1386c481718f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:22.092298 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63fe206-f856-4597-a081-1386c481718f admin admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:22.093089 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63fe206-f856-4597-a081-1386c481718f admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:22.094127 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63fe206-f856-4597-a081-1386c481718f admin admin] PATH_INFO: `/v3/projects` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:22.097022 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63fe206-f856-4597-a081-1386c481718f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:22.113935 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63fe206-f856-4597-a081-1386c481718f admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:22.267258 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72e9235-e257-4372-973e-5997b8ee88ff admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:22.267590 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1332/2664] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 31 00:29:22 2022] POST /identity/v3/projects => generated 373 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:29:22.303258 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72e9235-e257-4372-973e-5997b8ee88ff admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:22.502446 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e82c82-ed8f-4531-9569-84b2523b5b71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:22.503259 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e82c82-ed8f-4531-9569-84b2523b5b71 admin admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:22.504507 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e82c82-ed8f-4531-9569-84b2523b5b71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:22.504869 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e82c82-ed8f-4531-9569-84b2523b5b71 admin admin] PATH_INFO: `/v3/users` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:22.507312 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e82c82-ed8f-4531-9569-84b2523b5b71 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:22.511647 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e82c82-ed8f-4531-9569-84b2523b5b71 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:22.569724 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1333/2665] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 31 00:29:22 2022] POST /identity/v3/users => generated 287 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:29:22.576962 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63fe206-f856-4597-a081-1386c481718f admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:22.623934 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63fe206-f856-4597-a081-1386c481718f admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:22.669570 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2d8ef6-7193-4268-9cf5-bb446586f931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:22.670605 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2d8ef6-7193-4268-9cf5-bb446586f931 admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:22.671079 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2d8ef6-7193-4268-9cf5-bb446586f931 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:22.671557 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2d8ef6-7193-4268-9cf5-bb446586f931 admin admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:22.672795 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2d8ef6-7193-4268-9cf5-bb446586f931 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:22.675785 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2d8ef6-7193-4268-9cf5-bb446586f931 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:22.778364 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e82c82-ed8f-4531-9569-84b2523b5b71 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:22.779210 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1333/2666] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 00:29:22 2022] GET /identity/v3/roles => generated 1420 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:29:22.821739 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e82c82-ed8f-4531-9569-84b2523b5b71 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:22.879999 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a19a77-c519-4ac8-9c67-7eb90391040d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:22.881079 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a19a77-c519-4ac8-9c67-7eb90391040d admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:22.881586 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a19a77-c519-4ac8-9c67-7eb90391040d admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:22.882070 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a19a77-c519-4ac8-9c67-7eb90391040d admin admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:22.891036 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a19a77-c519-4ac8-9c67-7eb90391040d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:22.907739 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a19a77-c519-4ac8-9c67-7eb90391040d admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:22.975256 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1334/2667] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 00:29:22 2022] GET /identity/v3/roles => generated 1420 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:29:22.983093 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2d8ef6-7193-4268-9cf5-bb446586f931 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:23.026957 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2d8ef6-7193-4268-9cf5-bb446586f931 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:23.066609 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceca92a9-4246-4250-a2f6-f966e6536b41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:23.067384 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceca92a9-4246-4250-a2f6-f966e6536b41 admin admin] REQUEST_METHOD: `PUT` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:23.067839 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceca92a9-4246-4250-a2f6-f966e6536b41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:23.070571 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceca92a9-4246-4250-a2f6-f966e6536b41 admin admin] PATH_INFO: `/v3/projects/a082132d2c224d239d9a736073e604a2/users/4e00bf6dda5f4ac6874892eb92cbf362/roles/fdad79ffbcbb4fa380dc9cf7dd108618` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:23.128441 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceca92a9-4246-4250-a2f6-f966e6536b41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a082132d2c224d239d9a736073e604a2, user_id=4e00bf6dda5f4ac6874892eb92cbf362, role_id=fdad79ffbcbb4fa380dc9cf7dd108618)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:23.134690 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceca92a9-4246-4250-a2f6-f966e6536b41 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:23.164117 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1334/2668] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 00:29:22 2022] PUT /identity/v3/projects/a082132d2c224d239d9a736073e604a2/users/4e00bf6dda5f4ac6874892eb92cbf362/roles/fdad79ffbcbb4fa380dc9cf7dd108618 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:29:23.177550 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cc8a1f-102b-4c84-89d6-2aced53ba009 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:23.178267 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cc8a1f-102b-4c84-89d6-2aced53ba009 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:23.179260 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cc8a1f-102b-4c84-89d6-2aced53ba009 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:23.233710 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-19cc8a1f-102b-4c84-89d6-2aced53ba009 None None] MFA Rules not processed for user `4e00bf6dda5f4ac6874892eb92cbf362`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:29:23.234895 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-19cc8a1f-102b-4c84-89d6-2aced53ba009 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:23.256089 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:29:23.376543 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1335/2669] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:29:23 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:29:23.390159 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceca92a9-4246-4250-a2f6-f966e6536b41 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:23.392193 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-ceca92a9-4246-4250-a2f6-f966e6536b41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:23.483698 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:DELETE=4,keystone:SELECT=93,keystone:INSERT=3 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:29:23.553539 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceca92a9-4246-4250-a2f6-f966e6536b41 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:23.561299 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1461a02c-3d6b-4085-84f0-a19771a98d21 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea002bf49c248dbae7147665fa10fd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:23.561979 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1461a02c-3d6b-4085-84f0-a19771a98d21 service nova] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:23.562277 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1461a02c-3d6b-4085-84f0-a19771a98d21 service nova] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:23.562552 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1461a02c-3d6b-4085-84f0-a19771a98d21 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:23.573802 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1461a02c-3d6b-4085-84f0-a19771a98d21 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:23.575523 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1461a02c-3d6b-4085-84f0-a19771a98d21 service nova] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:23.591475 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1335/2670] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:29:23 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:29:24.093424 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cc8a1f-102b-4c84-89d6-2aced53ba009 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:24.320977 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cc8a1f-102b-4c84-89d6-2aced53ba009 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:24.335806 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a93a46f-ae4e-4226-b46e-065f2a5607f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:24.341031 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a93a46f-ae4e-4226-b46e-065f2a5607f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:24.341930 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a93a46f-ae4e-4226-b46e-065f2a5607f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:24.343170 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a93a46f-ae4e-4226-b46e-065f2a5607f7 admin admin] PATH_INFO: `/v3/users/4e00bf6dda5f4ac6874892eb92cbf362` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:24.348845 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a93a46f-ae4e-4226-b46e-065f2a5607f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e00bf6dda5f4ac6874892eb92cbf362)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:24.362237 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a93a46f-ae4e-4226-b46e-065f2a5607f7 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:24.504327 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-3a93a46f-ae4e-4226-b46e-065f2a5607f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e00bf6dda5f4ac6874892eb92cbf362'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:24.529199 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-3a93a46f-ae4e-4226-b46e-065f2a5607f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e00bf6dda5f4ac6874892eb92cbf362'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:24.546047 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-3a93a46f-ae4e-4226-b46e-065f2a5607f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e00bf6dda5f4ac6874892eb92cbf362'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:24.546747 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-3a93a46f-ae4e-4226-b46e-065f2a5607f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e00bf6dda5f4ac6874892eb92cbf362'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:24.563844 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-3a93a46f-ae4e-4226-b46e-065f2a5607f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e00bf6dda5f4ac6874892eb92cbf362'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:24.571843 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1336/2671] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 31 00:29:24 2022] DELETE /identity/v3/users/4e00bf6dda5f4ac6874892eb92cbf362 => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:29:24.576465 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6198ce-e90c-4a46-b222-4367966959c8 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:24.577037 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6198ce-e90c-4a46-b222-4367966959c8 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:24.577037 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6198ce-e90c-4a46-b222-4367966959c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:24.603368 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-7e6198ce-e90c-4a46-b222-4367966959c8 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:29:24.605336 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-7e6198ce-e90c-4a46-b222-4367966959c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:24.769707 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1336/2672] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:29:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:29:24.793999 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a93a46f-ae4e-4226-b46e-065f2a5607f7 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:24.797308 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-3a93a46f-ae4e-4226-b46e-065f2a5607f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:24.899090 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:29:24.993447 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a93a46f-ae4e-4226-b46e-065f2a5607f7 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:25.007948 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab25dd4-05f8-47d8-abd0-b475da293d08 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'daae792cd11d4c4ca7aae0558998aced', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:25.008784 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab25dd4-05f8-47d8-abd0-b475da293d08 service neutron] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:25.009239 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab25dd4-05f8-47d8-abd0-b475da293d08 service neutron] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:25.009603 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab25dd4-05f8-47d8-abd0-b475da293d08 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:25.024756 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab25dd4-05f8-47d8-abd0-b475da293d08 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:25.026925 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab25dd4-05f8-47d8-abd0-b475da293d08 service neutron] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:25.040006 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1337/2673] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:29:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:29:25.196093 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6198ce-e90c-4a46-b222-4367966959c8 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:25.198373 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-7e6198ce-e90c-4a46-b222-4367966959c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:25.219515 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6198ce-e90c-4a46-b222-4367966959c8 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:25.224982 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78ca083-58bf-4962-81ef-e549a1158eb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:25.225672 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78ca083-58bf-4962-81ef-e549a1158eb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:25.226066 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78ca083-58bf-4962-81ef-e549a1158eb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:25.226685 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78ca083-58bf-4962-81ef-e549a1158eb0 admin admin] PATH_INFO: `/v3/users/1bbf319c68074eac868644558dd024f8` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:25.228085 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78ca083-58bf-4962-81ef-e549a1158eb0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1bbf319c68074eac868644558dd024f8)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:25.230763 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78ca083-58bf-4962-81ef-e549a1158eb0 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:25.348656 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-a78ca083-58bf-4962-81ef-e549a1158eb0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1bbf319c68074eac868644558dd024f8'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:25.360912 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-a78ca083-58bf-4962-81ef-e549a1158eb0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1bbf319c68074eac868644558dd024f8'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:25.383512 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-a78ca083-58bf-4962-81ef-e549a1158eb0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1bbf319c68074eac868644558dd024f8'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:25.421974 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-a78ca083-58bf-4962-81ef-e549a1158eb0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1bbf319c68074eac868644558dd024f8'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:25.424061 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-a78ca083-58bf-4962-81ef-e549a1158eb0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1bbf319c68074eac868644558dd024f8'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:25.458918 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1337/2674] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 31 00:29:25 2022] DELETE /identity/v3/users/1bbf319c68074eac868644558dd024f8 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:29:25.462148 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8618b982-c0d7-4ba8-81f7-0a8db2532c4b None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:25.462893 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8618b982-c0d7-4ba8-81f7-0a8db2532c4b None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:25.463440 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8618b982-c0d7-4ba8-81f7-0a8db2532c4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:25.520450 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-8618b982-c0d7-4ba8-81f7-0a8db2532c4b None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:29:25.522056 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-8618b982-c0d7-4ba8-81f7-0a8db2532c4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:25.754927 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1338/2675] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:29:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:29:25.796414 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78ca083-58bf-4962-81ef-e549a1158eb0 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:25.806291 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-a78ca083-58bf-4962-81ef-e549a1158eb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:25.911524 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:29:25.955353 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8618b982-c0d7-4ba8-81f7-0a8db2532c4b None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:25.957336 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-8618b982-c0d7-4ba8-81f7-0a8db2532c4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:26.012278 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8618b982-c0d7-4ba8-81f7-0a8db2532c4b None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:26.023856 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1aa3e8-0e75-4974-b20a-513114d5467e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:26.025003 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1aa3e8-0e75-4974-b20a-513114d5467e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:26.025447 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1aa3e8-0e75-4974-b20a-513114d5467e admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:26.026918 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1aa3e8-0e75-4974-b20a-513114d5467e admin admin] PATH_INFO: `/v3/projects/a082132d2c224d239d9a736073e604a2` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:26.045219 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1aa3e8-0e75-4974-b20a-513114d5467e admin admin] RBAC: Authorizing `identity:delete_project(project_id=a082132d2c224d239d9a736073e604a2)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:26.047343 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1aa3e8-0e75-4974-b20a-513114d5467e admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:26.078748 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78ca083-58bf-4962-81ef-e549a1158eb0 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:26.098513 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38e533d-17ea-4840-973e-acea5515f683 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'daae792cd11d4c4ca7aae0558998aced', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:26.099156 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38e533d-17ea-4840-973e-acea5515f683 service neutron] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:26.099437 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38e533d-17ea-4840-973e-acea5515f683 service neutron] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:26.099703 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38e533d-17ea-4840-973e-acea5515f683 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:26.116967 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38e533d-17ea-4840-973e-acea5515f683 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:26.122565 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38e533d-17ea-4840-973e-acea5515f683 service neutron] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:26.151665 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1338/2676] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:29:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:29:26.193885 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-fd1aa3e8-0e75-4974-b20a-513114d5467e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a082132d2c224d239d9a736073e604a2', 'request_id': 'req-fd1aa3e8-0e75-4974-b20a-513114d5467e'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:26.252709 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-fd1aa3e8-0e75-4974-b20a-513114d5467e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a082132d2c224d239d9a736073e604a2', 'request_id': 'req-fd1aa3e8-0e75-4974-b20a-513114d5467e'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:26.284912 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-fd1aa3e8-0e75-4974-b20a-513114d5467e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a082132d2c224d239d9a736073e604a2', 'request_id': 'req-fd1aa3e8-0e75-4974-b20a-513114d5467e'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:26.342941 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-fd1aa3e8-0e75-4974-b20a-513114d5467e admin admin] The token cache is being invalidate because project a082132d2c224d239d9a736073e604a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:29:26.343487 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-fd1aa3e8-0e75-4974-b20a-513114d5467e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:26.349013 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-fd1aa3e8-0e75-4974-b20a-513114d5467e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:26.366146 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1339/2677] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 31 00:29:25 2022] DELETE /identity/v3/projects/a082132d2c224d239d9a736073e604a2 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:29:26.372591 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f55ee6b-3608-4efd-b697-8a037583802a None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:26.373068 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f55ee6b-3608-4efd-b697-8a037583802a None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:26.373516 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f55ee6b-3608-4efd-b697-8a037583802a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:26.416941 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-8f55ee6b-3608-4efd-b697-8a037583802a None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:29:26.419465 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-8f55ee6b-3608-4efd-b697-8a037583802a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:26.567582 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1339/2678] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:29:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:29:26.578242 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476f1f1d-ca74-4d8e-8ce1-065bb3cffff3 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:26.578827 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476f1f1d-ca74-4d8e-8ce1-065bb3cffff3 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:26.578827 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476f1f1d-ca74-4d8e-8ce1-065bb3cffff3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:26.654144 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-476f1f1d-ca74-4d8e-8ce1-065bb3cffff3 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:29:26.658381 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-476f1f1d-ca74-4d8e-8ce1-065bb3cffff3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:26.675791 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1340/2679] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:29:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:29:26.682696 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f55ee6b-3608-4efd-b697-8a037583802a None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:26.701475 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f55ee6b-3608-4efd-b697-8a037583802a None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:26.712032 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501cd0e2-68cb-401e-bfb9-9dfaef745361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:26.714216 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501cd0e2-68cb-401e-bfb9-9dfaef745361 admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:26.714783 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501cd0e2-68cb-401e-bfb9-9dfaef745361 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:26.715740 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501cd0e2-68cb-401e-bfb9-9dfaef745361 admin admin] PATH_INFO: `/v3/domains` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:26.717719 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501cd0e2-68cb-401e-bfb9-9dfaef745361 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:29:26.718488 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501cd0e2-68cb-401e-bfb9-9dfaef745361 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:26.722838 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501cd0e2-68cb-401e-bfb9-9dfaef745361 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:26.756382 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1340/2680] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 31 00:29:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:29:26.762388 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476f1f1d-ca74-4d8e-8ce1-065bb3cffff3 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:26.781432 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476f1f1d-ca74-4d8e-8ce1-065bb3cffff3 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:26.788111 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d2aa04-795c-4d93-ae66-61d5fa4dfcb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:26.790454 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d2aa04-795c-4d93-ae66-61d5fa4dfcb2 admin admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:26.792495 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d2aa04-795c-4d93-ae66-61d5fa4dfcb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:26.793948 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d2aa04-795c-4d93-ae66-61d5fa4dfcb2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:26.794880 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d2aa04-795c-4d93-ae66-61d5fa4dfcb2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:26.797538 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d2aa04-795c-4d93-ae66-61d5fa4dfcb2 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:26.860567 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1341/2681] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 31 00:29:26 2022] POST /identity/v3/projects => generated 357 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:29:26.862641 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501cd0e2-68cb-401e-bfb9-9dfaef745361 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:26.881955 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501cd0e2-68cb-401e-bfb9-9dfaef745361 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:27.023223 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ec770b-51ec-47e2-8f4d-d560600357ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:27.023869 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ec770b-51ec-47e2-8f4d-d560600357ac admin admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:27.024174 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ec770b-51ec-47e2-8f4d-d560600357ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:27.024456 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ec770b-51ec-47e2-8f4d-d560600357ac admin admin] PATH_INFO: `/v3/users` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:27.025127 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ec770b-51ec-47e2-8f4d-d560600357ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:27.028277 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ec770b-51ec-47e2-8f4d-d560600357ac admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:27.058803 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1341/2682] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 31 00:29:26 2022] POST /identity/v3/users => generated 279 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:29:27.062955 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d2aa04-795c-4d93-ae66-61d5fa4dfcb2 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:27.076449 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d2aa04-795c-4d93-ae66-61d5fa4dfcb2 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:27.086991 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f291ce18-a2fc-47b1-9238-b30ec8a6baf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:27.087638 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f291ce18-a2fc-47b1-9238-b30ec8a6baf4 admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:27.087969 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f291ce18-a2fc-47b1-9238-b30ec8a6baf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:27.089247 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f291ce18-a2fc-47b1-9238-b30ec8a6baf4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:27.090073 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f291ce18-a2fc-47b1-9238-b30ec8a6baf4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:27.092194 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f291ce18-a2fc-47b1-9238-b30ec8a6baf4 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:27.109033 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1342/2683] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 00:29:27 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 00:29:27.111426 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ec770b-51ec-47e2-8f4d-d560600357ac admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:27.144633 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ec770b-51ec-47e2-8f4d-d560600357ac admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:27.161232 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43260e93-c9e6-4979-a41f-f20a8dafdf87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:27.162108 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43260e93-c9e6-4979-a41f-f20a8dafdf87 admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:27.162458 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43260e93-c9e6-4979-a41f-f20a8dafdf87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:27.162920 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43260e93-c9e6-4979-a41f-f20a8dafdf87 admin admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:27.163417 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43260e93-c9e6-4979-a41f-f20a8dafdf87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:27.170826 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43260e93-c9e6-4979-a41f-f20a8dafdf87 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:27.187595 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f291ce18-a2fc-47b1-9238-b30ec8a6baf4 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:27.190942 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-f291ce18-a2fc-47b1-9238-b30ec8a6baf4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:27.204633 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1342/2684] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 00:29:27 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:29:27.206737 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43260e93-c9e6-4979-a41f-f20a8dafdf87 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:27.223031 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f291ce18-a2fc-47b1-9238-b30ec8a6baf4 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:27.231385 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009d95b0-3f03-43fc-8364-6e69f15f1846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:27.234214 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009d95b0-3f03-43fc-8364-6e69f15f1846 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:27.235249 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009d95b0-3f03-43fc-8364-6e69f15f1846 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:27.236238 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009d95b0-3f03-43fc-8364-6e69f15f1846 admin admin] PATH_INFO: `/v3/projects/a655bce9415b49d994547fff5c199e11` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:27.241225 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009d95b0-3f03-43fc-8364-6e69f15f1846 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a655bce9415b49d994547fff5c199e11)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:27.241669 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43260e93-c9e6-4979-a41f-f20a8dafdf87 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:27.247382 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009d95b0-3f03-43fc-8364-6e69f15f1846 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:27.252381 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12ca987-1ee3-41fd-ab2f-8d2552bc5771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:27.253966 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12ca987-1ee3-41fd-ab2f-8d2552bc5771 admin admin] REQUEST_METHOD: `PUT` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:27.254317 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12ca987-1ee3-41fd-ab2f-8d2552bc5771 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:27.254827 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12ca987-1ee3-41fd-ab2f-8d2552bc5771 admin admin] PATH_INFO: `/v3/projects/be5e3fd7127e488db46cf000c47d7bda/users/b0cf1e8e5e3844f6b463257cc814032d/roles/fdad79ffbcbb4fa380dc9cf7dd108618` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:27.275070 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12ca987-1ee3-41fd-ab2f-8d2552bc5771 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be5e3fd7127e488db46cf000c47d7bda, user_id=b0cf1e8e5e3844f6b463257cc814032d, role_id=fdad79ffbcbb4fa380dc9cf7dd108618)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:27.280542 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12ca987-1ee3-41fd-ab2f-8d2552bc5771 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:27.281204 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:29:27.306540 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1343/2685] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 00:29:27 2022] PUT /identity/v3/projects/be5e3fd7127e488db46cf000c47d7bda/users/b0cf1e8e5e3844f6b463257cc814032d/roles/fdad79ffbcbb4fa380dc9cf7dd108618 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:29:27.318677 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef94c1e-de1b-4896-8b29-cc8bd37d44d5 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:27.319097 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef94c1e-de1b-4896-8b29-cc8bd37d44d5 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:27.319442 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef94c1e-de1b-4896-8b29-cc8bd37d44d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:27.356724 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:29:27.357125 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-009d95b0-3f03-43fc-8364-6e69f15f1846 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a655bce9415b49d994547fff5c199e11', 'request_id': 'req-009d95b0-3f03-43fc-8364-6e69f15f1846'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:27.362630 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-0ef94c1e-de1b-4896-8b29-cc8bd37d44d5 None None] MFA Rules not processed for user `b0cf1e8e5e3844f6b463257cc814032d`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:29:27.365840 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-0ef94c1e-de1b-4896-8b29-cc8bd37d44d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:27.368963 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-009d95b0-3f03-43fc-8364-6e69f15f1846 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a655bce9415b49d994547fff5c199e11', 'request_id': 'req-009d95b0-3f03-43fc-8364-6e69f15f1846'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:27.377660 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-009d95b0-3f03-43fc-8364-6e69f15f1846 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a655bce9415b49d994547fff5c199e11', 'request_id': 'req-009d95b0-3f03-43fc-8364-6e69f15f1846'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:27.401404 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-009d95b0-3f03-43fc-8364-6e69f15f1846 admin admin] The token cache is being invalidate because project a655bce9415b49d994547fff5c199e11 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:29:27.401711 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-009d95b0-3f03-43fc-8364-6e69f15f1846 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:27.404685 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-009d95b0-3f03-43fc-8364-6e69f15f1846 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:27.406921 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1343/2686] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 31 00:29:27 2022] DELETE /identity/v3/projects/a655bce9415b49d994547fff5c199e11 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:29:27.412795 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db866826-c5d1-4a9a-9baa-ad4206c00f51 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:27.425900 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db866826-c5d1-4a9a-9baa-ad4206c00f51 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:27.428468 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db866826-c5d1-4a9a-9baa-ad4206c00f51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:27.461655 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-db866826-c5d1-4a9a-9baa-ad4206c00f51 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:29:27.463974 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-db866826-c5d1-4a9a-9baa-ad4206c00f51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:27.560214 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1344/2687] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:29:27 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:29:27.566838 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1344/2688] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:29:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:29:27.575181 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef94c1e-de1b-4896-8b29-cc8bd37d44d5 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:27.576170 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59158771-cdc4-4323-b913-931eac1f8f76 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:27.576470 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59158771-cdc4-4323-b913-931eac1f8f76 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:27.576743 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59158771-cdc4-4323-b913-931eac1f8f76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:27.577508 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-0ef94c1e-de1b-4896-8b29-cc8bd37d44d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:27.598952 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef94c1e-de1b-4896-8b29-cc8bd37d44d5 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:27.599679 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-59158771-cdc4-4323-b913-931eac1f8f76 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:29:27.600950 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-59158771-cdc4-4323-b913-931eac1f8f76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:27.606211 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d65007-ad43-4fb0-88df-c67f5a5c82b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:27.607110 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d65007-ad43-4fb0-88df-c67f5a5c82b9 admin admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:27.607550 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d65007-ad43-4fb0-88df-c67f5a5c82b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:27.608005 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d65007-ad43-4fb0-88df-c67f5a5c82b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:27.608860 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d65007-ad43-4fb0-88df-c67f5a5c82b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:27.613623 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1345/2689] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:29:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:29:27.613819 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d65007-ad43-4fb0-88df-c67f5a5c82b9 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:27.615851 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59158771-cdc4-4323-b913-931eac1f8f76 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:27.629880 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59158771-cdc4-4323-b913-931eac1f8f76 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:27.636222 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00aa0a2e-2ef7-48fe-9d12-9ff869802cfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:27.636857 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aa0a2e-2ef7-48fe-9d12-9ff869802cfa admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:27.637138 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aa0a2e-2ef7-48fe-9d12-9ff869802cfa admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:27.637419 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aa0a2e-2ef7-48fe-9d12-9ff869802cfa admin admin] PATH_INFO: `/v3/domains` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:27.638132 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00aa0a2e-2ef7-48fe-9d12-9ff869802cfa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:29:27.638440 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00aa0a2e-2ef7-48fe-9d12-9ff869802cfa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:27.640081 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00aa0a2e-2ef7-48fe-9d12-9ff869802cfa admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:27.660067 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1346/2690] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 31 00:29:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:29:27.664559 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00aa0a2e-2ef7-48fe-9d12-9ff869802cfa admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:27.681208 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00aa0a2e-2ef7-48fe-9d12-9ff869802cfa admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:27.689690 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246714b2-8503-4d57-9828-14c84584f3a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:27.690589 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246714b2-8503-4d57-9828-14c84584f3a2 admin admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:27.691028 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246714b2-8503-4d57-9828-14c84584f3a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:27.691410 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246714b2-8503-4d57-9828-14c84584f3a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:27.692349 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246714b2-8503-4d57-9828-14c84584f3a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:27.695609 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246714b2-8503-4d57-9828-14c84584f3a2 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:27.700881 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1345/2691] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 31 00:29:27 2022] POST /identity/v3/projects => generated 357 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:29:27.706069 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d65007-ad43-4fb0-88df-c67f5a5c82b9 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:27.749882 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1347/2692] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 31 00:29:27 2022] POST /identity/v3/projects => generated 375 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:29:27.754320 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246714b2-8503-4d57-9828-14c84584f3a2 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:27.843423 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d65007-ad43-4fb0-88df-c67f5a5c82b9 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:27.855691 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc35ffc-f2b3-4f63-b2f0-390227d8e6bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:27.858725 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc35ffc-f2b3-4f63-b2f0-390227d8e6bf admin admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:27.859407 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc35ffc-f2b3-4f63-b2f0-390227d8e6bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:27.859407 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc35ffc-f2b3-4f63-b2f0-390227d8e6bf admin admin] PATH_INFO: `/v3/users` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:27.860423 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc35ffc-f2b3-4f63-b2f0-390227d8e6bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:27.866643 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc35ffc-f2b3-4f63-b2f0-390227d8e6bf admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:27.876318 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246714b2-8503-4d57-9828-14c84584f3a2 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:27.889119 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3b18d0-1b80-44a8-881b-cb0e65cd7aad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:27.889775 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3b18d0-1b80-44a8-881b-cb0e65cd7aad admin admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:27.890234 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3b18d0-1b80-44a8-881b-cb0e65cd7aad admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:27.891182 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3b18d0-1b80-44a8-881b-cb0e65cd7aad admin admin] PATH_INFO: `/v3/users` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:27.891182 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3b18d0-1b80-44a8-881b-cb0e65cd7aad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:27.900307 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3b18d0-1b80-44a8-881b-cb0e65cd7aad admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:27.913799 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1346/2693] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 31 00:29:27 2022] POST /identity/v3/users => generated 285 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:29:27.914490 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:29:27.917130 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc35ffc-f2b3-4f63-b2f0-390227d8e6bf admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:27.920271 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-9cc35ffc-f2b3-4f63-b2f0-390227d8e6bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:27.947652 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1348/2694] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 31 00:29:27 2022] POST /identity/v3/users => generated 288 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:29:27.950867 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3b18d0-1b80-44a8-881b-cb0e65cd7aad admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:27.970082 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3b18d0-1b80-44a8-881b-cb0e65cd7aad admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:27.981424 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2472edd-3128-41cf-b2d2-99ebd2e818b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:27.982523 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2472edd-3128-41cf-b2d2-99ebd2e818b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:27.983007 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2472edd-3128-41cf-b2d2-99ebd2e818b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:27.983469 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2472edd-3128-41cf-b2d2-99ebd2e818b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:27.984404 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2472edd-3128-41cf-b2d2-99ebd2e818b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:27.986386 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2472edd-3128-41cf-b2d2-99ebd2e818b1 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:28.004709 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1349/2695] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 00:29:27 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:29:28.005895 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2472edd-3128-41cf-b2d2-99ebd2e818b1 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:28.011945 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc35ffc-f2b3-4f63-b2f0-390227d8e6bf admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:28.016751 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76580ab-e325-431e-9f9a-f69928083d1b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beecda6e9feb400288618745c784989f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:28.017738 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76580ab-e325-431e-9f9a-f69928083d1b service cinder] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:28.018238 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76580ab-e325-431e-9f9a-f69928083d1b service cinder] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:28.018581 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76580ab-e325-431e-9f9a-f69928083d1b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:28.021208 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-b76580ab-e325-431e-9f9a-f69928083d1b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:28.046181 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2472edd-3128-41cf-b2d2-99ebd2e818b1 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:28.055799 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9d51c4-d802-4181-b045-3339dbce29f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:28.059000 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9d51c4-d802-4181-b045-3339dbce29f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:28.059529 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9d51c4-d802-4181-b045-3339dbce29f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:28.059998 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9d51c4-d802-4181-b045-3339dbce29f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:28.060880 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9d51c4-d802-4181-b045-3339dbce29f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:28.062753 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:29:28.063196 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9d51c4-d802-4181-b045-3339dbce29f4 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:28.081635 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1350/2696] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 00:29:28 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:29:28.085575 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9d51c4-d802-4181-b045-3339dbce29f4 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:28.107021 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9d51c4-d802-4181-b045-3339dbce29f4 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:28.117847 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76580ab-e325-431e-9f9a-f69928083d1b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:28.121034 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76580ab-e325-431e-9f9a-f69928083d1b service cinder] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:28.130243 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f16180-d00d-45e3-96dd-e343a2763980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:28.130940 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f16180-d00d-45e3-96dd-e343a2763980 admin admin] REQUEST_METHOD: `PUT` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:28.131225 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f16180-d00d-45e3-96dd-e343a2763980 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:28.131505 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f16180-d00d-45e3-96dd-e343a2763980 admin admin] PATH_INFO: `/v3/projects/5f2f5e45a5bc4023941da77e3972f0ac/users/68db028557df451a8448f6132d37341b/roles/12f6817f9aaa4e2bb477095a6bed5d0f` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:28.133166 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1347/2697] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:29:27 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:29:28.139101 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76580ab-e325-431e-9f9a-f69928083d1b service cinder] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:28.162113 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76580ab-e325-431e-9f9a-f69928083d1b service cinder] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:28.164808 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f16180-d00d-45e3-96dd-e343a2763980 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f2f5e45a5bc4023941da77e3972f0ac, user_id=68db028557df451a8448f6132d37341b, role_id=12f6817f9aaa4e2bb477095a6bed5d0f)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:28.167837 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f16180-d00d-45e3-96dd-e343a2763980 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:28.181132 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefe0025-8e57-47d6-8cf9-a195811c4027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:28.183501 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefe0025-8e57-47d6-8cf9-a195811c4027 admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:28.183791 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefe0025-8e57-47d6-8cf9-a195811c4027 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:28.185220 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefe0025-8e57-47d6-8cf9-a195811c4027 admin admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:28.185942 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefe0025-8e57-47d6-8cf9-a195811c4027 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:28.192667 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefe0025-8e57-47d6-8cf9-a195811c4027 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:28.202439 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1351/2698] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 00:29:28 2022] PUT /identity/v3/projects/5f2f5e45a5bc4023941da77e3972f0ac/users/68db028557df451a8448f6132d37341b/roles/12f6817f9aaa4e2bb477095a6bed5d0f => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:29:28.206195 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f16180-d00d-45e3-96dd-e343a2763980 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:28.221204 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1348/2699] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 00:29:28 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:29:28.226206 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefe0025-8e57-47d6-8cf9-a195811c4027 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:28.247543 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefe0025-8e57-47d6-8cf9-a195811c4027 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:28.368282 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71737f5b-4e2d-4171-bede-f68b992e685c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:28.368818 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f16180-d00d-45e3-96dd-e343a2763980 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:28.371148 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71737f5b-4e2d-4171-bede-f68b992e685c admin admin] REQUEST_METHOD: `PUT` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:28.371148 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71737f5b-4e2d-4171-bede-f68b992e685c admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:28.371148 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71737f5b-4e2d-4171-bede-f68b992e685c admin admin] PATH_INFO: `/v3/projects/acc3a85473504e87ad9a9f4898426d9d/users/0246b239e1a14cab8ad2d5d69a43664e/roles/fdad79ffbcbb4fa380dc9cf7dd108618` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:28.382372 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdda20a-bb96-43be-8bac-65f5b6ccbc1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:28.383647 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdda20a-bb96-43be-8bac-65f5b6ccbc1f admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:28.384394 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdda20a-bb96-43be-8bac-65f5b6ccbc1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:28.385168 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdda20a-bb96-43be-8bac-65f5b6ccbc1f admin admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:28.386515 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdda20a-bb96-43be-8bac-65f5b6ccbc1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:28.397884 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71737f5b-4e2d-4171-bede-f68b992e685c admin admin] RBAC: Authorizing `identity:create_grant(project_id=acc3a85473504e87ad9a9f4898426d9d, user_id=0246b239e1a14cab8ad2d5d69a43664e, role_id=fdad79ffbcbb4fa380dc9cf7dd108618)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:28.400853 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71737f5b-4e2d-4171-bede-f68b992e685c admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:28.405398 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdda20a-bb96-43be-8bac-65f5b6ccbc1f admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:28.437906 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1349/2700] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 00:29:28 2022] PUT /identity/v3/projects/acc3a85473504e87ad9a9f4898426d9d/users/0246b239e1a14cab8ad2d5d69a43664e/roles/fdad79ffbcbb4fa380dc9cf7dd108618 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:29:28.438586 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1352/2701] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 00:29:28 2022] GET /identity/v3/roles => generated 1420 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:29:28.442281 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71737f5b-4e2d-4171-bede-f68b992e685c admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:28.458921 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106f63b6-6f60-4447-9771-c01d0fc2f796 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:28.460003 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106f63b6-6f60-4447-9771-c01d0fc2f796 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:28.460693 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106f63b6-6f60-4447-9771-c01d0fc2f796 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:28.561514 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-106f63b6-6f60-4447-9771-c01d0fc2f796 None None] MFA Rules not processed for user `0246b239e1a14cab8ad2d5d69a43664e`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:29:28.563681 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-106f63b6-6f60-4447-9771-c01d0fc2f796 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:28.614182 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71737f5b-4e2d-4171-bede-f68b992e685c admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:28.622549 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56fccca-adf1-4860-88ff-1a53137b4850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:28.623522 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56fccca-adf1-4860-88ff-1a53137b4850 admin admin] REQUEST_METHOD: `PUT` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:28.624060 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56fccca-adf1-4860-88ff-1a53137b4850 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:28.624634 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56fccca-adf1-4860-88ff-1a53137b4850 admin admin] PATH_INFO: `/v3/projects/5f2f5e45a5bc4023941da77e3972f0ac/users/68db028557df451a8448f6132d37341b/roles/12f6817f9aaa4e2bb477095a6bed5d0f` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:28.627319 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56fccca-adf1-4860-88ff-1a53137b4850 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f2f5e45a5bc4023941da77e3972f0ac, user_id=68db028557df451a8448f6132d37341b, role_id=12f6817f9aaa4e2bb477095a6bed5d0f)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:28.631810 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56fccca-adf1-4860-88ff-1a53137b4850 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:28.650857 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1350/2702] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 00:29:28 2022] PUT /identity/v3/projects/5f2f5e45a5bc4023941da77e3972f0ac/users/68db028557df451a8448f6132d37341b/roles/12f6817f9aaa4e2bb477095a6bed5d0f => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:29:28.669722 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb82298e-749f-49c0-9e50-6469def265d0 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:28.671895 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb82298e-749f-49c0-9e50-6469def265d0 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:28.672816 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb82298e-749f-49c0-9e50-6469def265d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:28.721628 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1353/2703] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:29:28 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:29:28.729669 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-bb82298e-749f-49c0-9e50-6469def265d0 None None] MFA Rules not processed for user `68db028557df451a8448f6132d37341b`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:29:28.730920 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-bb82298e-749f-49c0-9e50-6469def265d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:28.732934 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106f63b6-6f60-4447-9771-c01d0fc2f796 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:28.734332 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-106f63b6-6f60-4447-9771-c01d0fc2f796 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:28.777184 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:29:28.782331 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:29:28.833860 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106f63b6-6f60-4447-9771-c01d0fc2f796 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:28.939218 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1351/2704] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:29:28 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:29:28.960130 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a470e39-a5eb-4804-92e7-d9b4cd17fb14 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beecda6e9feb400288618745c784989f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:28.961750 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a470e39-a5eb-4804-92e7-d9b4cd17fb14 service cinder] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:28.962239 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a470e39-a5eb-4804-92e7-d9b4cd17fb14 service cinder] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:28.962728 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a470e39-a5eb-4804-92e7-d9b4cd17fb14 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:29.137074 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a470e39-a5eb-4804-92e7-d9b4cd17fb14 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:29.140554 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a470e39-a5eb-4804-92e7-d9b4cd17fb14 service cinder] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:29.159862 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1354/2705] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:29:28 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:29:29.185832 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb82298e-749f-49c0-9e50-6469def265d0 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:29.199721 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb82298e-749f-49c0-9e50-6469def265d0 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:29.205511 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33251f37-c3f3-4d7c-afb0-5590faef1f31 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beecda6e9feb400288618745c784989f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:29.206214 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33251f37-c3f3-4d7c-afb0-5590faef1f31 service cinder] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:29.206487 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33251f37-c3f3-4d7c-afb0-5590faef1f31 service cinder] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:29.206882 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33251f37-c3f3-4d7c-afb0-5590faef1f31 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:29.221649 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33251f37-c3f3-4d7c-afb0-5590faef1f31 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:29.223680 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33251f37-c3f3-4d7c-afb0-5590faef1f31 service cinder] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:29.249502 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1352/2706] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:29:29 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:29:29.612079 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a470e39-a5eb-4804-92e7-d9b4cd17fb14 service cinder] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:29.651095 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a470e39-a5eb-4804-92e7-d9b4cd17fb14 service cinder] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:29.662457 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dc06a3-a7fa-48ac-a5c8-3c61fe672b2a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beecda6e9feb400288618745c784989f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:29.663658 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dc06a3-a7fa-48ac-a5c8-3c61fe672b2a service cinder] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:29.664244 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dc06a3-a7fa-48ac-a5c8-3c61fe672b2a service cinder] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:29.666881 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dc06a3-a7fa-48ac-a5c8-3c61fe672b2a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:29.809990 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dc06a3-a7fa-48ac-a5c8-3c61fe672b2a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:29.811567 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dc06a3-a7fa-48ac-a5c8-3c61fe672b2a service cinder] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:29.826674 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1355/2707] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:29:29 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:29:32.736382 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33251f37-c3f3-4d7c-afb0-5590faef1f31 service cinder] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:32.740115 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-33251f37-c3f3-4d7c-afb0-5590faef1f31 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:32.746949 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dc06a3-a7fa-48ac-a5c8-3c61fe672b2a service cinder] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:32.750067 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-37dc06a3-a7fa-48ac-a5c8-3c61fe672b2a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:32.822981 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:29:32.842243 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33251f37-c3f3-4d7c-afb0-5590faef1f31 service cinder] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:32.850464 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b225b6c6-4e7a-4076-ad2e-2b259da5d3fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:32.851593 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b225b6c6-4e7a-4076-ad2e-2b259da5d3fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:32.852065 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b225b6c6-4e7a-4076-ad2e-2b259da5d3fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:32.852571 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b225b6c6-4e7a-4076-ad2e-2b259da5d3fd admin admin] PATH_INFO: `/v3/users/213a798609294cb3ab6e0312ddbb1024` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:32.855728 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b225b6c6-4e7a-4076-ad2e-2b259da5d3fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=213a798609294cb3ab6e0312ddbb1024)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:32.859564 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b225b6c6-4e7a-4076-ad2e-2b259da5d3fd admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:32.860488 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dc06a3-a7fa-48ac-a5c8-3c61fe672b2a service cinder] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:32.865978 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac24fa3f-f042-4c3d-bca8-88f7faddf04a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:32.866686 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac24fa3f-f042-4c3d-bca8-88f7faddf04a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:32.866971 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac24fa3f-f042-4c3d-bca8-88f7faddf04a admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:32.867244 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac24fa3f-f042-4c3d-bca8-88f7faddf04a admin admin] PATH_INFO: `/v3/users/1576c2bcb00449f387f7acff1add77d5` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:32.868590 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac24fa3f-f042-4c3d-bca8-88f7faddf04a admin admin] RBAC: Authorizing `identity:delete_user(user_id=1576c2bcb00449f387f7acff1add77d5)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:32.870643 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac24fa3f-f042-4c3d-bca8-88f7faddf04a admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:32.938836 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-b225b6c6-4e7a-4076-ad2e-2b259da5d3fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '213a798609294cb3ab6e0312ddbb1024'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:32.940988 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-ac24fa3f-f042-4c3d-bca8-88f7faddf04a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1576c2bcb00449f387f7acff1add77d5'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:32.950794 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-b225b6c6-4e7a-4076-ad2e-2b259da5d3fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '213a798609294cb3ab6e0312ddbb1024'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:32.954224 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-ac24fa3f-f042-4c3d-bca8-88f7faddf04a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1576c2bcb00449f387f7acff1add77d5'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:32.962808 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-b225b6c6-4e7a-4076-ad2e-2b259da5d3fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '213a798609294cb3ab6e0312ddbb1024'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:32.970593 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-ac24fa3f-f042-4c3d-bca8-88f7faddf04a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1576c2bcb00449f387f7acff1add77d5'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:32.971566 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-ac24fa3f-f042-4c3d-bca8-88f7faddf04a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1576c2bcb00449f387f7acff1add77d5'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:33.013472 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-b225b6c6-4e7a-4076-ad2e-2b259da5d3fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '213a798609294cb3ab6e0312ddbb1024'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:33.016554 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-b225b6c6-4e7a-4076-ad2e-2b259da5d3fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '213a798609294cb3ab6e0312ddbb1024'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:33.022681 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-ac24fa3f-f042-4c3d-bca8-88f7faddf04a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1576c2bcb00449f387f7acff1add77d5'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:33.029933 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1353/2708] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 31 00:29:32 2022] DELETE /identity/v3/users/213a798609294cb3ab6e0312ddbb1024 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:29:33.040229 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1356/2709] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 31 00:29:32 2022] DELETE /identity/v3/users/1576c2bcb00449f387f7acff1add77d5 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:29:33.047133 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cea417b-4714-42d4-8c98-9295392d6264 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:33.047865 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cea417b-4714-42d4-8c98-9295392d6264 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:33.048563 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cea417b-4714-42d4-8c98-9295392d6264 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:33.087165 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-7cea417b-4714-42d4-8c98-9295392d6264 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:29:33.090218 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-7cea417b-4714-42d4-8c98-9295392d6264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:33.123835 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:29:33.225292 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1354/2710] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:29:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:29:33.240931 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac24fa3f-f042-4c3d-bca8-88f7faddf04a admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:33.244036 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-ac24fa3f-f042-4c3d-bca8-88f7faddf04a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:33.340733 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cea417b-4714-42d4-8c98-9295392d6264 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:33.343457 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-7cea417b-4714-42d4-8c98-9295392d6264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:33.360106 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cea417b-4714-42d4-8c98-9295392d6264 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:33.389609 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac24fa3f-f042-4c3d-bca8-88f7faddf04a admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:33.390325 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22501a28-cb4b-4eea-8e80-cd5245348789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:33.393139 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22501a28-cb4b-4eea-8e80-cd5245348789 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:33.393790 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22501a28-cb4b-4eea-8e80-cd5245348789 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:33.396649 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22501a28-cb4b-4eea-8e80-cd5245348789 admin admin] PATH_INFO: `/v3/projects/81666ce8589a4e45ac7f5f9e6e6cc9a3` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:33.399565 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22501a28-cb4b-4eea-8e80-cd5245348789 admin admin] RBAC: Authorizing `identity:delete_project(project_id=81666ce8589a4e45ac7f5f9e6e6cc9a3)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:33.406545 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22501a28-cb4b-4eea-8e80-cd5245348789 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:33.407518 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d882e7-1e1c-4fe9-addd-b226de3e6b9a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'daae792cd11d4c4ca7aae0558998aced', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:33.409232 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d882e7-1e1c-4fe9-addd-b226de3e6b9a service neutron] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:33.409768 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d882e7-1e1c-4fe9-addd-b226de3e6b9a service neutron] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:33.412473 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d882e7-1e1c-4fe9-addd-b226de3e6b9a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:33.427847 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d882e7-1e1c-4fe9-addd-b226de3e6b9a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:33.429552 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d882e7-1e1c-4fe9-addd-b226de3e6b9a service neutron] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:33.444442 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1357/2711] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:29:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:29:33.500648 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-22501a28-cb4b-4eea-8e80-cd5245348789 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81666ce8589a4e45ac7f5f9e6e6cc9a3', 'request_id': 'req-22501a28-cb4b-4eea-8e80-cd5245348789'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:33.517453 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-22501a28-cb4b-4eea-8e80-cd5245348789 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81666ce8589a4e45ac7f5f9e6e6cc9a3', 'request_id': 'req-22501a28-cb4b-4eea-8e80-cd5245348789'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:33.526434 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-22501a28-cb4b-4eea-8e80-cd5245348789 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81666ce8589a4e45ac7f5f9e6e6cc9a3', 'request_id': 'req-22501a28-cb4b-4eea-8e80-cd5245348789'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:33.558159 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-22501a28-cb4b-4eea-8e80-cd5245348789 admin admin] The token cache is being invalidate because project 81666ce8589a4e45ac7f5f9e6e6cc9a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81523) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:29:33.558898 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-22501a28-cb4b-4eea-8e80-cd5245348789 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:33.559907 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-22501a28-cb4b-4eea-8e80-cd5245348789 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:33.567939 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1355/2712] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 31 00:29:33 2022] DELETE /identity/v3/projects/81666ce8589a4e45ac7f5f9e6e6cc9a3 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:29:33.570565 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d882e7-1e1c-4fe9-addd-b226de3e6b9a service neutron] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:33.602404 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d882e7-1e1c-4fe9-addd-b226de3e6b9a service neutron] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:33.788938 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ec6b04-3685-4964-b750-fe516bf14c9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:33.792248 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ec6b04-3685-4964-b750-fe516bf14c9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:33.797973 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ec6b04-3685-4964-b750-fe516bf14c9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:33.798620 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ec6b04-3685-4964-b750-fe516bf14c9d admin admin] PATH_INFO: `/v3/users/d43f2608ef11430a8655d3ba5ffa6f8b` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:33.801561 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ec6b04-3685-4964-b750-fe516bf14c9d admin admin] RBAC: Authorizing `identity:delete_user(user_id=d43f2608ef11430a8655d3ba5ffa6f8b)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:33.803936 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ec6b04-3685-4964-b750-fe516bf14c9d admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:33.808693 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:29:33.914935 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-d8ec6b04-3685-4964-b750-fe516bf14c9d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd43f2608ef11430a8655d3ba5ffa6f8b'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:33.926141 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-d8ec6b04-3685-4964-b750-fe516bf14c9d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd43f2608ef11430a8655d3ba5ffa6f8b'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:33.937935 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-d8ec6b04-3685-4964-b750-fe516bf14c9d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd43f2608ef11430a8655d3ba5ffa6f8b'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:33.938873 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-d8ec6b04-3685-4964-b750-fe516bf14c9d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd43f2608ef11430a8655d3ba5ffa6f8b'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:33.961578 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-d8ec6b04-3685-4964-b750-fe516bf14c9d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd43f2608ef11430a8655d3ba5ffa6f8b'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:33.973579 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1358/2713] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 31 00:29:33 2022] DELETE /identity/v3/users/d43f2608ef11430a8655d3ba5ffa6f8b => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:29:34.066479 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22501a28-cb4b-4eea-8e80-cd5245348789 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:34.069889 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-22501a28-cb4b-4eea-8e80-cd5245348789 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:34.092995 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22501a28-cb4b-4eea-8e80-cd5245348789 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:34.179069 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23b5acb-e480-42aa-8c01-bd5512a09d9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:34.179740 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23b5acb-e480-42aa-8c01-bd5512a09d9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:34.180015 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23b5acb-e480-42aa-8c01-bd5512a09d9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:34.180309 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23b5acb-e480-42aa-8c01-bd5512a09d9c admin admin] PATH_INFO: `/v3/projects/be8a65a5ac6a4df4800be784447f6886` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:34.182038 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23b5acb-e480-42aa-8c01-bd5512a09d9c admin admin] RBAC: Authorizing `identity:delete_project(project_id=be8a65a5ac6a4df4800be784447f6886)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:34.184482 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23b5acb-e480-42aa-8c01-bd5512a09d9c admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:34.251121 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ec6b04-3685-4964-b750-fe516bf14c9d admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:34.253707 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-d8ec6b04-3685-4964-b750-fe516bf14c9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:34.256424 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:29:34.258262 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-f23b5acb-e480-42aa-8c01-bd5512a09d9c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be8a65a5ac6a4df4800be784447f6886', 'request_id': 'req-f23b5acb-e480-42aa-8c01-bd5512a09d9c'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:34.275015 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ec6b04-3685-4964-b750-fe516bf14c9d admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:34.286971 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-f23b5acb-e480-42aa-8c01-bd5512a09d9c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be8a65a5ac6a4df4800be784447f6886', 'request_id': 'req-f23b5acb-e480-42aa-8c01-bd5512a09d9c'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:34.300547 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-f23b5acb-e480-42aa-8c01-bd5512a09d9c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be8a65a5ac6a4df4800be784447f6886', 'request_id': 'req-f23b5acb-e480-42aa-8c01-bd5512a09d9c'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:34.322301 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-f23b5acb-e480-42aa-8c01-bd5512a09d9c admin admin] The token cache is being invalidate because project be8a65a5ac6a4df4800be784447f6886 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81523) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:29:34.325454 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-f23b5acb-e480-42aa-8c01-bd5512a09d9c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:34.325454 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-f23b5acb-e480-42aa-8c01-bd5512a09d9c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:34.327785 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1356/2714] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 31 00:29:34 2022] DELETE /identity/v3/projects/be8a65a5ac6a4df4800be784447f6886 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:29:34.332134 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23b5acb-e480-42aa-8c01-bd5512a09d9c admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:34.333639 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-f23b5acb-e480-42aa-8c01-bd5512a09d9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:34.363048 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c9f42d-b7ae-41af-9b56-6beea5195142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:34.363605 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c9f42d-b7ae-41af-9b56-6beea5195142 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:34.363946 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c9f42d-b7ae-41af-9b56-6beea5195142 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:34.364256 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c9f42d-b7ae-41af-9b56-6beea5195142 admin admin] PATH_INFO: `/v3/projects/4b9380f45f99496883e536272ce068b6` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:34.365680 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c9f42d-b7ae-41af-9b56-6beea5195142 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b9380f45f99496883e536272ce068b6)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:34.367701 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c9f42d-b7ae-41af-9b56-6beea5195142 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:34.411225 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23b5acb-e480-42aa-8c01-bd5512a09d9c admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:34.417724 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95d8df2-b3dc-425d-98c1-2f22631eb8e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:34.418404 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95d8df2-b3dc-425d-98c1-2f22631eb8e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:34.418689 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95d8df2-b3dc-425d-98c1-2f22631eb8e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:34.418963 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95d8df2-b3dc-425d-98c1-2f22631eb8e5 admin admin] PATH_INFO: `/v3/users/1a979de0c9ba40dea9e05b77e6c88ec3` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:34.420251 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95d8df2-b3dc-425d-98c1-2f22631eb8e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a979de0c9ba40dea9e05b77e6c88ec3)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:34.422474 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95d8df2-b3dc-425d-98c1-2f22631eb8e5 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:34.445539 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-d3c9f42d-b7ae-41af-9b56-6beea5195142 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b9380f45f99496883e536272ce068b6', 'request_id': 'req-d3c9f42d-b7ae-41af-9b56-6beea5195142'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:34.453530 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-d3c9f42d-b7ae-41af-9b56-6beea5195142 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b9380f45f99496883e536272ce068b6', 'request_id': 'req-d3c9f42d-b7ae-41af-9b56-6beea5195142'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:34.461756 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-d3c9f42d-b7ae-41af-9b56-6beea5195142 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b9380f45f99496883e536272ce068b6', 'request_id': 'req-d3c9f42d-b7ae-41af-9b56-6beea5195142'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:34.478495 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-d3c9f42d-b7ae-41af-9b56-6beea5195142 admin admin] The token cache is being invalidate because project 4b9380f45f99496883e536272ce068b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:29:34.478946 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-d3c9f42d-b7ae-41af-9b56-6beea5195142 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:34.479971 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-d3c9f42d-b7ae-41af-9b56-6beea5195142 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:34.481557 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1359/2715] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 31 00:29:34 2022] DELETE /identity/v3/projects/4b9380f45f99496883e536272ce068b6 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:29:34.485872 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-e95d8df2-b3dc-425d-98c1-2f22631eb8e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a979de0c9ba40dea9e05b77e6c88ec3'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:34.500420 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-e95d8df2-b3dc-425d-98c1-2f22631eb8e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a979de0c9ba40dea9e05b77e6c88ec3'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:34.514050 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-e95d8df2-b3dc-425d-98c1-2f22631eb8e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a979de0c9ba40dea9e05b77e6c88ec3'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:34.545908 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-e95d8df2-b3dc-425d-98c1-2f22631eb8e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a979de0c9ba40dea9e05b77e6c88ec3'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:34.547842 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-e95d8df2-b3dc-425d-98c1-2f22631eb8e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a979de0c9ba40dea9e05b77e6c88ec3'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:34.558702 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1357/2716] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 31 00:29:34 2022] DELETE /identity/v3/users/1a979de0c9ba40dea9e05b77e6c88ec3 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:29:35.049992 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c9f42d-b7ae-41af-9b56-6beea5195142 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:35.054225 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-d3c9f42d-b7ae-41af-9b56-6beea5195142 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:35.103408 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:29:35.191354 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c9f42d-b7ae-41af-9b56-6beea5195142 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:35.278877 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33917de-194d-46c3-9672-5d87dcf760c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:35.279562 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33917de-194d-46c3-9672-5d87dcf760c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:35.279841 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33917de-194d-46c3-9672-5d87dcf760c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:35.280117 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33917de-194d-46c3-9672-5d87dcf760c4 admin admin] PATH_INFO: `/v3/projects/6d4b0aeebdd6430ca5d33ca373b0a94d` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:35.281401 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33917de-194d-46c3-9672-5d87dcf760c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d4b0aeebdd6430ca5d33ca373b0a94d)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:35.283590 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33917de-194d-46c3-9672-5d87dcf760c4 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:35.367630 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-e33917de-194d-46c3-9672-5d87dcf760c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d4b0aeebdd6430ca5d33ca373b0a94d', 'request_id': 'req-e33917de-194d-46c3-9672-5d87dcf760c4'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:35.377464 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-e33917de-194d-46c3-9672-5d87dcf760c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d4b0aeebdd6430ca5d33ca373b0a94d', 'request_id': 'req-e33917de-194d-46c3-9672-5d87dcf760c4'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:35.387405 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-e33917de-194d-46c3-9672-5d87dcf760c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d4b0aeebdd6430ca5d33ca373b0a94d', 'request_id': 'req-e33917de-194d-46c3-9672-5d87dcf760c4'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:35.405498 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-e33917de-194d-46c3-9672-5d87dcf760c4 admin admin] The token cache is being invalidate because project 6d4b0aeebdd6430ca5d33ca373b0a94d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:29:35.405805 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-e33917de-194d-46c3-9672-5d87dcf760c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:35.406502 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-e33917de-194d-46c3-9672-5d87dcf760c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:35.408103 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1360/2717] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 31 00:29:35 2022] DELETE /identity/v3/projects/6d4b0aeebdd6430ca5d33ca373b0a94d => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:29:35.412653 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95d8df2-b3dc-425d-98c1-2f22631eb8e5 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:35.414760 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-e95d8df2-b3dc-425d-98c1-2f22631eb8e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:35.438772 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95d8df2-b3dc-425d-98c1-2f22631eb8e5 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:35.516520 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:29:35.527165 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d1fa02-7932-49af-a514-889b81ff6a3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:35.528565 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d1fa02-7932-49af-a514-889b81ff6a3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:35.529095 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d1fa02-7932-49af-a514-889b81ff6a3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:35.529339 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d1fa02-7932-49af-a514-889b81ff6a3e admin admin] PATH_INFO: `/v3/users/cc015c6ce1c442c3980c64c2e99b9cb1` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:35.531069 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d1fa02-7932-49af-a514-889b81ff6a3e admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc015c6ce1c442c3980c64c2e99b9cb1)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:35.533503 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d1fa02-7932-49af-a514-889b81ff6a3e admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:35.612342 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-70d1fa02-7932-49af-a514-889b81ff6a3e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc015c6ce1c442c3980c64c2e99b9cb1'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:35.623534 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-70d1fa02-7932-49af-a514-889b81ff6a3e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc015c6ce1c442c3980c64c2e99b9cb1'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:35.636372 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-70d1fa02-7932-49af-a514-889b81ff6a3e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc015c6ce1c442c3980c64c2e99b9cb1'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:35.655955 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-70d1fa02-7932-49af-a514-889b81ff6a3e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc015c6ce1c442c3980c64c2e99b9cb1'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:35.656761 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-70d1fa02-7932-49af-a514-889b81ff6a3e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc015c6ce1c442c3980c64c2e99b9cb1'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:35.663769 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1358/2718] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 31 00:29:35 2022] DELETE /identity/v3/users/cc015c6ce1c442c3980c64c2e99b9cb1 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:29:36.139840 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33917de-194d-46c3-9672-5d87dcf760c4 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:36.142716 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-e33917de-194d-46c3-9672-5d87dcf760c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:36.168748 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33917de-194d-46c3-9672-5d87dcf760c4 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:36.295226 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:29:36.325985 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e38616a-db42-4af0-a75c-e554e40ac686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:36.327265 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e38616a-db42-4af0-a75c-e554e40ac686 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:36.327775 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e38616a-db42-4af0-a75c-e554e40ac686 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:36.328364 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e38616a-db42-4af0-a75c-e554e40ac686 admin admin] PATH_INFO: `/v3/projects/6d32b099e27544be94816911b8e4f09b` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:36.330680 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e38616a-db42-4af0-a75c-e554e40ac686 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d32b099e27544be94816911b8e4f09b)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:36.334655 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e38616a-db42-4af0-a75c-e554e40ac686 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:36.453758 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-0e38616a-db42-4af0-a75c-e554e40ac686 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d32b099e27544be94816911b8e4f09b', 'request_id': 'req-0e38616a-db42-4af0-a75c-e554e40ac686'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:36.465656 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-0e38616a-db42-4af0-a75c-e554e40ac686 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d32b099e27544be94816911b8e4f09b', 'request_id': 'req-0e38616a-db42-4af0-a75c-e554e40ac686'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:36.477077 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-0e38616a-db42-4af0-a75c-e554e40ac686 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d32b099e27544be94816911b8e4f09b', 'request_id': 'req-0e38616a-db42-4af0-a75c-e554e40ac686'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:36.499581 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-0e38616a-db42-4af0-a75c-e554e40ac686 admin admin] The token cache is being invalidate because project 6d32b099e27544be94816911b8e4f09b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:29:36.500217 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-0e38616a-db42-4af0-a75c-e554e40ac686 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:36.501182 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-0e38616a-db42-4af0-a75c-e554e40ac686 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:36.503167 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1361/2719] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 31 00:29:36 2022] DELETE /identity/v3/projects/6d32b099e27544be94816911b8e4f09b => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:29:36.512007 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5647debf-9ece-4d5c-8f92-61789fb3afc5 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:36.512907 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5647debf-9ece-4d5c-8f92-61789fb3afc5 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:36.512907 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5647debf-9ece-4d5c-8f92-61789fb3afc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:36.547955 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-5647debf-9ece-4d5c-8f92-61789fb3afc5 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:29:36.550001 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-5647debf-9ece-4d5c-8f92-61789fb3afc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:36.643376 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1359/2720] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:29:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:29:36.653782 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad9c8bf-5059-451d-a332-3435a3b9e11d None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:36.654312 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad9c8bf-5059-451d-a332-3435a3b9e11d None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:36.654591 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad9c8bf-5059-451d-a332-3435a3b9e11d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:36.676829 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-3ad9c8bf-5059-451d-a332-3435a3b9e11d None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:29:36.678064 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-3ad9c8bf-5059-451d-a332-3435a3b9e11d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:36.686917 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1362/2721] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:29:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:29:36.692107 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5647debf-9ece-4d5c-8f92-61789fb3afc5 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:36.704759 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5647debf-9ece-4d5c-8f92-61789fb3afc5 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:36.715639 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d2feba-61c7-4ca1-84c7-a426b1595ff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:36.716962 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d2feba-61c7-4ca1-84c7-a426b1595ff9 admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:36.717463 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d2feba-61c7-4ca1-84c7-a426b1595ff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:36.717948 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d2feba-61c7-4ca1-84c7-a426b1595ff9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:36.719198 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d2feba-61c7-4ca1-84c7-a426b1595ff9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:29:36.719750 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d2feba-61c7-4ca1-84c7-a426b1595ff9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:36.723118 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d2feba-61c7-4ca1-84c7-a426b1595ff9 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:36.740218 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1360/2722] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 31 00:29:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:29:36.745524 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad9c8bf-5059-451d-a332-3435a3b9e11d None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:36.763636 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad9c8bf-5059-451d-a332-3435a3b9e11d None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:36.772029 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954a3c3b-3974-4f59-924d-ac7700f7ed06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:36.773387 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954a3c3b-3974-4f59-924d-ac7700f7ed06 admin admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:36.773899 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954a3c3b-3974-4f59-924d-ac7700f7ed06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:36.774404 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954a3c3b-3974-4f59-924d-ac7700f7ed06 admin admin] PATH_INFO: `/v3/projects` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:36.776770 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954a3c3b-3974-4f59-924d-ac7700f7ed06 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:36.779475 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954a3c3b-3974-4f59-924d-ac7700f7ed06 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:36.834766 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1363/2723] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 31 00:29:36 2022] POST /identity/v3/projects => generated 383 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:29:36.837943 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d2feba-61c7-4ca1-84c7-a426b1595ff9 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:36.857301 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d2feba-61c7-4ca1-84c7-a426b1595ff9 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:36.965232 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fb8ded-4b67-429e-b2ee-c1105ac13bd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:36.966266 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fb8ded-4b67-429e-b2ee-c1105ac13bd0 admin admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:36.966738 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fb8ded-4b67-429e-b2ee-c1105ac13bd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:36.967238 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fb8ded-4b67-429e-b2ee-c1105ac13bd0 admin admin] PATH_INFO: `/v3/users` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:36.968433 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fb8ded-4b67-429e-b2ee-c1105ac13bd0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:36.972111 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fb8ded-4b67-429e-b2ee-c1105ac13bd0 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:36.983948 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:29:37.003690 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1361/2724] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 31 00:29:36 2022] POST /identity/v3/users => generated 292 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:29:37.008862 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954a3c3b-3974-4f59-924d-ac7700f7ed06 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:37.028806 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954a3c3b-3974-4f59-924d-ac7700f7ed06 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:37.037059 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099ba7d9-10f9-4493-93f8-0467afb40758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:37.038114 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099ba7d9-10f9-4493-93f8-0467afb40758 admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:37.038600 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099ba7d9-10f9-4493-93f8-0467afb40758 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:37.039078 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099ba7d9-10f9-4493-93f8-0467afb40758 admin admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:37.040288 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099ba7d9-10f9-4493-93f8-0467afb40758 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:37.044272 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099ba7d9-10f9-4493-93f8-0467afb40758 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:37.065344 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1364/2725] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 00:29:37 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:29:37.070205 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fb8ded-4b67-429e-b2ee-c1105ac13bd0 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:37.082737 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fb8ded-4b67-429e-b2ee-c1105ac13bd0 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:37.088224 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8be5b0e-8a3f-4d6e-b543-5f394e7c9d64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:37.089427 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8be5b0e-8a3f-4d6e-b543-5f394e7c9d64 admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:37.089857 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8be5b0e-8a3f-4d6e-b543-5f394e7c9d64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:37.090222 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8be5b0e-8a3f-4d6e-b543-5f394e7c9d64 admin admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:37.091128 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8be5b0e-8a3f-4d6e-b543-5f394e7c9d64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:37.092944 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8be5b0e-8a3f-4d6e-b543-5f394e7c9d64 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:37.106432 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1362/2726] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 00:29:37 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:29:37.111245 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099ba7d9-10f9-4493-93f8-0467afb40758 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:37.122592 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099ba7d9-10f9-4493-93f8-0467afb40758 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:37.127764 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f5952a-1a83-4be0-b990-7003c0cf641a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:37.128501 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f5952a-1a83-4be0-b990-7003c0cf641a admin admin] REQUEST_METHOD: `PUT` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:37.128778 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f5952a-1a83-4be0-b990-7003c0cf641a admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:37.129049 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f5952a-1a83-4be0-b990-7003c0cf641a admin admin] PATH_INFO: `/v3/projects/987ee5eda7984de1a1c1085a8ec08ed9/users/fad7b8a95a854a48b1955cab788865dc/roles/fdad79ffbcbb4fa380dc9cf7dd108618` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:37.158049 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f5952a-1a83-4be0-b990-7003c0cf641a admin admin] RBAC: Authorizing `identity:create_grant(project_id=987ee5eda7984de1a1c1085a8ec08ed9, user_id=fad7b8a95a854a48b1955cab788865dc, role_id=fdad79ffbcbb4fa380dc9cf7dd108618)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:37.163490 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f5952a-1a83-4be0-b990-7003c0cf641a admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:37.182675 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1365/2727] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 00:29:37 2022] PUT /identity/v3/projects/987ee5eda7984de1a1c1085a8ec08ed9/users/fad7b8a95a854a48b1955cab788865dc/roles/fdad79ffbcbb4fa380dc9cf7dd108618 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:29:37.204931 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38879b8c-92e4-4695-a513-776112fbe365 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:37.205439 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38879b8c-92e4-4695-a513-776112fbe365 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:37.205932 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38879b8c-92e4-4695-a513-776112fbe365 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:37.241991 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-38879b8c-92e4-4695-a513-776112fbe365 None None] MFA Rules not processed for user `fad7b8a95a854a48b1955cab788865dc`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:29:37.243377 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-38879b8c-92e4-4695-a513-776112fbe365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:37.319843 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1363/2728] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:29:37 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:29:37.333483 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f5952a-1a83-4be0-b990-7003c0cf641a admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:37.335333 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-74f5952a-1a83-4be0-b990-7003c0cf641a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:37.403602 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f5952a-1a83-4be0-b990-7003c0cf641a admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:37.407508 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b907ab2b-8d2e-4c1d-a77e-061e6dccda8e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beecda6e9feb400288618745c784989f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:37.408214 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b907ab2b-8d2e-4c1d-a77e-061e6dccda8e service cinder] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:37.408452 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b907ab2b-8d2e-4c1d-a77e-061e6dccda8e service cinder] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:37.408730 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b907ab2b-8d2e-4c1d-a77e-061e6dccda8e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:37.418798 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b907ab2b-8d2e-4c1d-a77e-061e6dccda8e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:37.420674 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b907ab2b-8d2e-4c1d-a77e-061e6dccda8e service cinder] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:37.433511 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1366/2729] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:29:37 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 00:29:40.329470 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38879b8c-92e4-4695-a513-776112fbe365 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:40.477061 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38879b8c-92e4-4695-a513-776112fbe365 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:40.487990 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb246d4d-1fbf-4460-9905-97e24ded2ee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:40.489130 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb246d4d-1fbf-4460-9905-97e24ded2ee9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:40.489996 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb246d4d-1fbf-4460-9905-97e24ded2ee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:40.490512 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb246d4d-1fbf-4460-9905-97e24ded2ee9 admin admin] PATH_INFO: `/v3/users/fad7b8a95a854a48b1955cab788865dc` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:40.492742 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb246d4d-1fbf-4460-9905-97e24ded2ee9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fad7b8a95a854a48b1955cab788865dc)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:40.497546 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb246d4d-1fbf-4460-9905-97e24ded2ee9 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:40.591430 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-fb246d4d-1fbf-4460-9905-97e24ded2ee9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fad7b8a95a854a48b1955cab788865dc'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:40.600480 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-fb246d4d-1fbf-4460-9905-97e24ded2ee9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fad7b8a95a854a48b1955cab788865dc'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:40.612570 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-fb246d4d-1fbf-4460-9905-97e24ded2ee9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fad7b8a95a854a48b1955cab788865dc'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:40.628119 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:INSERT=3,keystone:SELECT=88,keystone:DELETE=9 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:29:40.637692 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-fb246d4d-1fbf-4460-9905-97e24ded2ee9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fad7b8a95a854a48b1955cab788865dc'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:40.638672 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-fb246d4d-1fbf-4460-9905-97e24ded2ee9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fad7b8a95a854a48b1955cab788865dc'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:40.648564 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1364/2730] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 31 00:29:40 2022] DELETE /identity/v3/users/fad7b8a95a854a48b1955cab788865dc => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:29:40.654877 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be8521f-703d-4ddf-a690-6d086bfd9425 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:40.655545 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be8521f-703d-4ddf-a690-6d086bfd9425 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:40.656194 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be8521f-703d-4ddf-a690-6d086bfd9425 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:40.688998 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-4be8521f-703d-4ddf-a690-6d086bfd9425 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:29:40.691074 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-4be8521f-703d-4ddf-a690-6d086bfd9425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:40.709348 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:29:40.820398 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1367/2731] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:29:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:29:40.840057 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb246d4d-1fbf-4460-9905-97e24ded2ee9 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:40.842561 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-fb246d4d-1fbf-4460-9905-97e24ded2ee9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:40.975439 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb246d4d-1fbf-4460-9905-97e24ded2ee9 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:40.984799 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6a1d5b-ced3-4858-838b-91253b981021 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'daae792cd11d4c4ca7aae0558998aced', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:40.986082 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6a1d5b-ced3-4858-838b-91253b981021 service neutron] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:40.986475 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6a1d5b-ced3-4858-838b-91253b981021 service neutron] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:40.986996 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6a1d5b-ced3-4858-838b-91253b981021 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:41.004347 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6a1d5b-ced3-4858-838b-91253b981021 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:41.006294 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6a1d5b-ced3-4858-838b-91253b981021 service neutron] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:41.020345 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1365/2732] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:29:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:29:41.594816 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be8521f-703d-4ddf-a690-6d086bfd9425 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:41.596612 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-4be8521f-703d-4ddf-a690-6d086bfd9425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:41.634050 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be8521f-703d-4ddf-a690-6d086bfd9425 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:41.641578 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16ad1ed-d294-4631-bc66-e183b7ae6a0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:41.642187 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16ad1ed-d294-4631-bc66-e183b7ae6a0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:41.642847 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16ad1ed-d294-4631-bc66-e183b7ae6a0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:41.643455 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16ad1ed-d294-4631-bc66-e183b7ae6a0e admin admin] PATH_INFO: `/v3/projects/987ee5eda7984de1a1c1085a8ec08ed9` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:41.644830 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16ad1ed-d294-4631-bc66-e183b7ae6a0e admin admin] RBAC: Authorizing `identity:delete_project(project_id=987ee5eda7984de1a1c1085a8ec08ed9)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:41.647800 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16ad1ed-d294-4631-bc66-e183b7ae6a0e admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:41.717511 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-d16ad1ed-d294-4631-bc66-e183b7ae6a0e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '987ee5eda7984de1a1c1085a8ec08ed9', 'request_id': 'req-d16ad1ed-d294-4631-bc66-e183b7ae6a0e'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:41.726848 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-d16ad1ed-d294-4631-bc66-e183b7ae6a0e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '987ee5eda7984de1a1c1085a8ec08ed9', 'request_id': 'req-d16ad1ed-d294-4631-bc66-e183b7ae6a0e'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:41.736972 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-d16ad1ed-d294-4631-bc66-e183b7ae6a0e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '987ee5eda7984de1a1c1085a8ec08ed9', 'request_id': 'req-d16ad1ed-d294-4631-bc66-e183b7ae6a0e'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:41.754514 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-d16ad1ed-d294-4631-bc66-e183b7ae6a0e admin admin] The token cache is being invalidate because project 987ee5eda7984de1a1c1085a8ec08ed9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:29:41.754877 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-d16ad1ed-d294-4631-bc66-e183b7ae6a0e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:41.755479 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-d16ad1ed-d294-4631-bc66-e183b7ae6a0e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:41.757074 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1368/2733] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 31 00:29:41 2022] DELETE /identity/v3/projects/987ee5eda7984de1a1c1085a8ec08ed9 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:29:50.309515 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6a1d5b-ced3-4858-838b-91253b981021 service neutron] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:50.311647 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-1d6a1d5b-ced3-4858-838b-91253b981021 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:50.330162 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6a1d5b-ced3-4858-838b-91253b981021 service neutron] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:50.414746 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cb4b7b-d00a-4e8e-9dd9-acadd75a1ac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:50.415474 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cb4b7b-d00a-4e8e-9dd9-acadd75a1ac6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:50.415893 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cb4b7b-d00a-4e8e-9dd9-acadd75a1ac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:50.416340 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cb4b7b-d00a-4e8e-9dd9-acadd75a1ac6 admin admin] PATH_INFO: `/v3/users/0246b239e1a14cab8ad2d5d69a43664e` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:50.418097 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cb4b7b-d00a-4e8e-9dd9-acadd75a1ac6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0246b239e1a14cab8ad2d5d69a43664e)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:50.420863 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cb4b7b-d00a-4e8e-9dd9-acadd75a1ac6 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:50.491275 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-c8cb4b7b-d00a-4e8e-9dd9-acadd75a1ac6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0246b239e1a14cab8ad2d5d69a43664e'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:50.502304 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-c8cb4b7b-d00a-4e8e-9dd9-acadd75a1ac6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0246b239e1a14cab8ad2d5d69a43664e'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:50.514714 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-c8cb4b7b-d00a-4e8e-9dd9-acadd75a1ac6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0246b239e1a14cab8ad2d5d69a43664e'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:50.531781 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-c8cb4b7b-d00a-4e8e-9dd9-acadd75a1ac6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0246b239e1a14cab8ad2d5d69a43664e'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:50.532689 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-c8cb4b7b-d00a-4e8e-9dd9-acadd75a1ac6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0246b239e1a14cab8ad2d5d69a43664e'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:50.542627 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1366/2734] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 31 00:29:50 2022] DELETE /identity/v3/users/0246b239e1a14cab8ad2d5d69a43664e => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:29:50.552684 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c999d9-48f6-4ada-a9dc-98074cbf6f5c None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:50.553595 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c999d9-48f6-4ada-a9dc-98074cbf6f5c None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:50.553595 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c999d9-48f6-4ada-a9dc-98074cbf6f5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:50.580561 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-e6c999d9-48f6-4ada-a9dc-98074cbf6f5c None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:29:50.581804 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-e6c999d9-48f6-4ada-a9dc-98074cbf6f5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:50.693122 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1369/2735] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:29:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:29:50.704918 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cb4b7b-d00a-4e8e-9dd9-acadd75a1ac6 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:50.707397 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-c8cb4b7b-d00a-4e8e-9dd9-acadd75a1ac6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:50.734905 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:29:50.799785 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cb4b7b-d00a-4e8e-9dd9-acadd75a1ac6 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:50.805107 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cfed41-2e5c-4b8c-a42a-4546f36de676 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'daae792cd11d4c4ca7aae0558998aced', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:50.806151 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cfed41-2e5c-4b8c-a42a-4546f36de676 service neutron] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:50.806607 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cfed41-2e5c-4b8c-a42a-4546f36de676 service neutron] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:50.807230 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cfed41-2e5c-4b8c-a42a-4546f36de676 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:50.825767 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cfed41-2e5c-4b8c-a42a-4546f36de676 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:50.828619 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cfed41-2e5c-4b8c-a42a-4546f36de676 service neutron] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:50.850866 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1367/2736] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:29:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:29:51.288622 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c999d9-48f6-4ada-a9dc-98074cbf6f5c None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:51.292762 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-e6c999d9-48f6-4ada-a9dc-98074cbf6f5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:51.328452 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c999d9-48f6-4ada-a9dc-98074cbf6f5c None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:51.340306 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1d9b81-6058-4312-9c44-fbd3c001918b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:51.341475 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1d9b81-6058-4312-9c44-fbd3c001918b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:51.341946 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1d9b81-6058-4312-9c44-fbd3c001918b admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:51.344509 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1d9b81-6058-4312-9c44-fbd3c001918b admin admin] PATH_INFO: `/v3/projects/acc3a85473504e87ad9a9f4898426d9d` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:51.346047 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1d9b81-6058-4312-9c44-fbd3c001918b admin admin] RBAC: Authorizing `identity:delete_project(project_id=acc3a85473504e87ad9a9f4898426d9d)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:51.348298 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1d9b81-6058-4312-9c44-fbd3c001918b admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:51.383261 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cfed41-2e5c-4b8c-a42a-4546f36de676 service neutron] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:51.386689 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-74cfed41-2e5c-4b8c-a42a-4546f36de676 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:51.402852 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cfed41-2e5c-4b8c-a42a-4546f36de676 service neutron] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:51.411231 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:29:51.435025 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-7d1d9b81-6058-4312-9c44-fbd3c001918b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'acc3a85473504e87ad9a9f4898426d9d', 'request_id': 'req-7d1d9b81-6058-4312-9c44-fbd3c001918b'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:51.449265 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-7d1d9b81-6058-4312-9c44-fbd3c001918b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'acc3a85473504e87ad9a9f4898426d9d', 'request_id': 'req-7d1d9b81-6058-4312-9c44-fbd3c001918b'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:51.459920 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-7d1d9b81-6058-4312-9c44-fbd3c001918b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'acc3a85473504e87ad9a9f4898426d9d', 'request_id': 'req-7d1d9b81-6058-4312-9c44-fbd3c001918b'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:51.484334 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-7d1d9b81-6058-4312-9c44-fbd3c001918b admin admin] The token cache is being invalidate because project acc3a85473504e87ad9a9f4898426d9d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:29:51.484800 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-7d1d9b81-6058-4312-9c44-fbd3c001918b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:51.485952 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-7d1d9b81-6058-4312-9c44-fbd3c001918b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:51.488504 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1370/2737] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 31 00:29:51 2022] DELETE /identity/v3/projects/acc3a85473504e87ad9a9f4898426d9d => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:29:51.490919 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718abc4b-ddd0-4b92-b60d-f5812148d26e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:51.491680 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718abc4b-ddd0-4b92-b60d-f5812148d26e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:51.492030 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718abc4b-ddd0-4b92-b60d-f5812148d26e admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:51.492406 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718abc4b-ddd0-4b92-b60d-f5812148d26e admin admin] PATH_INFO: `/v3/users/b0cf1e8e5e3844f6b463257cc814032d` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:51.493818 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718abc4b-ddd0-4b92-b60d-f5812148d26e admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0cf1e8e5e3844f6b463257cc814032d)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:51.496868 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c9a64b-9aa2-4a2a-96f6-97b74824c26c None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:51.497100 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718abc4b-ddd0-4b92-b60d-f5812148d26e admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:51.497366 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c9a64b-9aa2-4a2a-96f6-97b74824c26c None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:51.497850 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c9a64b-9aa2-4a2a-96f6-97b74824c26c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:51.535319 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-93c9a64b-9aa2-4a2a-96f6-97b74824c26c None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:29:51.537645 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-93c9a64b-9aa2-4a2a-96f6-97b74824c26c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:51.552293 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1371/2738] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:29:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:29:51.566376 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9873840-1f9c-4cfa-8cb4-a3413b624825 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:51.567161 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9873840-1f9c-4cfa-8cb4-a3413b624825 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:51.567366 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9873840-1f9c-4cfa-8cb4-a3413b624825 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:51.595646 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-c9873840-1f9c-4cfa-8cb4-a3413b624825 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:29:51.596980 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-c9873840-1f9c-4cfa-8cb4-a3413b624825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:51.606709 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1372/2739] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:29:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:29:51.611604 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9873840-1f9c-4cfa-8cb4-a3413b624825 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:51.623616 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9873840-1f9c-4cfa-8cb4-a3413b624825 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:51.631115 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb510edf-58c4-43df-9275-129d6cf3a1cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:51.632263 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb510edf-58c4-43df-9275-129d6cf3a1cb admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:51.632788 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb510edf-58c4-43df-9275-129d6cf3a1cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:51.633276 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb510edf-58c4-43df-9275-129d6cf3a1cb admin admin] PATH_INFO: `/v3/domains` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:51.634488 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb510edf-58c4-43df-9275-129d6cf3a1cb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:29:51.635097 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb510edf-58c4-43df-9275-129d6cf3a1cb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:51.638424 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb510edf-58c4-43df-9275-129d6cf3a1cb admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:51.661407 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1373/2740] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 31 00:29:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:29:51.667793 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb510edf-58c4-43df-9275-129d6cf3a1cb admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:51.679278 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb510edf-58c4-43df-9275-129d6cf3a1cb admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:51.687460 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80496913-33e3-455c-887d-375dcde8f7a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:51.688292 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80496913-33e3-455c-887d-375dcde8f7a8 admin admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:51.688717 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80496913-33e3-455c-887d-375dcde8f7a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:51.689134 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80496913-33e3-455c-887d-375dcde8f7a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:51.689884 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80496913-33e3-455c-887d-375dcde8f7a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:51.691873 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80496913-33e3-455c-887d-375dcde8f7a8 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:51.694943 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-718abc4b-ddd0-4b92-b60d-f5812148d26e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0cf1e8e5e3844f6b463257cc814032d'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:51.707223 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-718abc4b-ddd0-4b92-b60d-f5812148d26e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0cf1e8e5e3844f6b463257cc814032d'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:51.719466 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-718abc4b-ddd0-4b92-b60d-f5812148d26e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0cf1e8e5e3844f6b463257cc814032d'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:51.725448 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1374/2741] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 31 00:29:51 2022] POST /identity/v3/projects => generated 383 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:29:51.727985 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80496913-33e3-455c-887d-375dcde8f7a8 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:51.745521 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-718abc4b-ddd0-4b92-b60d-f5812148d26e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0cf1e8e5e3844f6b463257cc814032d'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:51.746496 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-718abc4b-ddd0-4b92-b60d-f5812148d26e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0cf1e8e5e3844f6b463257cc814032d'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:51.758041 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1368/2742] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 31 00:29:51 2022] DELETE /identity/v3/users/b0cf1e8e5e3844f6b463257cc814032d => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:29:51.764759 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9529a9c8-a938-46ca-8b83-47b4193444a0 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:51.765159 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9529a9c8-a938-46ca-8b83-47b4193444a0 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:51.765411 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9529a9c8-a938-46ca-8b83-47b4193444a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:51.790753 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-9529a9c8-a938-46ca-8b83-47b4193444a0 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:29:51.792663 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-9529a9c8-a938-46ca-8b83-47b4193444a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:51.831134 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:29:51.839682 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80496913-33e3-455c-887d-375dcde8f7a8 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:51.885216 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1369/2743] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:29:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:29:51.900049 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9529a9c8-a938-46ca-8b83-47b4193444a0 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:51.903002 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-9529a9c8-a938-46ca-8b83-47b4193444a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:51.922425 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a769eb57-0637-4bba-af6b-88d0a4cef68f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:51.923441 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a769eb57-0637-4bba-af6b-88d0a4cef68f admin admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:51.923923 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a769eb57-0637-4bba-af6b-88d0a4cef68f admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:51.924442 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a769eb57-0637-4bba-af6b-88d0a4cef68f admin admin] PATH_INFO: `/v3/users` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:51.925597 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a769eb57-0637-4bba-af6b-88d0a4cef68f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:51.929632 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a769eb57-0637-4bba-af6b-88d0a4cef68f admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:51.967212 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1375/2744] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 31 00:29:51 2022] POST /identity/v3/users => generated 292 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:29:51.972995 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a769eb57-0637-4bba-af6b-88d0a4cef68f admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:51.975726 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-a769eb57-0637-4bba-af6b-88d0a4cef68f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:51.980716 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9529a9c8-a938-46ca-8b83-47b4193444a0 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:51.985005 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f56f12-dfac-4888-8615-51fa050201e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'daae792cd11d4c4ca7aae0558998aced', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:51.985715 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f56f12-dfac-4888-8615-51fa050201e0 service neutron] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:51.986044 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f56f12-dfac-4888-8615-51fa050201e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:51.986368 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f56f12-dfac-4888-8615-51fa050201e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:52.003608 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f56f12-dfac-4888-8615-51fa050201e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:52.006172 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f56f12-dfac-4888-8615-51fa050201e0 service neutron] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:52.006375 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a769eb57-0637-4bba-af6b-88d0a4cef68f admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:52.014972 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfa1379-da9e-41c5-8745-569897329aec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:52.016192 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfa1379-da9e-41c5-8745-569897329aec admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:52.016801 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfa1379-da9e-41c5-8745-569897329aec admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:52.017365 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfa1379-da9e-41c5-8745-569897329aec admin admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:52.018731 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfa1379-da9e-41c5-8745-569897329aec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:52.021942 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfa1379-da9e-41c5-8745-569897329aec admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:52.025860 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1370/2745] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:29:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 00:29:52.034399 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:DELETE=5,keystone:SELECT=90,keystone:INSERT=5 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:29:52.050868 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1376/2746] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 00:29:51 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 00:29:52.063117 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f56f12-dfac-4888-8615-51fa050201e0 service neutron] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:52.082077 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f56f12-dfac-4888-8615-51fa050201e0 service neutron] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:52.090798 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac45f8f-47b0-4eac-b1af-b96af267374f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:52.092091 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac45f8f-47b0-4eac-b1af-b96af267374f admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:52.092791 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac45f8f-47b0-4eac-b1af-b96af267374f admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:52.093290 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac45f8f-47b0-4eac-b1af-b96af267374f admin admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:52.094632 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac45f8f-47b0-4eac-b1af-b96af267374f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:52.097855 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac45f8f-47b0-4eac-b1af-b96af267374f admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:52.124229 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1371/2747] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 00:29:52 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:29:52.128192 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfa1379-da9e-41c5-8745-569897329aec admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:52.144265 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfa1379-da9e-41c5-8745-569897329aec admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:52.149609 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761d4c57-b846-4e74-936b-ef6e52339452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:52.151014 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761d4c57-b846-4e74-936b-ef6e52339452 admin admin] REQUEST_METHOD: `PUT` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:52.151267 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761d4c57-b846-4e74-936b-ef6e52339452 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:52.151393 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761d4c57-b846-4e74-936b-ef6e52339452 admin admin] PATH_INFO: `/v3/projects/abc8f23291e04f92bfdd10cdfb4ffeb9/users/2ad47bc878d14c9ab919af429b758eb5/roles/fdad79ffbcbb4fa380dc9cf7dd108618` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:52.181621 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761d4c57-b846-4e74-936b-ef6e52339452 admin admin] RBAC: Authorizing `identity:create_grant(project_id=abc8f23291e04f92bfdd10cdfb4ffeb9, user_id=2ad47bc878d14c9ab919af429b758eb5, role_id=fdad79ffbcbb4fa380dc9cf7dd108618)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:52.187286 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761d4c57-b846-4e74-936b-ef6e52339452 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:52.208480 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1377/2748] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 00:29:52 2022] PUT /identity/v3/projects/abc8f23291e04f92bfdd10cdfb4ffeb9/users/2ad47bc878d14c9ab919af429b758eb5/roles/fdad79ffbcbb4fa380dc9cf7dd108618 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:29:52.320231 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0180755d-b403-412f-a4d0-3fe2ca3733e9 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:52.320617 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0180755d-b403-412f-a4d0-3fe2ca3733e9 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:52.320974 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0180755d-b403-412f-a4d0-3fe2ca3733e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:52.354555 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-0180755d-b403-412f-a4d0-3fe2ca3733e9 None None] MFA Rules not processed for user `2ad47bc878d14c9ab919af429b758eb5`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:29:52.355837 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-0180755d-b403-412f-a4d0-3fe2ca3733e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:52.415612 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761d4c57-b846-4e74-936b-ef6e52339452 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:52.418384 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-761d4c57-b846-4e74-936b-ef6e52339452 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:52.457997 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1372/2749] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:29:52 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:29:52.464726 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0180755d-b403-412f-a4d0-3fe2ca3733e9 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:52.534685 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761d4c57-b846-4e74-936b-ef6e52339452 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:52.542678 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3564106-e1a6-4fb8-b135-5b0a941541bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:52.543749 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3564106-e1a6-4fb8-b135-5b0a941541bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:52.544251 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3564106-e1a6-4fb8-b135-5b0a941541bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:52.544723 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3564106-e1a6-4fb8-b135-5b0a941541bf admin admin] PATH_INFO: `/v3/projects/be5e3fd7127e488db46cf000c47d7bda` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:52.546670 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3564106-e1a6-4fb8-b135-5b0a941541bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=be5e3fd7127e488db46cf000c47d7bda)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:52.549991 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=100 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:29:52.550354 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3564106-e1a6-4fb8-b135-5b0a941541bf admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:52.558018 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0180755d-b403-412f-a4d0-3fe2ca3733e9 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:52.563156 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded8d24a-7e5f-4ce9-a44e-bb2afcdc7706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:52.563903 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded8d24a-7e5f-4ce9-a44e-bb2afcdc7706 admin admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:52.564215 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded8d24a-7e5f-4ce9-a44e-bb2afcdc7706 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:52.564487 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded8d24a-7e5f-4ce9-a44e-bb2afcdc7706 admin admin] PATH_INFO: `/v3/projects` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:52.565164 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded8d24a-7e5f-4ce9-a44e-bb2afcdc7706 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:52.567305 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded8d24a-7e5f-4ce9-a44e-bb2afcdc7706 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:52.602968 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1373/2750] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 31 00:29:52 2022] POST /identity/v3/projects => generated 383 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:29:52.609308 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded8d24a-7e5f-4ce9-a44e-bb2afcdc7706 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:52.641844 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-e3564106-e1a6-4fb8-b135-5b0a941541bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be5e3fd7127e488db46cf000c47d7bda', 'request_id': 'req-e3564106-e1a6-4fb8-b135-5b0a941541bf'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:52.652018 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-e3564106-e1a6-4fb8-b135-5b0a941541bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be5e3fd7127e488db46cf000c47d7bda', 'request_id': 'req-e3564106-e1a6-4fb8-b135-5b0a941541bf'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:52.660478 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-e3564106-e1a6-4fb8-b135-5b0a941541bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be5e3fd7127e488db46cf000c47d7bda', 'request_id': 'req-e3564106-e1a6-4fb8-b135-5b0a941541bf'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:52.681247 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-e3564106-e1a6-4fb8-b135-5b0a941541bf admin admin] The token cache is being invalidate because project be5e3fd7127e488db46cf000c47d7bda was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:29:52.683018 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-e3564106-e1a6-4fb8-b135-5b0a941541bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:52.684421 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-e3564106-e1a6-4fb8-b135-5b0a941541bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:52.686441 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1378/2751] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 31 00:29:52 2022] DELETE /identity/v3/projects/be5e3fd7127e488db46cf000c47d7bda => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:29:52.691234 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3564106-e1a6-4fb8-b135-5b0a941541bf admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:52.693195 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-e3564106-e1a6-4fb8-b135-5b0a941541bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:52.706062 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded8d24a-7e5f-4ce9-a44e-bb2afcdc7706 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:52.777979 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fdeff8-20c3-4e25-b6e2-d365e98ccc43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:52.778677 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fdeff8-20c3-4e25-b6e2-d365e98ccc43 admin admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:52.778957 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fdeff8-20c3-4e25-b6e2-d365e98ccc43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:52.779240 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fdeff8-20c3-4e25-b6e2-d365e98ccc43 admin admin] PATH_INFO: `/v3/users` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:52.779903 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fdeff8-20c3-4e25-b6e2-d365e98ccc43 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:52.782178 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fdeff8-20c3-4e25-b6e2-d365e98ccc43 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:52.809449 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3564106-e1a6-4fb8-b135-5b0a941541bf admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:52.809768 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1374/2752] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 31 00:29:52 2022] POST /identity/v3/users => generated 292 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:29:52.814777 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fdeff8-20c3-4e25-b6e2-d365e98ccc43 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:52.816521 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3ffee4-f4b7-4eb3-b934-a5623edc7d86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:52.816882 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-d7fdeff8-20c3-4e25-b6e2-d365e98ccc43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:52.817445 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3ffee4-f4b7-4eb3-b934-a5623edc7d86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:52.817864 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3ffee4-f4b7-4eb3-b934-a5623edc7d86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:52.818278 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3ffee4-f4b7-4eb3-b934-a5623edc7d86 admin admin] PATH_INFO: `/v3/users/68db028557df451a8448f6132d37341b` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:52.819857 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3ffee4-f4b7-4eb3-b934-a5623edc7d86 admin admin] RBAC: Authorizing `identity:delete_user(user_id=68db028557df451a8448f6132d37341b)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:52.823020 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3ffee4-f4b7-4eb3-b934-a5623edc7d86 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:52.831882 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:29:52.833341 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fdeff8-20c3-4e25-b6e2-d365e98ccc43 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:52.841817 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d90bcd3-6f43-4d8e-9dbe-32080a3bdb36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:52.842735 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d90bcd3-6f43-4d8e-9dbe-32080a3bdb36 admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:52.843081 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d90bcd3-6f43-4d8e-9dbe-32080a3bdb36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:52.843728 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d90bcd3-6f43-4d8e-9dbe-32080a3bdb36 admin admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:52.845294 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d90bcd3-6f43-4d8e-9dbe-32080a3bdb36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:52.848524 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d90bcd3-6f43-4d8e-9dbe-32080a3bdb36 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:52.865321 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1375/2753] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 00:29:52 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 00:29:52.870243 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d90bcd3-6f43-4d8e-9dbe-32080a3bdb36 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:52.884061 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d90bcd3-6f43-4d8e-9dbe-32080a3bdb36 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:52.890512 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e640ae-0bae-4dae-823f-809ed37daa50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:52.891227 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e640ae-0bae-4dae-823f-809ed37daa50 admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:52.891513 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e640ae-0bae-4dae-823f-809ed37daa50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:52.891790 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e640ae-0bae-4dae-823f-809ed37daa50 admin admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:52.892560 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e640ae-0bae-4dae-823f-809ed37daa50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:52.894234 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e640ae-0bae-4dae-823f-809ed37daa50 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:52.901717 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-1a3ffee4-f4b7-4eb3-b934-a5623edc7d86 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68db028557df451a8448f6132d37341b'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:52.910016 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-1a3ffee4-f4b7-4eb3-b934-a5623edc7d86 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68db028557df451a8448f6132d37341b'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:52.914511 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1376/2754] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 00:29:52 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 00:29:52.924276 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e640ae-0bae-4dae-823f-809ed37daa50 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:52.925333 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-1a3ffee4-f4b7-4eb3-b934-a5623edc7d86 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68db028557df451a8448f6132d37341b'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:52.926147 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-1a3ffee4-f4b7-4eb3-b934-a5623edc7d86 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68db028557df451a8448f6132d37341b'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:52.941719 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-1a3ffee4-f4b7-4eb3-b934-a5623edc7d86 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68db028557df451a8448f6132d37341b'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:52.943334 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e640ae-0bae-4dae-823f-809ed37daa50 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:52.949451 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1379/2755] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 31 00:29:52 2022] DELETE /identity/v3/users/68db028557df451a8448f6132d37341b => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:29:52.951391 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5b8a74-a14b-4c4a-aa7d-26285cf0fddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:52.952539 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5b8a74-a14b-4c4a-aa7d-26285cf0fddc admin admin] REQUEST_METHOD: `PUT` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:52.953087 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5b8a74-a14b-4c4a-aa7d-26285cf0fddc admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:52.953566 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5b8a74-a14b-4c4a-aa7d-26285cf0fddc admin admin] PATH_INFO: `/v3/projects/e2eb747fd13f4749812dbe1bc62d1c51/users/5c1134a7a9d04a9f993ebc24c8de4f3d/roles/fdad79ffbcbb4fa380dc9cf7dd108618` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:52.975105 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5b8a74-a14b-4c4a-aa7d-26285cf0fddc admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2eb747fd13f4749812dbe1bc62d1c51, user_id=5c1134a7a9d04a9f993ebc24c8de4f3d, role_id=fdad79ffbcbb4fa380dc9cf7dd108618)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:52.979129 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5b8a74-a14b-4c4a-aa7d-26285cf0fddc admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:53.004809 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1377/2756] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 00:29:52 2022] PUT /identity/v3/projects/e2eb747fd13f4749812dbe1bc62d1c51/users/5c1134a7a9d04a9f993ebc24c8de4f3d/roles/fdad79ffbcbb4fa380dc9cf7dd108618 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:29:53.027156 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaf87fa-114d-4eb8-a91c-d624e7676ff7 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:53.027686 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaf87fa-114d-4eb8-a91c-d624e7676ff7 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:53.028102 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaf87fa-114d-4eb8-a91c-d624e7676ff7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:53.065294 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-efaf87fa-114d-4eb8-a91c-d624e7676ff7 None None] MFA Rules not processed for user `5c1134a7a9d04a9f993ebc24c8de4f3d`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:29:53.066575 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-efaf87fa-114d-4eb8-a91c-d624e7676ff7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:53.149308 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1380/2757] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:29:53 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:29:53.156281 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5b8a74-a14b-4c4a-aa7d-26285cf0fddc admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:53.159589 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-dc5b8a74-a14b-4c4a-aa7d-26285cf0fddc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:53.233531 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:29:53.283297 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5b8a74-a14b-4c4a-aa7d-26285cf0fddc admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:53.289153 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d0b619-8d8a-4f35-9312-1f6db4118872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:53.290066 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d0b619-8d8a-4f35-9312-1f6db4118872 admin admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:53.290417 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d0b619-8d8a-4f35-9312-1f6db4118872 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:53.291278 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d0b619-8d8a-4f35-9312-1f6db4118872 admin admin] PATH_INFO: `/v3/projects` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:53.292607 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d0b619-8d8a-4f35-9312-1f6db4118872 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:53.294955 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d0b619-8d8a-4f35-9312-1f6db4118872 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:53.338516 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1378/2758] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 31 00:29:53 2022] POST /identity/v3/projects => generated 385 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:29:53.340940 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaf87fa-114d-4eb8-a91c-d624e7676ff7 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:53.346047 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d0b619-8d8a-4f35-9312-1f6db4118872 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:53.348124 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-a9d0b619-8d8a-4f35-9312-1f6db4118872 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:53.359712 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaf87fa-114d-4eb8-a91c-d624e7676ff7 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:53.452496 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d0b619-8d8a-4f35-9312-1f6db4118872 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:53.457638 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f92f09-25a3-4f9e-8678-665d6cc750a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:53.458325 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f92f09-25a3-4f9e-8678-665d6cc750a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:53.459329 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f92f09-25a3-4f9e-8678-665d6cc750a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:53.459329 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f92f09-25a3-4f9e-8678-665d6cc750a0 admin admin] PATH_INFO: `/v3/projects/5f2f5e45a5bc4023941da77e3972f0ac` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:53.461008 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f92f09-25a3-4f9e-8678-665d6cc750a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f2f5e45a5bc4023941da77e3972f0ac)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:53.461614 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527210e6-f589-4258-8624-7fc95fd8360f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:53.462645 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527210e6-f589-4258-8624-7fc95fd8360f admin admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:53.463288 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527210e6-f589-4258-8624-7fc95fd8360f admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:53.463765 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527210e6-f589-4258-8624-7fc95fd8360f admin admin] PATH_INFO: `/v3/users` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:53.464915 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527210e6-f589-4258-8624-7fc95fd8360f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:53.465143 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f92f09-25a3-4f9e-8678-665d6cc750a0 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:53.468367 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527210e6-f589-4258-8624-7fc95fd8360f admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:53.506390 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1381/2759] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 31 00:29:53 2022] POST /identity/v3/users => generated 299 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:29:53.512296 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527210e6-f589-4258-8624-7fc95fd8360f admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:53.520417 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:29:53.528327 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527210e6-f589-4258-8624-7fc95fd8360f admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:53.552201 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-a0f92f09-25a3-4f9e-8678-665d6cc750a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f2f5e45a5bc4023941da77e3972f0ac', 'request_id': 'req-a0f92f09-25a3-4f9e-8678-665d6cc750a0'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:53.564804 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-a0f92f09-25a3-4f9e-8678-665d6cc750a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f2f5e45a5bc4023941da77e3972f0ac', 'request_id': 'req-a0f92f09-25a3-4f9e-8678-665d6cc750a0'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:53.574299 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-a0f92f09-25a3-4f9e-8678-665d6cc750a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f2f5e45a5bc4023941da77e3972f0ac', 'request_id': 'req-a0f92f09-25a3-4f9e-8678-665d6cc750a0'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:53.591770 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-a0f92f09-25a3-4f9e-8678-665d6cc750a0 admin admin] The token cache is being invalidate because project 5f2f5e45a5bc4023941da77e3972f0ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81523) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:29:53.592026 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-a0f92f09-25a3-4f9e-8678-665d6cc750a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:53.592743 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-a0f92f09-25a3-4f9e-8678-665d6cc750a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:53.594532 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1379/2760] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 31 00:29:53 2022] DELETE /identity/v3/projects/5f2f5e45a5bc4023941da77e3972f0ac => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:29:53.600963 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7eb932-3405-42cd-aff0-705c6cfa9eaa None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:53.601284 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7eb932-3405-42cd-aff0-705c6cfa9eaa None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:53.601534 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7eb932-3405-42cd-aff0-705c6cfa9eaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:53.620559 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d623b705-d37e-4349-b45a-3b165ce0d3f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:53.621208 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d623b705-d37e-4349-b45a-3b165ce0d3f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:53.621484 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d623b705-d37e-4349-b45a-3b165ce0d3f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:53.621765 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d623b705-d37e-4349-b45a-3b165ce0d3f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:53.622432 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d623b705-d37e-4349-b45a-3b165ce0d3f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:53.624377 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d623b705-d37e-4349-b45a-3b165ce0d3f5 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:53.630423 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-7c7eb932-3405-42cd-aff0-705c6cfa9eaa None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:29:53.632058 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-7c7eb932-3405-42cd-aff0-705c6cfa9eaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:53.641907 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1380/2761] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:29:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:29:53.644746 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1382/2762] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 00:29:53 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 00:29:53.651812 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7eb932-3405-42cd-aff0-705c6cfa9eaa None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:53.654014 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-7c7eb932-3405-42cd-aff0-705c6cfa9eaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:53.654396 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c8a67a-5608-441e-ab2f-7484b72b5516 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:53.654868 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c8a67a-5608-441e-ab2f-7484b72b5516 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:53.655273 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c8a67a-5608-441e-ab2f-7484b72b5516 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:53.671879 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7eb932-3405-42cd-aff0-705c6cfa9eaa None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:53.678457 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-b1c8a67a-5608-441e-ab2f-7484b72b5516 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:29:53.678742 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b422cecf-9b92-4034-ad6c-aa9b9aa829fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:53.679874 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-b1c8a67a-5608-441e-ab2f-7484b72b5516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:53.680050 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b422cecf-9b92-4034-ad6c-aa9b9aa829fb admin admin] REQUEST_METHOD: `PUT` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:53.680368 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b422cecf-9b92-4034-ad6c-aa9b9aa829fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:53.681017 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b422cecf-9b92-4034-ad6c-aa9b9aa829fb admin admin] PATH_INFO: `/v3/projects/ca64852f61e74f629b756c1cf19e9d34/users/01279075849e4b35bb0e1b8a02912471/roles/12f6817f9aaa4e2bb477095a6bed5d0f` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:53.689609 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1383/2763] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:29:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:29:53.694540 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c8a67a-5608-441e-ab2f-7484b72b5516 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:53.705211 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c8a67a-5608-441e-ab2f-7484b72b5516 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:53.710217 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a56fb2-ed91-433d-af35-6e48e2ce62f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:53.710880 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a56fb2-ed91-433d-af35-6e48e2ce62f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:53.711124 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b422cecf-9b92-4034-ad6c-aa9b9aa829fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca64852f61e74f629b756c1cf19e9d34, user_id=01279075849e4b35bb0e1b8a02912471, role_id=12f6817f9aaa4e2bb477095a6bed5d0f)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:53.711317 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a56fb2-ed91-433d-af35-6e48e2ce62f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:53.711486 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a56fb2-ed91-433d-af35-6e48e2ce62f5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:53.712109 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a56fb2-ed91-433d-af35-6e48e2ce62f5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:29:53.712452 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a56fb2-ed91-433d-af35-6e48e2ce62f5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:53.714329 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a56fb2-ed91-433d-af35-6e48e2ce62f5 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:53.717030 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b422cecf-9b92-4034-ad6c-aa9b9aa829fb admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:53.730745 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1384/2764] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 31 00:29:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:29:53.737346 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a56fb2-ed91-433d-af35-6e48e2ce62f5 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:53.740032 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1381/2765] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 00:29:53 2022] PUT /identity/v3/projects/ca64852f61e74f629b756c1cf19e9d34/users/01279075849e4b35bb0e1b8a02912471/roles/12f6817f9aaa4e2bb477095a6bed5d0f => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:29:53.746375 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b422cecf-9b92-4034-ad6c-aa9b9aa829fb admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:53.750508 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a56fb2-ed91-433d-af35-6e48e2ce62f5 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:53.781460 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:29:53.834993 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b961ab6f-d46b-42ea-9801-c3a45bf01400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:53.835644 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b961ab6f-d46b-42ea-9801-c3a45bf01400 admin admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:53.835926 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b961ab6f-d46b-42ea-9801-c3a45bf01400 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:53.836236 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b961ab6f-d46b-42ea-9801-c3a45bf01400 admin admin] PATH_INFO: `/v3/projects` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:53.836908 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b961ab6f-d46b-42ea-9801-c3a45bf01400 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:53.839252 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b961ab6f-d46b-42ea-9801-c3a45bf01400 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:53.864579 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b422cecf-9b92-4034-ad6c-aa9b9aa829fb admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:53.873508 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6362b420-9dfd-462f-8d1c-099dfa050b3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:53.874503 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6362b420-9dfd-462f-8d1c-099dfa050b3e admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:53.874955 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6362b420-9dfd-462f-8d1c-099dfa050b3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:53.875314 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6362b420-9dfd-462f-8d1c-099dfa050b3e admin admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:53.876106 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6362b420-9dfd-462f-8d1c-099dfa050b3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:53.877990 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6362b420-9dfd-462f-8d1c-099dfa050b3e admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:53.883396 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1385/2766] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 31 00:29:53 2022] POST /identity/v3/projects => generated 381 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:29:53.888349 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b961ab6f-d46b-42ea-9801-c3a45bf01400 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:53.892928 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1382/2767] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 00:29:53 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 00:29:53.898167 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6362b420-9dfd-462f-8d1c-099dfa050b3e admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:53.917002 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6362b420-9dfd-462f-8d1c-099dfa050b3e admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:53.974581 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b961ab6f-d46b-42ea-9801-c3a45bf01400 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:53.980579 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a6ab48-793a-4803-9bd4-92a1d4946d99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:53.981236 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a6ab48-793a-4803-9bd4-92a1d4946d99 admin admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:53.981516 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a6ab48-793a-4803-9bd4-92a1d4946d99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:53.981793 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a6ab48-793a-4803-9bd4-92a1d4946d99 admin admin] PATH_INFO: `/v3/users` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:53.982464 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a6ab48-793a-4803-9bd4-92a1d4946d99 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:53.984542 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a6ab48-793a-4803-9bd4-92a1d4946d99 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:54.006431 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:29:54.028775 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1386/2768] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 31 00:29:53 2022] POST /identity/v3/users => generated 291 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:29:54.033564 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767b890f-f9bb-420b-9c00-7454b5873422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:54.033875 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a6ab48-793a-4803-9bd4-92a1d4946d99 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:54.034705 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767b890f-f9bb-420b-9c00-7454b5873422 admin admin] REQUEST_METHOD: `PUT` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:54.035202 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767b890f-f9bb-420b-9c00-7454b5873422 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:54.035709 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767b890f-f9bb-420b-9c00-7454b5873422 admin admin] PATH_INFO: `/v3/projects/ca64852f61e74f629b756c1cf19e9d34/users/01279075849e4b35bb0e1b8a02912471/roles/12f6817f9aaa4e2bb477095a6bed5d0f` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:54.040050 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767b890f-f9bb-420b-9c00-7454b5873422 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca64852f61e74f629b756c1cf19e9d34, user_id=01279075849e4b35bb0e1b8a02912471, role_id=12f6817f9aaa4e2bb477095a6bed5d0f)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:54.045453 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a6ab48-793a-4803-9bd4-92a1d4946d99 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:54.047001 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767b890f-f9bb-420b-9c00-7454b5873422 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:54.050520 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ab680c-3344-4d2b-b4f4-ef42d2b3557a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:54.051283 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ab680c-3344-4d2b-b4f4-ef42d2b3557a admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:54.051728 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ab680c-3344-4d2b-b4f4-ef42d2b3557a admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:54.052012 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ab680c-3344-4d2b-b4f4-ef42d2b3557a admin admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:54.052849 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ab680c-3344-4d2b-b4f4-ef42d2b3557a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:54.054737 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ab680c-3344-4d2b-b4f4-ef42d2b3557a admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:54.068178 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1387/2769] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 00:29:54 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 00:29:54.068511 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1383/2770] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 00:29:53 2022] PUT /identity/v3/projects/ca64852f61e74f629b756c1cf19e9d34/users/01279075849e4b35bb0e1b8a02912471/roles/12f6817f9aaa4e2bb477095a6bed5d0f => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:29:54.073672 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ab680c-3344-4d2b-b4f4-ef42d2b3557a admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:54.083482 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6df4f4c-016e-4986-95c4-3d413e894607 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:54.084014 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6df4f4c-016e-4986-95c4-3d413e894607 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:54.084581 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6df4f4c-016e-4986-95c4-3d413e894607 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:54.087159 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ab680c-3344-4d2b-b4f4-ef42d2b3557a admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:54.131465 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-a6df4f4c-016e-4986-95c4-3d413e894607 None None] MFA Rules not processed for user `01279075849e4b35bb0e1b8a02912471`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:29:54.133172 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-a6df4f4c-016e-4986-95c4-3d413e894607 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:54.178566 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81edee1-65da-4f4e-9277-c46e12f4e34f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:54.179706 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81edee1-65da-4f4e-9277-c46e12f4e34f admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:54.180275 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81edee1-65da-4f4e-9277-c46e12f4e34f admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:54.180710 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81edee1-65da-4f4e-9277-c46e12f4e34f admin admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:54.181608 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81edee1-65da-4f4e-9277-c46e12f4e34f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:54.183706 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81edee1-65da-4f4e-9277-c46e12f4e34f admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:54.195710 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1388/2771] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 00:29:54 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:29:54.202376 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81edee1-65da-4f4e-9277-c46e12f4e34f admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:54.217128 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81edee1-65da-4f4e-9277-c46e12f4e34f admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:54.224711 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce30ca7-0ad3-482e-9a4d-5495903ee847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:54.225768 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce30ca7-0ad3-482e-9a4d-5495903ee847 admin admin] REQUEST_METHOD: `PUT` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:54.226149 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce30ca7-0ad3-482e-9a4d-5495903ee847 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:54.226635 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce30ca7-0ad3-482e-9a4d-5495903ee847 admin admin] PATH_INFO: `/v3/projects/bc0e45aca1b044689c28a159b2bfa5ca/users/51a7918802994733a657ce5d701156a8/roles/fdad79ffbcbb4fa380dc9cf7dd108618` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:54.240500 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1384/2772] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:29:54 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:29:54.254818 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6df4f4c-016e-4986-95c4-3d413e894607 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:54.255093 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce30ca7-0ad3-482e-9a4d-5495903ee847 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc0e45aca1b044689c28a159b2bfa5ca, user_id=51a7918802994733a657ce5d701156a8, role_id=fdad79ffbcbb4fa380dc9cf7dd108618)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:54.256290 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-a6df4f4c-016e-4986-95c4-3d413e894607 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:54.261679 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce30ca7-0ad3-482e-9a4d-5495903ee847 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:54.283313 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1389/2773] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 00:29:54 2022] PUT /identity/v3/projects/bc0e45aca1b044689c28a159b2bfa5ca/users/51a7918802994733a657ce5d701156a8/roles/fdad79ffbcbb4fa380dc9cf7dd108618 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:29:54.294835 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17a476b-c740-46c3-b3bc-fbe8c7059e62 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:54.295119 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17a476b-c740-46c3-b3bc-fbe8c7059e62 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:54.295383 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17a476b-c740-46c3-b3bc-fbe8c7059e62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:54.304591 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:29:54.333162 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-a17a476b-c740-46c3-b3bc-fbe8c7059e62 None None] MFA Rules not processed for user `51a7918802994733a657ce5d701156a8`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:29:54.334529 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-a17a476b-c740-46c3-b3bc-fbe8c7059e62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:54.343460 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6df4f4c-016e-4986-95c4-3d413e894607 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:54.413377 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da77b5c4-aafb-4aa4-bdc1-356ac32d9890 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beecda6e9feb400288618745c784989f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:54.414274 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da77b5c4-aafb-4aa4-bdc1-356ac32d9890 service cinder] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:54.414615 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da77b5c4-aafb-4aa4-bdc1-356ac32d9890 service cinder] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:54.414878 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da77b5c4-aafb-4aa4-bdc1-356ac32d9890 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:54.417629 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-da77b5c4-aafb-4aa4-bdc1-356ac32d9890 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:54.440325 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1390/2774] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:29:54 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:29:54.445220 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17a476b-c740-46c3-b3bc-fbe8c7059e62 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:54.508970 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da77b5c4-aafb-4aa4-bdc1-356ac32d9890 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:54.511912 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da77b5c4-aafb-4aa4-bdc1-356ac32d9890 service cinder] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:54.516018 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:29:54.530959 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1385/2775] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:29:54 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:29:54.541824 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17a476b-c740-46c3-b3bc-fbe8c7059e62 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:54.548000 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad33a6a0-c5e3-4bc7-aa5f-8ff88eff00b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:54.548812 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad33a6a0-c5e3-4bc7-aa5f-8ff88eff00b1 admin admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:54.549212 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad33a6a0-c5e3-4bc7-aa5f-8ff88eff00b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:54.549587 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad33a6a0-c5e3-4bc7-aa5f-8ff88eff00b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:54.550331 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad33a6a0-c5e3-4bc7-aa5f-8ff88eff00b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:54.552732 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad33a6a0-c5e3-4bc7-aa5f-8ff88eff00b1 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:54.592082 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1391/2776] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 31 00:29:54 2022] POST /identity/v3/projects => generated 379 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:29:54.598313 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da77b5c4-aafb-4aa4-bdc1-356ac32d9890 service cinder] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:54.612899 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da77b5c4-aafb-4aa4-bdc1-356ac32d9890 service cinder] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:54.713433 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c6caae-cfbb-47d5-8a73-812eafc4b88c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:54.715221 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c6caae-cfbb-47d5-8a73-812eafc4b88c admin admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:54.715605 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c6caae-cfbb-47d5-8a73-812eafc4b88c admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:54.716044 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c6caae-cfbb-47d5-8a73-812eafc4b88c admin admin] PATH_INFO: `/v3/users` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:54.716845 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c6caae-cfbb-47d5-8a73-812eafc4b88c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:54.719442 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c6caae-cfbb-47d5-8a73-812eafc4b88c admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:54.756631 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1386/2777] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 31 00:29:54 2022] POST /identity/v3/users => generated 296 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:29:54.758137 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad33a6a0-c5e3-4bc7-aa5f-8ff88eff00b1 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:54.771903 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad33a6a0-c5e3-4bc7-aa5f-8ff88eff00b1 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:54.777374 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb333c3-0bd5-4bcf-9523-9b03cb65977c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:54.778005 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb333c3-0bd5-4bcf-9523-9b03cb65977c admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:54.778289 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb333c3-0bd5-4bcf-9523-9b03cb65977c admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:54.778565 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb333c3-0bd5-4bcf-9523-9b03cb65977c admin admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:54.779220 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb333c3-0bd5-4bcf-9523-9b03cb65977c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:54.780914 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb333c3-0bd5-4bcf-9523-9b03cb65977c admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:54.796904 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1392/2778] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 00:29:54 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:29:54.805074 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c6caae-cfbb-47d5-8a73-812eafc4b88c admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:54.816988 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c6caae-cfbb-47d5-8a73-812eafc4b88c admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:54.822301 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0c7377-904d-466a-9184-12c49d6128b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:54.822985 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0c7377-904d-466a-9184-12c49d6128b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:54.823267 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0c7377-904d-466a-9184-12c49d6128b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:54.823595 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0c7377-904d-466a-9184-12c49d6128b1 admin admin] PATH_INFO: `/v3/projects/86bcbfdeab6043cbb03fc9ef2e3f28c2/users/b5adf09b5ced40c6b563c48a2d173358/roles/12f6817f9aaa4e2bb477095a6bed5d0f` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:54.843780 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0c7377-904d-466a-9184-12c49d6128b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=86bcbfdeab6043cbb03fc9ef2e3f28c2, user_id=b5adf09b5ced40c6b563c48a2d173358, role_id=12f6817f9aaa4e2bb477095a6bed5d0f)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:54.846843 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0c7377-904d-466a-9184-12c49d6128b1 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:54.863825 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1387/2779] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 00:29:54 2022] PUT /identity/v3/projects/86bcbfdeab6043cbb03fc9ef2e3f28c2/users/b5adf09b5ced40c6b563c48a2d173358/roles/12f6817f9aaa4e2bb477095a6bed5d0f => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:29:54.868548 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb333c3-0bd5-4bcf-9523-9b03cb65977c admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:54.880869 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb333c3-0bd5-4bcf-9523-9b03cb65977c admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:55.005894 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987e03f3-7b0d-444b-b562-19e6d31feca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:55.006551 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987e03f3-7b0d-444b-b562-19e6d31feca1 admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:55.006832 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987e03f3-7b0d-444b-b562-19e6d31feca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:55.007103 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987e03f3-7b0d-444b-b562-19e6d31feca1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:55.007768 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987e03f3-7b0d-444b-b562-19e6d31feca1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:55.009521 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987e03f3-7b0d-444b-b562-19e6d31feca1 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:55.030764 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1393/2780] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 00:29:54 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:29:55.032145 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0c7377-904d-466a-9184-12c49d6128b1 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:55.044602 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0c7377-904d-466a-9184-12c49d6128b1 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:55.050279 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ececf7f-8e29-4e6a-b313-24c04d61b2ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:55.051191 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ececf7f-8e29-4e6a-b313-24c04d61b2ee admin admin] REQUEST_METHOD: `PUT` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:55.051516 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ececf7f-8e29-4e6a-b313-24c04d61b2ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:55.051868 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ececf7f-8e29-4e6a-b313-24c04d61b2ee admin admin] PATH_INFO: `/v3/projects/86bcbfdeab6043cbb03fc9ef2e3f28c2/users/b5adf09b5ced40c6b563c48a2d173358/roles/12f6817f9aaa4e2bb477095a6bed5d0f` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:55.054399 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ececf7f-8e29-4e6a-b313-24c04d61b2ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=86bcbfdeab6043cbb03fc9ef2e3f28c2, user_id=b5adf09b5ced40c6b563c48a2d173358, role_id=12f6817f9aaa4e2bb477095a6bed5d0f)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:55.058347 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ececf7f-8e29-4e6a-b313-24c04d61b2ee admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:55.061566 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:29:55.080300 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1388/2781] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 00:29:55 2022] PUT /identity/v3/projects/86bcbfdeab6043cbb03fc9ef2e3f28c2/users/b5adf09b5ced40c6b563c48a2d173358/roles/12f6817f9aaa4e2bb477095a6bed5d0f => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:29:55.091186 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed98f205-1d1f-4c76-bb1d-d62a542eca0b None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:55.091754 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed98f205-1d1f-4c76-bb1d-d62a542eca0b None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:55.092302 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed98f205-1d1f-4c76-bb1d-d62a542eca0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:55.145822 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-ed98f205-1d1f-4c76-bb1d-d62a542eca0b None None] MFA Rules not processed for user `b5adf09b5ced40c6b563c48a2d173358`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:29:55.148170 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-ed98f205-1d1f-4c76-bb1d-d62a542eca0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:55.258644 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1394/2782] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:29:55 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:29:55.273954 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ececf7f-8e29-4e6a-b313-24c04d61b2ee admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:55.339530 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ececf7f-8e29-4e6a-b313-24c04d61b2ee admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:55.344583 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be74da49-353f-464b-9fac-acd9d7e4db56 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beecda6e9feb400288618745c784989f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:55.345225 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be74da49-353f-464b-9fac-acd9d7e4db56 service cinder] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:55.345508 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be74da49-353f-464b-9fac-acd9d7e4db56 service cinder] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:55.345779 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be74da49-353f-464b-9fac-acd9d7e4db56 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:55.356230 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be74da49-353f-464b-9fac-acd9d7e4db56 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:55.358467 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be74da49-353f-464b-9fac-acd9d7e4db56 service cinder] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:55.371552 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1389/2783] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:29:55 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:29:55.773049 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed98f205-1d1f-4c76-bb1d-d62a542eca0b None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:55.786283 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed98f205-1d1f-4c76-bb1d-d62a542eca0b None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:55.791953 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64369cf6-5811-49de-a325-283fd5961011 tempest-VolumeQuotaClassesTest-789484958 tempest-VolumeQuotaClassesTest-789484958-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5adf09b5ced40c6b563c48a2d173358', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86bcbfdeab6043cbb03fc9ef2e3f28c2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:55.792634 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64369cf6-5811-49de-a325-283fd5961011 tempest-VolumeQuotaClassesTest-789484958 tempest-VolumeQuotaClassesTest-789484958-project-admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:55.792925 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64369cf6-5811-49de-a325-283fd5961011 tempest-VolumeQuotaClassesTest-789484958 tempest-VolumeQuotaClassesTest-789484958-project-admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:55.793206 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64369cf6-5811-49de-a325-283fd5961011 tempest-VolumeQuotaClassesTest-789484958 tempest-VolumeQuotaClassesTest-789484958-project-admin] PATH_INFO: `/v3/domains` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:55.793927 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64369cf6-5811-49de-a325-283fd5961011 tempest-VolumeQuotaClassesTest-789484958 tempest-VolumeQuotaClassesTest-789484958-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:29:55.794235 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64369cf6-5811-49de-a325-283fd5961011 tempest-VolumeQuotaClassesTest-789484958 tempest-VolumeQuotaClassesTest-789484958-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:55.796193 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64369cf6-5811-49de-a325-283fd5961011 tempest-VolumeQuotaClassesTest-789484958 tempest-VolumeQuotaClassesTest-789484958-project-admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:55.823276 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1395/2784] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 31 00:29:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:29:55.828211 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be74da49-353f-464b-9fac-acd9d7e4db56 service cinder] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:55.840325 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be74da49-353f-464b-9fac-acd9d7e4db56 service cinder] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:55.846162 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0045b8-0ec0-42c1-9dac-f940d08d745b tempest-VolumeQuotaClassesTest-789484958 tempest-VolumeQuotaClassesTest-789484958-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5adf09b5ced40c6b563c48a2d173358', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86bcbfdeab6043cbb03fc9ef2e3f28c2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:55.846916 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0045b8-0ec0-42c1-9dac-f940d08d745b tempest-VolumeQuotaClassesTest-789484958 tempest-VolumeQuotaClassesTest-789484958-project-admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:55.847249 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0045b8-0ec0-42c1-9dac-f940d08d745b tempest-VolumeQuotaClassesTest-789484958 tempest-VolumeQuotaClassesTest-789484958-project-admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:55.847577 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0045b8-0ec0-42c1-9dac-f940d08d745b tempest-VolumeQuotaClassesTest-789484958 tempest-VolumeQuotaClassesTest-789484958-project-admin] PATH_INFO: `/v3/projects` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:55.848453 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0045b8-0ec0-42c1-9dac-f940d08d745b tempest-VolumeQuotaClassesTest-789484958 tempest-VolumeQuotaClassesTest-789484958-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:55.850634 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0045b8-0ec0-42c1-9dac-f940d08d745b tempest-VolumeQuotaClassesTest-789484958 tempest-VolumeQuotaClassesTest-789484958-project-admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:55.883918 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1390/2785] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 31 00:29:55 2022] POST /identity/v3/projects => generated 354 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:29:55.889152 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64369cf6-5811-49de-a325-283fd5961011 tempest-VolumeQuotaClassesTest-789484958 tempest-VolumeQuotaClassesTest-789484958-project-admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:55.901677 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64369cf6-5811-49de-a325-283fd5961011 tempest-VolumeQuotaClassesTest-789484958 tempest-VolumeQuotaClassesTest-789484958-project-admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:55.934350 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:29:55.975207 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567988c4-f1b0-4dc5-afd5-e2b42daacc8b tempest-VolumeQuotaClassesTest-789484958 tempest-VolumeQuotaClassesTest-789484958-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5adf09b5ced40c6b563c48a2d173358', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86bcbfdeab6043cbb03fc9ef2e3f28c2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:55.975912 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567988c4-f1b0-4dc5-afd5-e2b42daacc8b tempest-VolumeQuotaClassesTest-789484958 tempest-VolumeQuotaClassesTest-789484958-project-admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:55.976292 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567988c4-f1b0-4dc5-afd5-e2b42daacc8b tempest-VolumeQuotaClassesTest-789484958 tempest-VolumeQuotaClassesTest-789484958-project-admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:55.976633 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567988c4-f1b0-4dc5-afd5-e2b42daacc8b tempest-VolumeQuotaClassesTest-789484958 tempest-VolumeQuotaClassesTest-789484958-project-admin] PATH_INFO: `/v3/domains` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:55.978045 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567988c4-f1b0-4dc5-afd5-e2b42daacc8b tempest-VolumeQuotaClassesTest-789484958 tempest-VolumeQuotaClassesTest-789484958-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:29:55.979061 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567988c4-f1b0-4dc5-afd5-e2b42daacc8b tempest-VolumeQuotaClassesTest-789484958 tempest-VolumeQuotaClassesTest-789484958-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:55.986461 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567988c4-f1b0-4dc5-afd5-e2b42daacc8b tempest-VolumeQuotaClassesTest-789484958 tempest-VolumeQuotaClassesTest-789484958-project-admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:55.997917 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1396/2786] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 31 00:29:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:29:56.046076 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0045b8-0ec0-42c1-9dac-f940d08d745b tempest-VolumeQuotaClassesTest-789484958 tempest-VolumeQuotaClassesTest-789484958-project-admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:56.064788 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0045b8-0ec0-42c1-9dac-f940d08d745b tempest-VolumeQuotaClassesTest-789484958 tempest-VolumeQuotaClassesTest-789484958-project-admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:56.071813 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5eae9c-40c1-41f7-b6c4-770c3e8ba2c2 tempest-VolumeQuotaClassesTest-789484958 tempest-VolumeQuotaClassesTest-789484958-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5adf09b5ced40c6b563c48a2d173358', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86bcbfdeab6043cbb03fc9ef2e3f28c2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:56.073432 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5eae9c-40c1-41f7-b6c4-770c3e8ba2c2 tempest-VolumeQuotaClassesTest-789484958 tempest-VolumeQuotaClassesTest-789484958-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:56.073903 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5eae9c-40c1-41f7-b6c4-770c3e8ba2c2 tempest-VolumeQuotaClassesTest-789484958 tempest-VolumeQuotaClassesTest-789484958-project-admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:56.074355 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5eae9c-40c1-41f7-b6c4-770c3e8ba2c2 tempest-VolumeQuotaClassesTest-789484958 tempest-VolumeQuotaClassesTest-789484958-project-admin] PATH_INFO: `/v3/projects/e5ae6689b4724e6a97d5f0fe9620d5cb` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:56.076442 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5eae9c-40c1-41f7-b6c4-770c3e8ba2c2 tempest-VolumeQuotaClassesTest-789484958 tempest-VolumeQuotaClassesTest-789484958-project-admin] RBAC: Authorizing `identity:delete_project(project_id=e5ae6689b4724e6a97d5f0fe9620d5cb)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:56.080033 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5eae9c-40c1-41f7-b6c4-770c3e8ba2c2 tempest-VolumeQuotaClassesTest-789484958 tempest-VolumeQuotaClassesTest-789484958-project-admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:56.152118 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-3a5eae9c-40c1-41f7-b6c4-770c3e8ba2c2 tempest-VolumeQuotaClassesTest-789484958 tempest-VolumeQuotaClassesTest-789484958-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e5ae6689b4724e6a97d5f0fe9620d5cb', 'request_id': 'req-3a5eae9c-40c1-41f7-b6c4-770c3e8ba2c2'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:56.160240 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-3a5eae9c-40c1-41f7-b6c4-770c3e8ba2c2 tempest-VolumeQuotaClassesTest-789484958 tempest-VolumeQuotaClassesTest-789484958-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e5ae6689b4724e6a97d5f0fe9620d5cb', 'request_id': 'req-3a5eae9c-40c1-41f7-b6c4-770c3e8ba2c2'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:56.167691 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-3a5eae9c-40c1-41f7-b6c4-770c3e8ba2c2 tempest-VolumeQuotaClassesTest-789484958 tempest-VolumeQuotaClassesTest-789484958-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e5ae6689b4724e6a97d5f0fe9620d5cb', 'request_id': 'req-3a5eae9c-40c1-41f7-b6c4-770c3e8ba2c2'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:56.184643 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-3a5eae9c-40c1-41f7-b6c4-770c3e8ba2c2 tempest-VolumeQuotaClassesTest-789484958 tempest-VolumeQuotaClassesTest-789484958-project-admin] The token cache is being invalidate because project e5ae6689b4724e6a97d5f0fe9620d5cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81523) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:29:56.184995 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-3a5eae9c-40c1-41f7-b6c4-770c3e8ba2c2 tempest-VolumeQuotaClassesTest-789484958 tempest-VolumeQuotaClassesTest-789484958-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:56.185695 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-3a5eae9c-40c1-41f7-b6c4-770c3e8ba2c2 tempest-VolumeQuotaClassesTest-789484958 tempest-VolumeQuotaClassesTest-789484958-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:56.187383 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1391/2787] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 31 00:29:56 2022] DELETE /identity/v3/projects/e5ae6689b4724e6a97d5f0fe9620d5cb => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:29:56.332839 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567988c4-f1b0-4dc5-afd5-e2b42daacc8b tempest-VolumeQuotaClassesTest-789484958 tempest-VolumeQuotaClassesTest-789484958-project-admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:56.335173 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-567988c4-f1b0-4dc5-afd5-e2b42daacc8b tempest-VolumeQuotaClassesTest-789484958 tempest-VolumeQuotaClassesTest-789484958-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:56.414804 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567988c4-f1b0-4dc5-afd5-e2b42daacc8b tempest-VolumeQuotaClassesTest-789484958 tempest-VolumeQuotaClassesTest-789484958-project-admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:56.462141 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5eae9c-40c1-41f7-b6c4-770c3e8ba2c2 tempest-VolumeQuotaClassesTest-789484958 tempest-VolumeQuotaClassesTest-789484958-project-admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:56.463753 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-3a5eae9c-40c1-41f7-b6c4-770c3e8ba2c2 tempest-VolumeQuotaClassesTest-789484958 tempest-VolumeQuotaClassesTest-789484958-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:56.495752 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d32ffe-9065-4562-be58-953769bf7c05 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beecda6e9feb400288618745c784989f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:56.496514 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d32ffe-9065-4562-be58-953769bf7c05 service cinder] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:56.496968 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d32ffe-9065-4562-be58-953769bf7c05 service cinder] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:56.497441 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d32ffe-9065-4562-be58-953769bf7c05 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:56.499802 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-39d32ffe-9065-4562-be58-953769bf7c05 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:56.537923 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:INSERT=3,keystone:SELECT=90,keystone:DELETE=7 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:29:56.544302 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5eae9c-40c1-41f7-b6c4-770c3e8ba2c2 tempest-VolumeQuotaClassesTest-789484958 tempest-VolumeQuotaClassesTest-789484958-project-admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:56.552993 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d39224-5afd-446d-abac-fe28e37653b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:56.553950 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d39224-5afd-446d-abac-fe28e37653b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:56.554333 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d39224-5afd-446d-abac-fe28e37653b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:56.554609 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d39224-5afd-446d-abac-fe28e37653b9 admin admin] PATH_INFO: `/v3/users/51a7918802994733a657ce5d701156a8` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:56.556185 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d39224-5afd-446d-abac-fe28e37653b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=51a7918802994733a657ce5d701156a8)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:56.558820 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d39224-5afd-446d-abac-fe28e37653b9 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:56.582869 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d32ffe-9065-4562-be58-953769bf7c05 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:56.584389 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d32ffe-9065-4562-be58-953769bf7c05 service cinder] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:56.596278 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1397/2788] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:29:56 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:29:56.625151 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-18d39224-5afd-446d-abac-fe28e37653b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51a7918802994733a657ce5d701156a8'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:56.638521 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-18d39224-5afd-446d-abac-fe28e37653b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51a7918802994733a657ce5d701156a8'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:56.649103 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-18d39224-5afd-446d-abac-fe28e37653b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51a7918802994733a657ce5d701156a8'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:56.663925 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-18d39224-5afd-446d-abac-fe28e37653b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51a7918802994733a657ce5d701156a8'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:56.664912 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-18d39224-5afd-446d-abac-fe28e37653b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51a7918802994733a657ce5d701156a8'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:56.673907 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1392/2789] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 31 00:29:56 2022] DELETE /identity/v3/users/51a7918802994733a657ce5d701156a8 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:29:56.679436 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e85db6-1363-4c2e-b7b1-9052d2e3ac64 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:56.679807 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e85db6-1363-4c2e-b7b1-9052d2e3ac64 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:56.680182 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e85db6-1363-4c2e-b7b1-9052d2e3ac64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:56.710595 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-50e85db6-1363-4c2e-b7b1-9052d2e3ac64 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:29:56.713489 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-50e85db6-1363-4c2e-b7b1-9052d2e3ac64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:56.765027 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:29:56.821084 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1398/2790] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:29:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:29:56.837960 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d39224-5afd-446d-abac-fe28e37653b9 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:56.840058 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-18d39224-5afd-446d-abac-fe28e37653b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:56.934721 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d39224-5afd-446d-abac-fe28e37653b9 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:56.939870 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe04fe8d-b04c-4f59-a7f8-2c676f4d7fb6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'daae792cd11d4c4ca7aae0558998aced', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:56.940892 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe04fe8d-b04c-4f59-a7f8-2c676f4d7fb6 service neutron] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:56.941386 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe04fe8d-b04c-4f59-a7f8-2c676f4d7fb6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:56.941840 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe04fe8d-b04c-4f59-a7f8-2c676f4d7fb6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:56.955562 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe04fe8d-b04c-4f59-a7f8-2c676f4d7fb6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:56.957381 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe04fe8d-b04c-4f59-a7f8-2c676f4d7fb6 service neutron] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:56.971899 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1393/2791] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:29:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:29:57.404843 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e85db6-1363-4c2e-b7b1-9052d2e3ac64 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:57.407920 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-50e85db6-1363-4c2e-b7b1-9052d2e3ac64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:57.408931 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe04fe8d-b04c-4f59-a7f8-2c676f4d7fb6 service neutron] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:57.412129 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-fe04fe8d-b04c-4f59-a7f8-2c676f4d7fb6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:57.431023 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e85db6-1363-4c2e-b7b1-9052d2e3ac64 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:57.441013 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96c3767-f068-404f-b99a-180eda44ed09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:57.442297 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96c3767-f068-404f-b99a-180eda44ed09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:57.442901 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96c3767-f068-404f-b99a-180eda44ed09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:57.443263 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96c3767-f068-404f-b99a-180eda44ed09 admin admin] PATH_INFO: `/v3/projects/bc0e45aca1b044689c28a159b2bfa5ca` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:57.445084 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96c3767-f068-404f-b99a-180eda44ed09 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc0e45aca1b044689c28a159b2bfa5ca)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:57.449052 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96c3767-f068-404f-b99a-180eda44ed09 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:57.502318 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe04fe8d-b04c-4f59-a7f8-2c676f4d7fb6 service neutron] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:57.517809 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-d96c3767-f068-404f-b99a-180eda44ed09 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc0e45aca1b044689c28a159b2bfa5ca', 'request_id': 'req-d96c3767-f068-404f-b99a-180eda44ed09'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:57.525973 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-d96c3767-f068-404f-b99a-180eda44ed09 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc0e45aca1b044689c28a159b2bfa5ca', 'request_id': 'req-d96c3767-f068-404f-b99a-180eda44ed09'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:57.533845 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-d96c3767-f068-404f-b99a-180eda44ed09 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc0e45aca1b044689c28a159b2bfa5ca', 'request_id': 'req-d96c3767-f068-404f-b99a-180eda44ed09'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:57.546846 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:29:57.560313 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-d96c3767-f068-404f-b99a-180eda44ed09 admin admin] The token cache is being invalidate because project bc0e45aca1b044689c28a159b2bfa5ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:29:57.560841 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-d96c3767-f068-404f-b99a-180eda44ed09 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:57.562200 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-d96c3767-f068-404f-b99a-180eda44ed09 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:57.565121 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1399/2792] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 31 00:29:57 2022] DELETE /identity/v3/projects/bc0e45aca1b044689c28a159b2bfa5ca => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:29:57.569786 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96c3767-f068-404f-b99a-180eda44ed09 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:57.571724 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9260015-252b-4acb-86a7-6718b8d6ae83 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beecda6e9feb400288618745c784989f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:57.572955 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-d96c3767-f068-404f-b99a-180eda44ed09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:57.573283 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9260015-252b-4acb-86a7-6718b8d6ae83 service cinder] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:57.573552 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9260015-252b-4acb-86a7-6718b8d6ae83 service cinder] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:57.573841 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9260015-252b-4acb-86a7-6718b8d6ae83 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:57.575893 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-b9260015-252b-4acb-86a7-6718b8d6ae83 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:57.655218 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9260015-252b-4acb-86a7-6718b8d6ae83 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:57.658084 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9260015-252b-4acb-86a7-6718b8d6ae83 service cinder] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:57.676295 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1394/2793] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:29:57 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:29:57.681973 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96c3767-f068-404f-b99a-180eda44ed09 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:57.689625 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9683b3b6-0e86-485f-980c-7def7aa875d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:57.690459 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9683b3b6-0e86-485f-980c-7def7aa875d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:57.690780 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9683b3b6-0e86-485f-980c-7def7aa875d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:57.691081 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9683b3b6-0e86-485f-980c-7def7aa875d9 admin admin] PATH_INFO: `/v3/users/b5adf09b5ced40c6b563c48a2d173358` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:57.693131 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9683b3b6-0e86-485f-980c-7def7aa875d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5adf09b5ced40c6b563c48a2d173358)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:57.695579 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9683b3b6-0e86-485f-980c-7def7aa875d9 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:57.764425 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-9683b3b6-0e86-485f-980c-7def7aa875d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5adf09b5ced40c6b563c48a2d173358'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:57.774211 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-9683b3b6-0e86-485f-980c-7def7aa875d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5adf09b5ced40c6b563c48a2d173358'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:57.778181 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:29:57.786216 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-9683b3b6-0e86-485f-980c-7def7aa875d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5adf09b5ced40c6b563c48a2d173358'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:57.787225 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-9683b3b6-0e86-485f-980c-7def7aa875d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5adf09b5ced40c6b563c48a2d173358'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:57.809271 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-9683b3b6-0e86-485f-980c-7def7aa875d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5adf09b5ced40c6b563c48a2d173358'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:57.822587 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1400/2794] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 31 00:29:57 2022] DELETE /identity/v3/users/b5adf09b5ced40c6b563c48a2d173358 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:29:58.214578 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9260015-252b-4acb-86a7-6718b8d6ae83 service cinder] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:58.232523 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9260015-252b-4acb-86a7-6718b8d6ae83 service cinder] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:58.316810 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494bcf0e-dd6b-4f66-b0d3-d790051bd3a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:58.317517 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494bcf0e-dd6b-4f66-b0d3-d790051bd3a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:58.317833 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494bcf0e-dd6b-4f66-b0d3-d790051bd3a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:58.318147 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494bcf0e-dd6b-4f66-b0d3-d790051bd3a3 admin admin] PATH_INFO: `/v3/projects/86bcbfdeab6043cbb03fc9ef2e3f28c2` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:58.319491 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494bcf0e-dd6b-4f66-b0d3-d790051bd3a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=86bcbfdeab6043cbb03fc9ef2e3f28c2)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:58.322668 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494bcf0e-dd6b-4f66-b0d3-d790051bd3a3 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:58.391031 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-494bcf0e-dd6b-4f66-b0d3-d790051bd3a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86bcbfdeab6043cbb03fc9ef2e3f28c2', 'request_id': 'req-494bcf0e-dd6b-4f66-b0d3-d790051bd3a3'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:58.398683 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-494bcf0e-dd6b-4f66-b0d3-d790051bd3a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86bcbfdeab6043cbb03fc9ef2e3f28c2', 'request_id': 'req-494bcf0e-dd6b-4f66-b0d3-d790051bd3a3'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:58.408467 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-494bcf0e-dd6b-4f66-b0d3-d790051bd3a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86bcbfdeab6043cbb03fc9ef2e3f28c2', 'request_id': 'req-494bcf0e-dd6b-4f66-b0d3-d790051bd3a3'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:58.425983 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-494bcf0e-dd6b-4f66-b0d3-d790051bd3a3 admin admin] The token cache is being invalidate because project 86bcbfdeab6043cbb03fc9ef2e3f28c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81523) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:29:58.426388 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-494bcf0e-dd6b-4f66-b0d3-d790051bd3a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:58.427107 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-494bcf0e-dd6b-4f66-b0d3-d790051bd3a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:29:58.429365 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1395/2795] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 31 00:29:58 2022] DELETE /identity/v3/projects/86bcbfdeab6043cbb03fc9ef2e3f28c2 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:29:58.435415 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbf4f44-3d49-4e99-93e6-ddc69f4d149d None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:58.435729 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbf4f44-3d49-4e99-93e6-ddc69f4d149d None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:58.435959 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbf4f44-3d49-4e99-93e6-ddc69f4d149d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:58.458576 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-9fbf4f44-3d49-4e99-93e6-ddc69f4d149d None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:29:58.459750 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-9fbf4f44-3d49-4e99-93e6-ddc69f4d149d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:58.545470 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1401/2796] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:29:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:29:58.553817 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34694991-6a36-4a54-af62-f87322086a85 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:58.554132 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34694991-6a36-4a54-af62-f87322086a85 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:58.554404 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34694991-6a36-4a54-af62-f87322086a85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:58.578254 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-34694991-6a36-4a54-af62-f87322086a85 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:29:58.579510 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-34694991-6a36-4a54-af62-f87322086a85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:58.588828 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1396/2797] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:29:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:29:58.593574 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbf4f44-3d49-4e99-93e6-ddc69f4d149d None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:58.605666 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbf4f44-3d49-4e99-93e6-ddc69f4d149d None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:58.611112 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad263744-2a5d-4933-ac3d-1fcb09e389b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:58.611807 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad263744-2a5d-4933-ac3d-1fcb09e389b4 admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:58.612136 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad263744-2a5d-4933-ac3d-1fcb09e389b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:58.612501 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad263744-2a5d-4933-ac3d-1fcb09e389b4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:58.613235 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad263744-2a5d-4933-ac3d-1fcb09e389b4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:29:58.613690 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad263744-2a5d-4933-ac3d-1fcb09e389b4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:58.615531 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad263744-2a5d-4933-ac3d-1fcb09e389b4 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:58.631903 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1402/2798] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 31 00:29:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:29:58.639489 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34694991-6a36-4a54-af62-f87322086a85 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:58.658110 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34694991-6a36-4a54-af62-f87322086a85 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:58.666034 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5467420-fb94-417e-93a6-c8f1a1c94c21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:58.667145 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5467420-fb94-417e-93a6-c8f1a1c94c21 admin admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:58.667613 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5467420-fb94-417e-93a6-c8f1a1c94c21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:58.668058 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5467420-fb94-417e-93a6-c8f1a1c94c21 admin admin] PATH_INFO: `/v3/projects` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:58.669196 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5467420-fb94-417e-93a6-c8f1a1c94c21 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:58.672376 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5467420-fb94-417e-93a6-c8f1a1c94c21 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:58.683469 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:29:58.711712 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1397/2799] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 31 00:29:58 2022] POST /identity/v3/projects => generated 401 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:29:58.716874 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad263744-2a5d-4933-ac3d-1fcb09e389b4 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:58.729307 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad263744-2a5d-4933-ac3d-1fcb09e389b4 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:58.808952 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9fbea2-dfd9-4e2a-9377-7e65b38a13ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:58.809704 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9fbea2-dfd9-4e2a-9377-7e65b38a13ae admin admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:58.810168 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9fbea2-dfd9-4e2a-9377-7e65b38a13ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:58.810546 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9fbea2-dfd9-4e2a-9377-7e65b38a13ae admin admin] PATH_INFO: `/v3/users` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:58.811299 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9fbea2-dfd9-4e2a-9377-7e65b38a13ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:58.813472 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9fbea2-dfd9-4e2a-9377-7e65b38a13ae admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:58.844032 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1403/2800] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 31 00:29:58 2022] POST /identity/v3/users => generated 301 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:29:58.848623 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5467420-fb94-417e-93a6-c8f1a1c94c21 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:58.867968 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5467420-fb94-417e-93a6-c8f1a1c94c21 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:58.876554 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8496946-960c-43f7-ae8f-da078040ab25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:58.877603 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8496946-960c-43f7-ae8f-da078040ab25 admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:58.878143 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8496946-960c-43f7-ae8f-da078040ab25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:58.878714 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8496946-960c-43f7-ae8f-da078040ab25 admin admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:58.880051 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8496946-960c-43f7-ae8f-da078040ab25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:58.883060 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8496946-960c-43f7-ae8f-da078040ab25 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:58.902811 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1398/2801] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 00:29:58 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:29:58.907364 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9fbea2-dfd9-4e2a-9377-7e65b38a13ae admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:58.920852 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9fbea2-dfd9-4e2a-9377-7e65b38a13ae admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:58.927538 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14be3e63-0eea-4e83-83cb-bb4d7e35993d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:58.928798 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14be3e63-0eea-4e83-83cb-bb4d7e35993d admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:58.929343 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14be3e63-0eea-4e83-83cb-bb4d7e35993d admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:58.929800 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14be3e63-0eea-4e83-83cb-bb4d7e35993d admin admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:58.930934 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14be3e63-0eea-4e83-83cb-bb4d7e35993d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:58.934578 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14be3e63-0eea-4e83-83cb-bb4d7e35993d admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:58.954615 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1404/2802] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 00:29:58 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:29:58.956071 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8496946-960c-43f7-ae8f-da078040ab25 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:58.969301 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8496946-960c-43f7-ae8f-da078040ab25 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:58.977453 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48232816-643b-4e9c-a688-dd0c8ea5247d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:58.980610 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48232816-643b-4e9c-a688-dd0c8ea5247d admin admin] REQUEST_METHOD: `PUT` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:58.980610 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48232816-643b-4e9c-a688-dd0c8ea5247d admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:58.980610 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48232816-643b-4e9c-a688-dd0c8ea5247d admin admin] PATH_INFO: `/v3/projects/d23840ac65344329b891987a7068bd53/users/8eb2841c178d489da546678fd134f301/roles/fdad79ffbcbb4fa380dc9cf7dd108618` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:59.006208 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48232816-643b-4e9c-a688-dd0c8ea5247d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d23840ac65344329b891987a7068bd53, user_id=8eb2841c178d489da546678fd134f301, role_id=fdad79ffbcbb4fa380dc9cf7dd108618)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:59.010665 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48232816-643b-4e9c-a688-dd0c8ea5247d admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:59.030943 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1399/2803] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 00:29:58 2022] PUT /identity/v3/projects/d23840ac65344329b891987a7068bd53/users/8eb2841c178d489da546678fd134f301/roles/fdad79ffbcbb4fa380dc9cf7dd108618 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:29:59.045527 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7afc0f-0d78-42c0-9ece-d8215a62c190 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:59.045963 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7afc0f-0d78-42c0-9ece-d8215a62c190 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:59.046361 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7afc0f-0d78-42c0-9ece-d8215a62c190 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:59.082472 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-7d7afc0f-0d78-42c0-9ece-d8215a62c190 None None] MFA Rules not processed for user `8eb2841c178d489da546678fd134f301`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:29:59.083768 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-7d7afc0f-0d78-42c0-9ece-d8215a62c190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:59.125129 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:29:59.175504 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1405/2804] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:29:59 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:29:59.182241 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48232816-643b-4e9c-a688-dd0c8ea5247d admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:59.321785 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48232816-643b-4e9c-a688-dd0c8ea5247d admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:59.327534 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72d5f01-4af5-4dfe-bc01-1e64cd48771a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:59.328361 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72d5f01-4af5-4dfe-bc01-1e64cd48771a admin admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:59.328683 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72d5f01-4af5-4dfe-bc01-1e64cd48771a admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:59.328995 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72d5f01-4af5-4dfe-bc01-1e64cd48771a admin admin] PATH_INFO: `/v3/projects` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:59.329819 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72d5f01-4af5-4dfe-bc01-1e64cd48771a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:59.332040 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72d5f01-4af5-4dfe-bc01-1e64cd48771a admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:59.364541 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1400/2805] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 31 00:29:59 2022] POST /identity/v3/projects => generated 401 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:29:59.370675 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7afc0f-0d78-42c0-9ece-d8215a62c190 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:59.382264 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7afc0f-0d78-42c0-9ece-d8215a62c190 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:59.451194 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dfa90b-110a-4822-9c95-ce183c113fe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:59.452000 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dfa90b-110a-4822-9c95-ce183c113fe4 admin admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:59.452429 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dfa90b-110a-4822-9c95-ce183c113fe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:59.452803 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dfa90b-110a-4822-9c95-ce183c113fe4 admin admin] PATH_INFO: `/v3/users` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:59.453566 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dfa90b-110a-4822-9c95-ce183c113fe4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:59.455664 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dfa90b-110a-4822-9c95-ce183c113fe4 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:59.479079 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1406/2806] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 31 00:29:59 2022] POST /identity/v3/users => generated 307 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:29:59.483450 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72d5f01-4af5-4dfe-bc01-1e64cd48771a admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:59.495373 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72d5f01-4af5-4dfe-bc01-1e64cd48771a admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:59.500365 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad39b83c-fcb7-4d62-8760-b0f8e0452d4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:59.500998 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad39b83c-fcb7-4d62-8760-b0f8e0452d4d admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:59.501279 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad39b83c-fcb7-4d62-8760-b0f8e0452d4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:59.501549 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad39b83c-fcb7-4d62-8760-b0f8e0452d4d admin admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:59.502201 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad39b83c-fcb7-4d62-8760-b0f8e0452d4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:59.503832 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad39b83c-fcb7-4d62-8760-b0f8e0452d4d admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:59.516882 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1401/2807] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 00:29:59 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:29:59.521738 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dfa90b-110a-4822-9c95-ce183c113fe4 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:59.534393 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dfa90b-110a-4822-9c95-ce183c113fe4 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:59.539574 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce41ed3-d160-48b3-8fce-84ca1883c1c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:59.540485 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce41ed3-d160-48b3-8fce-84ca1883c1c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:59.540787 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce41ed3-d160-48b3-8fce-84ca1883c1c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:59.541072 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce41ed3-d160-48b3-8fce-84ca1883c1c4 admin admin] PATH_INFO: `/v3/projects/5e6ca7649e864f9388aeb6f92e2481ee/users/9971c51b47234b469009e5946c3b540e/roles/12f6817f9aaa4e2bb477095a6bed5d0f` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:59.559474 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce41ed3-d160-48b3-8fce-84ca1883c1c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e6ca7649e864f9388aeb6f92e2481ee, user_id=9971c51b47234b469009e5946c3b540e, role_id=12f6817f9aaa4e2bb477095a6bed5d0f)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:59.562231 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce41ed3-d160-48b3-8fce-84ca1883c1c4 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:59.579293 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1407/2808] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 00:29:59 2022] PUT /identity/v3/projects/5e6ca7649e864f9388aeb6f92e2481ee/users/9971c51b47234b469009e5946c3b540e/roles/12f6817f9aaa4e2bb477095a6bed5d0f => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:29:59.583680 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad39b83c-fcb7-4d62-8760-b0f8e0452d4d admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:59.595578 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad39b83c-fcb7-4d62-8760-b0f8e0452d4d admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:59.662840 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4035428b-7be6-452c-bcb6-ded916ade438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:59.663480 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4035428b-7be6-452c-bcb6-ded916ade438 admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:59.663759 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4035428b-7be6-452c-bcb6-ded916ade438 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:59.664030 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4035428b-7be6-452c-bcb6-ded916ade438 admin admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:59.664713 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4035428b-7be6-452c-bcb6-ded916ade438 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:59.667124 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4035428b-7be6-452c-bcb6-ded916ade438 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:59.678002 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1402/2809] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 00:29:59 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:29:59.683912 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce41ed3-d160-48b3-8fce-84ca1883c1c4 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:59.695095 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce41ed3-d160-48b3-8fce-84ca1883c1c4 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:59.701327 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea66571-3fe6-4379-8e9e-31fbb51161d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:59.702120 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea66571-3fe6-4379-8e9e-31fbb51161d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:59.702494 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea66571-3fe6-4379-8e9e-31fbb51161d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:59.702744 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea66571-3fe6-4379-8e9e-31fbb51161d7 admin admin] PATH_INFO: `/v3/projects/5e6ca7649e864f9388aeb6f92e2481ee/users/9971c51b47234b469009e5946c3b540e/roles/12f6817f9aaa4e2bb477095a6bed5d0f` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:59.704821 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea66571-3fe6-4379-8e9e-31fbb51161d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e6ca7649e864f9388aeb6f92e2481ee, user_id=9971c51b47234b469009e5946c3b540e, role_id=12f6817f9aaa4e2bb477095a6bed5d0f)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:59.707515 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea66571-3fe6-4379-8e9e-31fbb51161d7 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:59.720719 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1408/2810] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 00:29:59 2022] PUT /identity/v3/projects/5e6ca7649e864f9388aeb6f92e2481ee/users/9971c51b47234b469009e5946c3b540e/roles/12f6817f9aaa4e2bb477095a6bed5d0f => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:29:59.732108 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99560dbc-63ca-488b-b522-02047c0631e5 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:59.732412 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99560dbc-63ca-488b-b522-02047c0631e5 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:59.732752 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99560dbc-63ca-488b-b522-02047c0631e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:59.766269 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-99560dbc-63ca-488b-b522-02047c0631e5 None None] MFA Rules not processed for user `9971c51b47234b469009e5946c3b540e`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:29:59.767536 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-99560dbc-63ca-488b-b522-02047c0631e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:59.779485 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:29:59.849013 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1403/2811] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:29:59 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:29:59.862796 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea66571-3fe6-4379-8e9e-31fbb51161d7 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:59.866501 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-eea66571-3fe6-4379-8e9e-31fbb51161d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:59.940990 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea66571-3fe6-4379-8e9e-31fbb51161d7 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:59.944762 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e1625b-8586-4bf8-b6e8-672a57c32f84 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beecda6e9feb400288618745c784989f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:59.945399 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e1625b-8586-4bf8-b6e8-672a57c32f84 service cinder] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:59.945679 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e1625b-8586-4bf8-b6e8-672a57c32f84 service cinder] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:59.945950 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e1625b-8586-4bf8-b6e8-672a57c32f84 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:59.957317 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e1625b-8586-4bf8-b6e8-672a57c32f84 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:59.958783 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e1625b-8586-4bf8-b6e8-672a57c32f84 service cinder] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:59.971235 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1409/2812] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:29:59 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:30:00.059974 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99560dbc-63ca-488b-b522-02047c0631e5 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:30:00.070057 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99560dbc-63ca-488b-b522-02047c0631e5 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:30:00.074713 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89d50f9-8289-49dd-9aa9-8390c690af41 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beecda6e9feb400288618745c784989f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:30:00.075346 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89d50f9-8289-49dd-9aa9-8390c690af41 service cinder] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:30:00.075625 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89d50f9-8289-49dd-9aa9-8390c690af41 service cinder] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:30:00.075895 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89d50f9-8289-49dd-9aa9-8390c690af41 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:30:00.142180 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89d50f9-8289-49dd-9aa9-8390c690af41 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:30:00.143651 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89d50f9-8289-49dd-9aa9-8390c690af41 service cinder] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:30:00.155134 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1404/2813] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:30:00 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:30:01.918668 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e1625b-8586-4bf8-b6e8-672a57c32f84 service cinder] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:30:01.921064 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-47e1625b-8586-4bf8-b6e8-672a57c32f84 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:30:01.968777 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:30:02.020505 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e1625b-8586-4bf8-b6e8-672a57c32f84 service cinder] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:30:02.026424 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff352fc8-fc81-4880-846b-81f38e60cd7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:30:02.027086 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff352fc8-fc81-4880-846b-81f38e60cd7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:30:02.027366 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff352fc8-fc81-4880-846b-81f38e60cd7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:30:02.027699 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff352fc8-fc81-4880-846b-81f38e60cd7d admin admin] PATH_INFO: `/v3/users/2ad47bc878d14c9ab919af429b758eb5` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:30:02.029030 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff352fc8-fc81-4880-846b-81f38e60cd7d admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ad47bc878d14c9ab919af429b758eb5)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:30:02.031108 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff352fc8-fc81-4880-846b-81f38e60cd7d admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:30:02.106818 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-ff352fc8-fc81-4880-846b-81f38e60cd7d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ad47bc878d14c9ab919af429b758eb5'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:30:02.116611 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-ff352fc8-fc81-4880-846b-81f38e60cd7d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ad47bc878d14c9ab919af429b758eb5'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:30:02.126867 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-ff352fc8-fc81-4880-846b-81f38e60cd7d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ad47bc878d14c9ab919af429b758eb5'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:30:02.127595 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-ff352fc8-fc81-4880-846b-81f38e60cd7d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ad47bc878d14c9ab919af429b758eb5'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:30:02.145726 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-ff352fc8-fc81-4880-846b-81f38e60cd7d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ad47bc878d14c9ab919af429b758eb5'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:30:02.153913 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1410/2814] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 31 00:30:01 2022] DELETE /identity/v3/users/2ad47bc878d14c9ab919af429b758eb5 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:30:02.158809 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1383985b-b248-4624-9490-cf14ea64b456 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:30:02.159546 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1383985b-b248-4624-9490-cf14ea64b456 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:30:02.159546 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1383985b-b248-4624-9490-cf14ea64b456 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:30:02.182719 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-1383985b-b248-4624-9490-cf14ea64b456 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:30:02.184473 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-1383985b-b248-4624-9490-cf14ea64b456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:30:02.253449 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1405/2815] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:30:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:30:02.265078 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff352fc8-fc81-4880-846b-81f38e60cd7d admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:30:02.266823 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-ff352fc8-fc81-4880-846b-81f38e60cd7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:30:02.347416 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff352fc8-fc81-4880-846b-81f38e60cd7d admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:30:02.351343 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0bf115-70ec-45b2-bbe9-ee24d00b5cc1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'daae792cd11d4c4ca7aae0558998aced', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:30:02.351984 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0bf115-70ec-45b2-bbe9-ee24d00b5cc1 service neutron] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:30:02.352301 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0bf115-70ec-45b2-bbe9-ee24d00b5cc1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:30:02.352574 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0bf115-70ec-45b2-bbe9-ee24d00b5cc1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:30:02.364702 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0bf115-70ec-45b2-bbe9-ee24d00b5cc1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:30:02.366256 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0bf115-70ec-45b2-bbe9-ee24d00b5cc1 service neutron] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:30:02.378942 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1411/2816] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:30:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:30:02.704092 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1383985b-b248-4624-9490-cf14ea64b456 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:30:02.705780 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-1383985b-b248-4624-9490-cf14ea64b456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:30:02.719152 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1383985b-b248-4624-9490-cf14ea64b456 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:30:02.725590 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3f5e43-2fff-48e6-b06b-332c62572a66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:30:02.726433 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3f5e43-2fff-48e6-b06b-332c62572a66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:30:02.726806 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3f5e43-2fff-48e6-b06b-332c62572a66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:30:02.727187 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3f5e43-2fff-48e6-b06b-332c62572a66 admin admin] PATH_INFO: `/v3/projects/abc8f23291e04f92bfdd10cdfb4ffeb9` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:30:02.729855 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3f5e43-2fff-48e6-b06b-332c62572a66 admin admin] RBAC: Authorizing `identity:delete_project(project_id=abc8f23291e04f92bfdd10cdfb4ffeb9)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:30:02.732325 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3f5e43-2fff-48e6-b06b-332c62572a66 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:30:02.789018 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:30:02.796974 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-8e3f5e43-2fff-48e6-b06b-332c62572a66 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'abc8f23291e04f92bfdd10cdfb4ffeb9', 'request_id': 'req-8e3f5e43-2fff-48e6-b06b-332c62572a66'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:30:02.804760 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-8e3f5e43-2fff-48e6-b06b-332c62572a66 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'abc8f23291e04f92bfdd10cdfb4ffeb9', 'request_id': 'req-8e3f5e43-2fff-48e6-b06b-332c62572a66'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:30:02.811108 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-8e3f5e43-2fff-48e6-b06b-332c62572a66 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'abc8f23291e04f92bfdd10cdfb4ffeb9', 'request_id': 'req-8e3f5e43-2fff-48e6-b06b-332c62572a66'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:30:02.828103 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-8e3f5e43-2fff-48e6-b06b-332c62572a66 admin admin] The token cache is being invalidate because project abc8f23291e04f92bfdd10cdfb4ffeb9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81523) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:30:02.828646 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-8e3f5e43-2fff-48e6-b06b-332c62572a66 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:30:02.829674 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-8e3f5e43-2fff-48e6-b06b-332c62572a66 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:30:02.832176 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1406/2817] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 31 00:30:02 2022] DELETE /identity/v3/projects/abc8f23291e04f92bfdd10cdfb4ffeb9 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:30:02.839543 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0bf115-70ec-45b2-bbe9-ee24d00b5cc1 service neutron] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:30:02.857688 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0bf115-70ec-45b2-bbe9-ee24d00b5cc1 service neutron] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:30:02.926220 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:30:02.942615 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d862558-8b3a-4b2f-8024-70ca5c3299b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:30:02.943268 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d862558-8b3a-4b2f-8024-70ca5c3299b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:30:02.943549 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d862558-8b3a-4b2f-8024-70ca5c3299b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:30:02.943826 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d862558-8b3a-4b2f-8024-70ca5c3299b2 admin admin] PATH_INFO: `/v3/users/5c1134a7a9d04a9f993ebc24c8de4f3d` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:30:02.945031 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d862558-8b3a-4b2f-8024-70ca5c3299b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c1134a7a9d04a9f993ebc24c8de4f3d)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:30:02.948218 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d862558-8b3a-4b2f-8024-70ca5c3299b2 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:30:03.012221 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-3d862558-8b3a-4b2f-8024-70ca5c3299b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c1134a7a9d04a9f993ebc24c8de4f3d'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:30:03.026948 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-3d862558-8b3a-4b2f-8024-70ca5c3299b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c1134a7a9d04a9f993ebc24c8de4f3d'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:30:03.038573 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-3d862558-8b3a-4b2f-8024-70ca5c3299b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c1134a7a9d04a9f993ebc24c8de4f3d'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:30:03.039274 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-3d862558-8b3a-4b2f-8024-70ca5c3299b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c1134a7a9d04a9f993ebc24c8de4f3d'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:30:03.061821 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-3d862558-8b3a-4b2f-8024-70ca5c3299b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c1134a7a9d04a9f993ebc24c8de4f3d'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:30:03.073082 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1412/2818] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 31 00:30:02 2022] DELETE /identity/v3/users/5c1134a7a9d04a9f993ebc24c8de4f3d => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:30:03.450678 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3f5e43-2fff-48e6-b06b-332c62572a66 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:30:03.453341 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-8e3f5e43-2fff-48e6-b06b-332c62572a66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:30:03.471356 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3f5e43-2fff-48e6-b06b-332c62572a66 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:30:03.538591 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a9fce0-c753-4779-ae17-3b682c6dd18c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:30:03.539329 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a9fce0-c753-4779-ae17-3b682c6dd18c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:30:03.539710 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a9fce0-c753-4779-ae17-3b682c6dd18c admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:30:03.539971 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a9fce0-c753-4779-ae17-3b682c6dd18c admin admin] PATH_INFO: `/v3/projects/e2eb747fd13f4749812dbe1bc62d1c51` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:30:03.541808 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a9fce0-c753-4779-ae17-3b682c6dd18c admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2eb747fd13f4749812dbe1bc62d1c51)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:30:03.543776 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a9fce0-c753-4779-ae17-3b682c6dd18c admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:30:03.608138 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-90a9fce0-c753-4779-ae17-3b682c6dd18c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2eb747fd13f4749812dbe1bc62d1c51', 'request_id': 'req-90a9fce0-c753-4779-ae17-3b682c6dd18c'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:30:03.615052 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-90a9fce0-c753-4779-ae17-3b682c6dd18c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2eb747fd13f4749812dbe1bc62d1c51', 'request_id': 'req-90a9fce0-c753-4779-ae17-3b682c6dd18c'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:30:03.622505 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-90a9fce0-c753-4779-ae17-3b682c6dd18c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2eb747fd13f4749812dbe1bc62d1c51', 'request_id': 'req-90a9fce0-c753-4779-ae17-3b682c6dd18c'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:30:03.640807 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-90a9fce0-c753-4779-ae17-3b682c6dd18c admin admin] The token cache is being invalidate because project e2eb747fd13f4749812dbe1bc62d1c51 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81523) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:30:03.641169 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-90a9fce0-c753-4779-ae17-3b682c6dd18c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:30:03.642012 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-90a9fce0-c753-4779-ae17-3b682c6dd18c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:30:03.643634 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1407/2819] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 31 00:30:03 2022] DELETE /identity/v3/projects/e2eb747fd13f4749812dbe1bc62d1c51 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:30:03.649247 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d862558-8b3a-4b2f-8024-70ca5c3299b2 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:30:03.651631 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-3d862558-8b3a-4b2f-8024-70ca5c3299b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:30:03.674856 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d862558-8b3a-4b2f-8024-70ca5c3299b2 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:30:03.747491 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d03d2f9-44fa-43eb-872b-a472a6915add admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:30:03.748535 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d03d2f9-44fa-43eb-872b-a472a6915add admin admin] REQUEST_METHOD: `DELETE` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:30:03.748903 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d03d2f9-44fa-43eb-872b-a472a6915add admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:30:03.749322 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d03d2f9-44fa-43eb-872b-a472a6915add admin admin] PATH_INFO: `/v3/users/01279075849e4b35bb0e1b8a02912471` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:30:03.751396 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d03d2f9-44fa-43eb-872b-a472a6915add admin admin] RBAC: Authorizing `identity:delete_user(user_id=01279075849e4b35bb0e1b8a02912471)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:30:03.755211 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d03d2f9-44fa-43eb-872b-a472a6915add admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:30:03.835578 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-8d03d2f9-44fa-43eb-872b-a472a6915add admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01279075849e4b35bb0e1b8a02912471'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:30:03.848281 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-8d03d2f9-44fa-43eb-872b-a472a6915add admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01279075849e4b35bb0e1b8a02912471'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:30:03.857913 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-8d03d2f9-44fa-43eb-872b-a472a6915add admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01279075849e4b35bb0e1b8a02912471'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:30:03.858560 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-8d03d2f9-44fa-43eb-872b-a472a6915add admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01279075849e4b35bb0e1b8a02912471'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:30:03.867846 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:30:03.882827 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-8d03d2f9-44fa-43eb-872b-a472a6915add admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01279075849e4b35bb0e1b8a02912471'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:30:03.890590 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1413/2820] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 31 00:30:03 2022] DELETE /identity/v3/users/01279075849e4b35bb0e1b8a02912471 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:30:04.210099 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a9fce0-c753-4779-ae17-3b682c6dd18c admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:30:04.211677 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-90a9fce0-c753-4779-ae17-3b682c6dd18c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:30:04.231898 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a9fce0-c753-4779-ae17-3b682c6dd18c admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:30:04.316703 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccf17a2-8ed2-48c2-ab39-15d165d721e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:30:04.317349 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccf17a2-8ed2-48c2-ab39-15d165d721e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:30:04.317684 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccf17a2-8ed2-48c2-ab39-15d165d721e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:30:04.318104 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccf17a2-8ed2-48c2-ab39-15d165d721e5 admin admin] PATH_INFO: `/v3/projects/ca64852f61e74f629b756c1cf19e9d34` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:30:04.319712 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccf17a2-8ed2-48c2-ab39-15d165d721e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca64852f61e74f629b756c1cf19e9d34)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:30:04.322432 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccf17a2-8ed2-48c2-ab39-15d165d721e5 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:30:04.324426 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:30:04.382841 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-1ccf17a2-8ed2-48c2-ab39-15d165d721e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca64852f61e74f629b756c1cf19e9d34', 'request_id': 'req-1ccf17a2-8ed2-48c2-ab39-15d165d721e5'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:30:04.394793 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-1ccf17a2-8ed2-48c2-ab39-15d165d721e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca64852f61e74f629b756c1cf19e9d34', 'request_id': 'req-1ccf17a2-8ed2-48c2-ab39-15d165d721e5'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:30:04.403357 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-1ccf17a2-8ed2-48c2-ab39-15d165d721e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca64852f61e74f629b756c1cf19e9d34', 'request_id': 'req-1ccf17a2-8ed2-48c2-ab39-15d165d721e5'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:30:04.421610 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-1ccf17a2-8ed2-48c2-ab39-15d165d721e5 admin admin] The token cache is being invalidate because project ca64852f61e74f629b756c1cf19e9d34 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81523) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:30:04.422078 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-1ccf17a2-8ed2-48c2-ab39-15d165d721e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:30:04.423058 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-1ccf17a2-8ed2-48c2-ab39-15d165d721e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:30:04.425486 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1408/2821] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 31 00:30:04 2022] DELETE /identity/v3/projects/ca64852f61e74f629b756c1cf19e9d34 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:30:04.431801 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a9cd75-2361-43d7-8c74-9d186f1c88ab None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:30:04.432635 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a9cd75-2361-43d7-8c74-9d186f1c88ab None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:30:04.432635 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a9cd75-2361-43d7-8c74-9d186f1c88ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:30:04.460191 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-d8a9cd75-2361-43d7-8c74-9d186f1c88ab None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:30:04.461896 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-d8a9cd75-2361-43d7-8c74-9d186f1c88ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:30:04.560551 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1414/2822] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:30:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:30:04.571481 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b66400-143b-41d8-8992-4256d0647037 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:30:04.572919 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b66400-143b-41d8-8992-4256d0647037 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:30:04.572919 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b66400-143b-41d8-8992-4256d0647037 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:30:04.590090 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a9cd75-2361-43d7-8c74-9d186f1c88ab None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:30:04.592384 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-d8a9cd75-2361-43d7-8c74-9d186f1c88ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:30:04.606840 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-59b66400-143b-41d8-8992-4256d0647037 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:30:04.608594 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-59b66400-143b-41d8-8992-4256d0647037 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:30:04.613844 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a9cd75-2361-43d7-8c74-9d186f1c88ab None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:30:04.622053 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1409/2823] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:30:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:30:04.622743 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c461d6a-a8bb-407e-b49c-48b9481eff43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:30:04.623966 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c461d6a-a8bb-407e-b49c-48b9481eff43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:30:04.624494 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c461d6a-a8bb-407e-b49c-48b9481eff43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:30:04.624982 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c461d6a-a8bb-407e-b49c-48b9481eff43 admin admin] PATH_INFO: `/v3/users/8eb2841c178d489da546678fd134f301` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:30:04.627475 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c461d6a-a8bb-407e-b49c-48b9481eff43 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8eb2841c178d489da546678fd134f301)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:30:04.629134 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b66400-143b-41d8-8992-4256d0647037 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:30:04.631175 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c461d6a-a8bb-407e-b49c-48b9481eff43 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:30:04.643972 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b66400-143b-41d8-8992-4256d0647037 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:30:04.651068 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5febd1e-2f04-4492-8586-358728e8c9be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:30:04.652400 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5febd1e-2f04-4492-8586-358728e8c9be admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:30:04.652889 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5febd1e-2f04-4492-8586-358728e8c9be admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:30:04.653312 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5febd1e-2f04-4492-8586-358728e8c9be admin admin] PATH_INFO: `/v3/domains` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:30:04.654355 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5febd1e-2f04-4492-8586-358728e8c9be admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:30:04.654907 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5febd1e-2f04-4492-8586-358728e8c9be admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:30:04.657607 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5febd1e-2f04-4492-8586-358728e8c9be admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:30:04.681254 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1410/2824] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 31 00:30:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:30:04.688127 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5febd1e-2f04-4492-8586-358728e8c9be admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:30:04.700797 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5febd1e-2f04-4492-8586-358728e8c9be admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:30:04.707288 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e85327-29b5-4880-bbb2-3f56e26400ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:30:04.707838 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-4c461d6a-a8bb-407e-b49c-48b9481eff43 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8eb2841c178d489da546678fd134f301'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:30:04.708179 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e85327-29b5-4880-bbb2-3f56e26400ac admin admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:30:04.708758 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e85327-29b5-4880-bbb2-3f56e26400ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:30:04.708911 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e85327-29b5-4880-bbb2-3f56e26400ac admin admin] PATH_INFO: `/v3/projects` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:30:04.709721 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e85327-29b5-4880-bbb2-3f56e26400ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:30:04.712754 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e85327-29b5-4880-bbb2-3f56e26400ac admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:30:04.716689 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-4c461d6a-a8bb-407e-b49c-48b9481eff43 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8eb2841c178d489da546678fd134f301'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:30:04.726123 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-4c461d6a-a8bb-407e-b49c-48b9481eff43 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8eb2841c178d489da546678fd134f301'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:30:04.727203 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-4c461d6a-a8bb-407e-b49c-48b9481eff43 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8eb2841c178d489da546678fd134f301'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:30:04.753489 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1411/2825] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 31 00:30:04 2022] POST /identity/v3/projects => generated 373 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:30:04.758652 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e85327-29b5-4880-bbb2-3f56e26400ac admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:30:04.759094 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-4c461d6a-a8bb-407e-b49c-48b9481eff43 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8eb2841c178d489da546678fd134f301'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:30:04.760630 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-66e85327-29b5-4880-bbb2-3f56e26400ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:30:04.767946 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1415/2826] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 31 00:30:04 2022] DELETE /identity/v3/users/8eb2841c178d489da546678fd134f301 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:30:04.772719 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ec84da-037d-4b48-b2cb-efd753c886d2 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:30:04.773002 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ec84da-037d-4b48-b2cb-efd753c886d2 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:30:04.773277 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ec84da-037d-4b48-b2cb-efd753c886d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:30:04.794893 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-d5ec84da-037d-4b48-b2cb-efd753c886d2 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:30:04.796138 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-d5ec84da-037d-4b48-b2cb-efd753c886d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:30:04.853789 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e85327-29b5-4880-bbb2-3f56e26400ac admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:30:04.867786 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:30:04.886369 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1416/2827] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:30:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:30:04.893803 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ec84da-037d-4b48-b2cb-efd753c886d2 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:30:04.895248 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-d5ec84da-037d-4b48-b2cb-efd753c886d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:30:04.920494 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:30:04.928394 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d645ac00-caf5-49dd-91dd-7e34d90151c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:30:04.929326 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d645ac00-caf5-49dd-91dd-7e34d90151c6 admin admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:30:04.930094 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d645ac00-caf5-49dd-91dd-7e34d90151c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:30:04.930527 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d645ac00-caf5-49dd-91dd-7e34d90151c6 admin admin] PATH_INFO: `/v3/users` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:30:04.931951 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d645ac00-caf5-49dd-91dd-7e34d90151c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:30:04.934245 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d645ac00-caf5-49dd-91dd-7e34d90151c6 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:30:04.958600 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1412/2828] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 31 00:30:04 2022] POST /identity/v3/users => generated 287 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:30:04.963181 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d645ac00-caf5-49dd-91dd-7e34d90151c6 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:30:04.965667 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ec84da-037d-4b48-b2cb-efd753c886d2 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:30:04.972120 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce726726-de68-4213-a591-daa929504e76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'daae792cd11d4c4ca7aae0558998aced', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:30:04.973215 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce726726-de68-4213-a591-daa929504e76 service neutron] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:30:04.973731 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce726726-de68-4213-a591-daa929504e76 service neutron] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:30:04.974172 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d645ac00-caf5-49dd-91dd-7e34d90151c6 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:30:04.974294 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce726726-de68-4213-a591-daa929504e76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:30:04.979435 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e65b32-5689-4ed8-af0b-413638dee775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:30:04.980055 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e65b32-5689-4ed8-af0b-413638dee775 admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:30:04.980403 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e65b32-5689-4ed8-af0b-413638dee775 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:30:04.980698 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e65b32-5689-4ed8-af0b-413638dee775 admin admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:30:04.981351 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e65b32-5689-4ed8-af0b-413638dee775 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:30:04.983001 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e65b32-5689-4ed8-af0b-413638dee775 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:30:04.992668 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce726726-de68-4213-a591-daa929504e76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:30:04.994487 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1413/2829] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 00:30:04 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:30:04.995188 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce726726-de68-4213-a591-daa929504e76 service neutron] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:30:04.998831 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e65b32-5689-4ed8-af0b-413638dee775 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:30:05.008649 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1417/2830] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:30:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 00:30:05.010430 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e65b32-5689-4ed8-af0b-413638dee775 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:30:05.016332 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2a9b83-87ed-48b9-bb14-f48625aa6f7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:30:05.017266 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2a9b83-87ed-48b9-bb14-f48625aa6f7d admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:30:05.017650 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2a9b83-87ed-48b9-bb14-f48625aa6f7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:30:05.018025 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2a9b83-87ed-48b9-bb14-f48625aa6f7d admin admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:30:05.018797 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2a9b83-87ed-48b9-bb14-f48625aa6f7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:30:05.020941 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2a9b83-87ed-48b9-bb14-f48625aa6f7d admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:30:05.041082 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1414/2831] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 00:30:04 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 00:30:05.042568 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce726726-de68-4213-a591-daa929504e76 service neutron] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:30:05.058250 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce726726-de68-4213-a591-daa929504e76 service neutron] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:30:05.065745 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d631e17-e6de-42f3-89b8-715fa7ac648b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:30:05.066590 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d631e17-e6de-42f3-89b8-715fa7ac648b admin admin] REQUEST_METHOD: `PUT` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:30:05.067417 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d631e17-e6de-42f3-89b8-715fa7ac648b admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:30:05.067860 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d631e17-e6de-42f3-89b8-715fa7ac648b admin admin] PATH_INFO: `/v3/projects/0c60f381dfb74597b07208b0c080987f/users/4f5ea3b457d546b0b9c362085a90e2ed/roles/fdad79ffbcbb4fa380dc9cf7dd108618` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:30:05.101682 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d631e17-e6de-42f3-89b8-715fa7ac648b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c60f381dfb74597b07208b0c080987f, user_id=4f5ea3b457d546b0b9c362085a90e2ed, role_id=fdad79ffbcbb4fa380dc9cf7dd108618)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:30:05.109102 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d631e17-e6de-42f3-89b8-715fa7ac648b admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:30:05.133354 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1418/2832] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 00:30:05 2022] PUT /identity/v3/projects/0c60f381dfb74597b07208b0c080987f/users/4f5ea3b457d546b0b9c362085a90e2ed/roles/fdad79ffbcbb4fa380dc9cf7dd108618 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:30:05.142675 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc898c5-1601-4cfa-88f3-dc815089fc16 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:30:05.143160 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc898c5-1601-4cfa-88f3-dc815089fc16 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:30:05.143770 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc898c5-1601-4cfa-88f3-dc815089fc16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:30:05.179123 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-4bc898c5-1601-4cfa-88f3-dc815089fc16 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:30:05.181895 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-4bc898c5-1601-4cfa-88f3-dc815089fc16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:30:05.280206 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1415/2833] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:30:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:30:05.295153 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d631e17-e6de-42f3-89b8-715fa7ac648b admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:30:05.297866 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-5d631e17-e6de-42f3-89b8-715fa7ac648b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:30:05.388482 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d631e17-e6de-42f3-89b8-715fa7ac648b admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:30:05.392613 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65aeb96c-7716-4c51-8b67-89e808e3722c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'daae792cd11d4c4ca7aae0558998aced', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:30:05.393260 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aeb96c-7716-4c51-8b67-89e808e3722c service neutron] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:30:05.393553 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aeb96c-7716-4c51-8b67-89e808e3722c service neutron] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:30:05.393823 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aeb96c-7716-4c51-8b67-89e808e3722c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:30:05.405671 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65aeb96c-7716-4c51-8b67-89e808e3722c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:30:05.407275 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65aeb96c-7716-4c51-8b67-89e808e3722c service neutron] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:30:05.411673 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc898c5-1601-4cfa-88f3-dc815089fc16 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:30:05.413983 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-4bc898c5-1601-4cfa-88f3-dc815089fc16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:30:05.418866 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1419/2834] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:30:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 00:30:05.433676 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc898c5-1601-4cfa-88f3-dc815089fc16 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:30:05.439574 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e001660-7904-4c5b-b3eb-0c4eeece22e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:30:05.440340 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e001660-7904-4c5b-b3eb-0c4eeece22e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:30:05.440817 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e001660-7904-4c5b-b3eb-0c4eeece22e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:30:05.441145 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e001660-7904-4c5b-b3eb-0c4eeece22e5 admin admin] PATH_INFO: `/v3/projects/d23840ac65344329b891987a7068bd53` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:30:05.442730 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e001660-7904-4c5b-b3eb-0c4eeece22e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d23840ac65344329b891987a7068bd53)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:30:05.445022 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e001660-7904-4c5b-b3eb-0c4eeece22e5 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:30:05.511905 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-4e001660-7904-4c5b-b3eb-0c4eeece22e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd23840ac65344329b891987a7068bd53', 'request_id': 'req-4e001660-7904-4c5b-b3eb-0c4eeece22e5'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:30:05.525245 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-4e001660-7904-4c5b-b3eb-0c4eeece22e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd23840ac65344329b891987a7068bd53', 'request_id': 'req-4e001660-7904-4c5b-b3eb-0c4eeece22e5'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:30:05.536230 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-4e001660-7904-4c5b-b3eb-0c4eeece22e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd23840ac65344329b891987a7068bd53', 'request_id': 'req-4e001660-7904-4c5b-b3eb-0c4eeece22e5'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:30:05.555310 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-4e001660-7904-4c5b-b3eb-0c4eeece22e5 admin admin] The token cache is being invalidate because project d23840ac65344329b891987a7068bd53 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81523) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:30:05.555597 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-4e001660-7904-4c5b-b3eb-0c4eeece22e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:30:05.556502 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-4e001660-7904-4c5b-b3eb-0c4eeece22e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:30:05.558100 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1416/2835] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 31 00:30:05 2022] DELETE /identity/v3/projects/d23840ac65344329b891987a7068bd53 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:30:05.562399 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65aeb96c-7716-4c51-8b67-89e808e3722c service neutron] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:30:05.573986 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65aeb96c-7716-4c51-8b67-89e808e3722c service neutron] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:30:05.654523 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e748f66d-4cda-499d-949f-21af281c0b60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:30:05.655167 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e748f66d-4cda-499d-949f-21af281c0b60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:30:05.655440 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e748f66d-4cda-499d-949f-21af281c0b60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:30:05.655710 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e748f66d-4cda-499d-949f-21af281c0b60 admin admin] PATH_INFO: `/v3/users/9971c51b47234b469009e5946c3b540e` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:30:05.656997 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e748f66d-4cda-499d-949f-21af281c0b60 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9971c51b47234b469009e5946c3b540e)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:30:05.658987 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e748f66d-4cda-499d-949f-21af281c0b60 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:30:05.687216 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:30:05.720711 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-e748f66d-4cda-499d-949f-21af281c0b60 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9971c51b47234b469009e5946c3b540e'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:30:05.729667 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-e748f66d-4cda-499d-949f-21af281c0b60 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9971c51b47234b469009e5946c3b540e'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:30:05.739061 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-e748f66d-4cda-499d-949f-21af281c0b60 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9971c51b47234b469009e5946c3b540e'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:30:05.739800 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-e748f66d-4cda-499d-949f-21af281c0b60 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9971c51b47234b469009e5946c3b540e'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:30:05.757362 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-e748f66d-4cda-499d-949f-21af281c0b60 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9971c51b47234b469009e5946c3b540e'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:30:05.764813 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1420/2836] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 31 00:30:05 2022] DELETE /identity/v3/users/9971c51b47234b469009e5946c3b540e => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:30:06.648091 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e001660-7904-4c5b-b3eb-0c4eeece22e5 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:30:06.649531 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-4e001660-7904-4c5b-b3eb-0c4eeece22e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:30:06.664112 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e001660-7904-4c5b-b3eb-0c4eeece22e5 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:30:06.752606 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:30:06.771746 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e49cb9-06b5-4080-a5df-f80b6c517837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:30:06.772683 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e49cb9-06b5-4080-a5df-f80b6c517837 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:30:06.772970 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e49cb9-06b5-4080-a5df-f80b6c517837 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:30:06.773240 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e49cb9-06b5-4080-a5df-f80b6c517837 admin admin] PATH_INFO: `/v3/projects/5e6ca7649e864f9388aeb6f92e2481ee` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:30:06.774579 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e49cb9-06b5-4080-a5df-f80b6c517837 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e6ca7649e864f9388aeb6f92e2481ee)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:30:06.777411 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e49cb9-06b5-4080-a5df-f80b6c517837 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:30:06.840730 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-e4e49cb9-06b5-4080-a5df-f80b6c517837 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e6ca7649e864f9388aeb6f92e2481ee', 'request_id': 'req-e4e49cb9-06b5-4080-a5df-f80b6c517837'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:30:06.848496 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-e4e49cb9-06b5-4080-a5df-f80b6c517837 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e6ca7649e864f9388aeb6f92e2481ee', 'request_id': 'req-e4e49cb9-06b5-4080-a5df-f80b6c517837'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:30:06.856365 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-e4e49cb9-06b5-4080-a5df-f80b6c517837 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e6ca7649e864f9388aeb6f92e2481ee', 'request_id': 'req-e4e49cb9-06b5-4080-a5df-f80b6c517837'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:30:06.876229 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-e4e49cb9-06b5-4080-a5df-f80b6c517837 admin admin] The token cache is being invalidate because project 5e6ca7649e864f9388aeb6f92e2481ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81523) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:30:06.876742 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-e4e49cb9-06b5-4080-a5df-f80b6c517837 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:30:06.877283 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-e4e49cb9-06b5-4080-a5df-f80b6c517837 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:30:06.880001 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1417/2837] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 31 00:30:06 2022] DELETE /identity/v3/projects/5e6ca7649e864f9388aeb6f92e2481ee => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:30:06.885490 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a6a17a-d219-4597-9c77-210ec267ef35 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:30:06.886090 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a6a17a-d219-4597-9c77-210ec267ef35 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:30:06.886191 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a6a17a-d219-4597-9c77-210ec267ef35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:30:06.932406 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-38a6a17a-d219-4597-9c77-210ec267ef35 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:30:06.933582 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-38a6a17a-d219-4597-9c77-210ec267ef35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:30:07.051647 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1421/2838] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:30:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:30:07.062575 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47768d3f-d4b6-4365-8adf-904301b516df None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:30:07.063031 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47768d3f-d4b6-4365-8adf-904301b516df None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:30:07.063485 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47768d3f-d4b6-4365-8adf-904301b516df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:30:07.115172 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-47768d3f-d4b6-4365-8adf-904301b516df None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:30:07.116506 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-47768d3f-d4b6-4365-8adf-904301b516df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:30:07.128727 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1418/2839] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:30:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:30:07.133181 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a6a17a-d219-4597-9c77-210ec267ef35 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:30:07.145723 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a6a17a-d219-4597-9c77-210ec267ef35 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:30:07.164023 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca160a2a-cf5b-46ac-8b03-86ab964916a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:30:07.164945 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca160a2a-cf5b-46ac-8b03-86ab964916a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:30:07.165317 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca160a2a-cf5b-46ac-8b03-86ab964916a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:30:07.165672 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca160a2a-cf5b-46ac-8b03-86ab964916a7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:30:07.166428 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca160a2a-cf5b-46ac-8b03-86ab964916a7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:30:07.166972 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca160a2a-cf5b-46ac-8b03-86ab964916a7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:30:07.169000 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca160a2a-cf5b-46ac-8b03-86ab964916a7 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:30:07.200888 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1422/2840] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 31 00:30:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:30:07.209799 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47768d3f-d4b6-4365-8adf-904301b516df None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:30:07.242570 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47768d3f-d4b6-4365-8adf-904301b516df None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:30:07.262189 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885fafc9-342f-492a-b8a7-2c46630480d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:30:07.263858 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885fafc9-342f-492a-b8a7-2c46630480d7 admin admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:30:07.264877 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885fafc9-342f-492a-b8a7-2c46630480d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:30:07.265470 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885fafc9-342f-492a-b8a7-2c46630480d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:30:07.267785 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885fafc9-342f-492a-b8a7-2c46630480d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:30:07.275333 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885fafc9-342f-492a-b8a7-2c46630480d7 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:30:07.354839 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1419/2841] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 31 00:30:07 2022] POST /identity/v3/projects => generated 381 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:30:07.360623 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca160a2a-cf5b-46ac-8b03-86ab964916a7 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:30:07.388598 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7abbbdc-6a19-4144-b214-079b41e7f331 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:30:07.388920 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7abbbdc-6a19-4144-b214-079b41e7f331 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:30:07.389148 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7abbbdc-6a19-4144-b214-079b41e7f331 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:30:07.401381 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca160a2a-cf5b-46ac-8b03-86ab964916a7 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:30:07.486040 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-b7abbbdc-6a19-4144-b214-079b41e7f331 None None] MFA Rules not processed for user `4f5ea3b457d546b0b9c362085a90e2ed`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:30:07.488521 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-b7abbbdc-6a19-4144-b214-079b41e7f331 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:30:07.612386 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0b0f1d-e50c-4f1c-a0b5-9a54481baea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:30:07.615648 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0b0f1d-e50c-4f1c-a0b5-9a54481baea2 admin admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:30:07.620422 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0b0f1d-e50c-4f1c-a0b5-9a54481baea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:30:07.620862 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0b0f1d-e50c-4f1c-a0b5-9a54481baea2 admin admin] PATH_INFO: `/v3/users` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:30:07.621488 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0b0f1d-e50c-4f1c-a0b5-9a54481baea2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:30:07.630677 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0b0f1d-e50c-4f1c-a0b5-9a54481baea2 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:30:07.640424 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1420/2842] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:30:07 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:30:07.661318 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7abbbdc-6a19-4144-b214-079b41e7f331 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:30:07.663922 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-b7abbbdc-6a19-4144-b214-079b41e7f331 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:30:07.671013 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1423/2843] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 31 00:30:07 2022] POST /identity/v3/users => generated 291 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:30:07.676241 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0b0f1d-e50c-4f1c-a0b5-9a54481baea2 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:30:07.691226 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0b0f1d-e50c-4f1c-a0b5-9a54481baea2 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:30:07.699661 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11de1c91-8a37-4fe7-927d-be4eeaedb143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:30:07.700446 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11de1c91-8a37-4fe7-927d-be4eeaedb143 admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:30:07.700807 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11de1c91-8a37-4fe7-927d-be4eeaedb143 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:30:07.701154 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11de1c91-8a37-4fe7-927d-be4eeaedb143 admin admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:30:07.701911 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11de1c91-8a37-4fe7-927d-be4eeaedb143 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:30:07.704748 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11de1c91-8a37-4fe7-927d-be4eeaedb143 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:30:07.721076 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:30:07.731911 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1424/2844] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 00:30:07 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:30:07.733879 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11de1c91-8a37-4fe7-927d-be4eeaedb143 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:30:07.749552 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11de1c91-8a37-4fe7-927d-be4eeaedb143 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:30:07.757152 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad75b416-1837-42e1-9a25-7a6ac18927db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:30:07.757846 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad75b416-1837-42e1-9a25-7a6ac18927db admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:30:07.758674 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad75b416-1837-42e1-9a25-7a6ac18927db admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:30:07.758962 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad75b416-1837-42e1-9a25-7a6ac18927db admin admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:30:07.759966 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7abbbdc-6a19-4144-b214-079b41e7f331 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:30:07.760326 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad75b416-1837-42e1-9a25-7a6ac18927db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:30:07.762309 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad75b416-1837-42e1-9a25-7a6ac18927db admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:30:07.764194 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b79dda4-3a15-487b-a42c-fd5d172cdc00 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beecda6e9feb400288618745c784989f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:30:07.764971 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b79dda4-3a15-487b-a42c-fd5d172cdc00 service cinder] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:30:07.765172 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:30:07.765327 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b79dda4-3a15-487b-a42c-fd5d172cdc00 service cinder] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:30:07.765816 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b79dda4-3a15-487b-a42c-fd5d172cdc00 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:30:07.777958 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b79dda4-3a15-487b-a42c-fd5d172cdc00 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:30:07.780077 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b79dda4-3a15-487b-a42c-fd5d172cdc00 service cinder] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:30:07.784922 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1425/2845] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 00:30:07 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:30:07.789810 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad75b416-1837-42e1-9a25-7a6ac18927db admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:30:07.803543 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1421/2846] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:30:07 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:30:07.814781 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad75b416-1837-42e1-9a25-7a6ac18927db admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:30:07.820836 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f685c9cc-2da3-402d-b6c6-a1c02be30b8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:30:07.822163 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f685c9cc-2da3-402d-b6c6-a1c02be30b8c admin admin] REQUEST_METHOD: `PUT` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:30:07.822458 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f685c9cc-2da3-402d-b6c6-a1c02be30b8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:30:07.822737 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f685c9cc-2da3-402d-b6c6-a1c02be30b8c admin admin] PATH_INFO: `/v3/projects/f4b9396ad1f047c2bb518e24794b5d23/users/fb342e5832824055905e959777bdbb5d/roles/fdad79ffbcbb4fa380dc9cf7dd108618` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:30:07.844853 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f685c9cc-2da3-402d-b6c6-a1c02be30b8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4b9396ad1f047c2bb518e24794b5d23, user_id=fb342e5832824055905e959777bdbb5d, role_id=fdad79ffbcbb4fa380dc9cf7dd108618)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:30:07.848453 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f685c9cc-2da3-402d-b6c6-a1c02be30b8c admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:30:07.868233 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1426/2847] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 00:30:07 2022] PUT /identity/v3/projects/f4b9396ad1f047c2bb518e24794b5d23/users/fb342e5832824055905e959777bdbb5d/roles/fdad79ffbcbb4fa380dc9cf7dd108618 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:30:07.881173 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798c4949-b7b3-4649-ba62-f9e8d6de6d75 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:30:07.882019 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798c4949-b7b3-4649-ba62-f9e8d6de6d75 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:30:07.882019 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798c4949-b7b3-4649-ba62-f9e8d6de6d75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:30:07.921109 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-798c4949-b7b3-4649-ba62-f9e8d6de6d75 None None] MFA Rules not processed for user `fb342e5832824055905e959777bdbb5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:30:07.922711 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-798c4949-b7b3-4649-ba62-f9e8d6de6d75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:30:08.036765 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1422/2848] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:30:07 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:30:08.045901 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f685c9cc-2da3-402d-b6c6-a1c02be30b8c admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:30:08.129352 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f685c9cc-2da3-402d-b6c6-a1c02be30b8c admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:30:08.141137 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a58658-4fa9-4171-abc8-11d3cbd57a1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:30:08.142301 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a58658-4fa9-4171-abc8-11d3cbd57a1a admin admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:30:08.142691 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a58658-4fa9-4171-abc8-11d3cbd57a1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:30:08.143036 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a58658-4fa9-4171-abc8-11d3cbd57a1a admin admin] PATH_INFO: `/v3/projects` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:30:08.144603 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a58658-4fa9-4171-abc8-11d3cbd57a1a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:30:08.147287 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a58658-4fa9-4171-abc8-11d3cbd57a1a admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:30:08.204126 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1427/2849] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 31 00:30:08 2022] POST /identity/v3/projects => generated 381 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:30:08.210497 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798c4949-b7b3-4649-ba62-f9e8d6de6d75 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:30:08.231537 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798c4949-b7b3-4649-ba62-f9e8d6de6d75 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:30:08.365842 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6fa289-e86e-464f-a21f-4ed2ed0de5f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:30:08.367025 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6fa289-e86e-464f-a21f-4ed2ed0de5f8 admin admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:30:08.367547 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6fa289-e86e-464f-a21f-4ed2ed0de5f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:30:08.368120 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6fa289-e86e-464f-a21f-4ed2ed0de5f8 admin admin] PATH_INFO: `/v3/users` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:30:08.369135 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6fa289-e86e-464f-a21f-4ed2ed0de5f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:30:08.371993 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6fa289-e86e-464f-a21f-4ed2ed0de5f8 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:30:08.402303 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1423/2850] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 31 00:30:08 2022] POST /identity/v3/users => generated 297 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:30:08.406675 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a58658-4fa9-4171-abc8-11d3cbd57a1a admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:30:08.418560 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a58658-4fa9-4171-abc8-11d3cbd57a1a admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:30:08.430983 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7425984f-c04f-4900-995c-5c6b94b7327a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:30:08.431659 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7425984f-c04f-4900-995c-5c6b94b7327a admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:30:08.431996 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7425984f-c04f-4900-995c-5c6b94b7327a admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:30:08.432220 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7425984f-c04f-4900-995c-5c6b94b7327a admin admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:30:08.433002 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7425984f-c04f-4900-995c-5c6b94b7327a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:30:08.434550 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7425984f-c04f-4900-995c-5c6b94b7327a admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:30:08.450522 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1428/2851] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 00:30:08 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:30:08.455331 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6fa289-e86e-464f-a21f-4ed2ed0de5f8 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:30:08.468015 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6fa289-e86e-464f-a21f-4ed2ed0de5f8 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:30:08.473411 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3761c4db-0456-4e47-ac8b-b20edf2bef60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:30:08.474196 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3761c4db-0456-4e47-ac8b-b20edf2bef60 admin admin] REQUEST_METHOD: `PUT` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:30:08.474542 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3761c4db-0456-4e47-ac8b-b20edf2bef60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:30:08.475145 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3761c4db-0456-4e47-ac8b-b20edf2bef60 admin admin] PATH_INFO: `/v3/projects/5348356a3bcd4c60b15a489fb46dee30/users/b8d4934fcfe44503a3b9a787fe6f9ba8/roles/12f6817f9aaa4e2bb477095a6bed5d0f` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:30:08.503108 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3761c4db-0456-4e47-ac8b-b20edf2bef60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5348356a3bcd4c60b15a489fb46dee30, user_id=b8d4934fcfe44503a3b9a787fe6f9ba8, role_id=12f6817f9aaa4e2bb477095a6bed5d0f)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:30:08.508896 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3761c4db-0456-4e47-ac8b-b20edf2bef60 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:30:08.529110 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1424/2852] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 00:30:08 2022] PUT /identity/v3/projects/5348356a3bcd4c60b15a489fb46dee30/users/b8d4934fcfe44503a3b9a787fe6f9ba8/roles/12f6817f9aaa4e2bb477095a6bed5d0f => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:30:08.532945 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7425984f-c04f-4900-995c-5c6b94b7327a admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:30:08.545785 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7425984f-c04f-4900-995c-5c6b94b7327a admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:30:08.630238 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8e8a41-49b5-44b0-ac03-f0e855c74092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:30:08.631332 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8e8a41-49b5-44b0-ac03-f0e855c74092 admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:30:08.632543 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8e8a41-49b5-44b0-ac03-f0e855c74092 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:30:08.633897 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8e8a41-49b5-44b0-ac03-f0e855c74092 admin admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:30:08.635063 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8e8a41-49b5-44b0-ac03-f0e855c74092 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:30:08.637139 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8e8a41-49b5-44b0-ac03-f0e855c74092 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:30:08.655840 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1429/2853] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 00:30:08 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:30:08.663621 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3761c4db-0456-4e47-ac8b-b20edf2bef60 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:30:08.676069 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3761c4db-0456-4e47-ac8b-b20edf2bef60 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:30:08.680928 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ea3b08-e030-4370-a86e-7158f1c0e84d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:30:08.681774 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ea3b08-e030-4370-a86e-7158f1c0e84d admin admin] REQUEST_METHOD: `PUT` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:30:08.682047 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ea3b08-e030-4370-a86e-7158f1c0e84d admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:30:08.682381 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ea3b08-e030-4370-a86e-7158f1c0e84d admin admin] PATH_INFO: `/v3/projects/5348356a3bcd4c60b15a489fb46dee30/users/b8d4934fcfe44503a3b9a787fe6f9ba8/roles/12f6817f9aaa4e2bb477095a6bed5d0f` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:30:08.684799 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ea3b08-e030-4370-a86e-7158f1c0e84d admin admin] RBAC: Authorizing `identity:create_grant(project_id=5348356a3bcd4c60b15a489fb46dee30, user_id=b8d4934fcfe44503a3b9a787fe6f9ba8, role_id=12f6817f9aaa4e2bb477095a6bed5d0f)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:30:08.687489 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ea3b08-e030-4370-a86e-7158f1c0e84d admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:30:08.712818 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1425/2854] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 00:30:08 2022] PUT /identity/v3/projects/5348356a3bcd4c60b15a489fb46dee30/users/b8d4934fcfe44503a3b9a787fe6f9ba8/roles/12f6817f9aaa4e2bb477095a6bed5d0f => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:30:08.727985 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d95e301-7332-42b2-bf51-84b565bc3294 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:30:08.728748 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d95e301-7332-42b2-bf51-84b565bc3294 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:30:08.730112 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d95e301-7332-42b2-bf51-84b565bc3294 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:30:08.797256 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-1d95e301-7332-42b2-bf51-84b565bc3294 None None] MFA Rules not processed for user `b8d4934fcfe44503a3b9a787fe6f9ba8`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:30:08.798756 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-1d95e301-7332-42b2-bf51-84b565bc3294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:30:08.866007 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:30:08.948485 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1430/2855] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:30:08 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:30:08.960567 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ea3b08-e030-4370-a86e-7158f1c0e84d admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:30:08.981037 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:30:09.053089 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ea3b08-e030-4370-a86e-7158f1c0e84d admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:30:09.058251 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d77117e-0355-4355-8a03-ce60257709c2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beecda6e9feb400288618745c784989f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:30:09.059667 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d77117e-0355-4355-8a03-ce60257709c2 service cinder] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:30:09.059942 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d77117e-0355-4355-8a03-ce60257709c2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:30:09.060248 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d77117e-0355-4355-8a03-ce60257709c2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:30:09.073136 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d77117e-0355-4355-8a03-ce60257709c2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:30:09.074600 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d77117e-0355-4355-8a03-ce60257709c2 service cinder] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:30:09.086360 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1426/2856] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:30:08 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:30:09.463407 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168f75e0-8a0e-42ac-aadf-56a9063ba2b2 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:30:09.464147 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168f75e0-8a0e-42ac-aadf-56a9063ba2b2 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:30:09.464744 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168f75e0-8a0e-42ac-aadf-56a9063ba2b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:30:09.550510 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-168f75e0-8a0e-42ac-aadf-56a9063ba2b2 None None] MFA Rules not processed for user `4f5ea3b457d546b0b9c362085a90e2ed`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:30:09.552328 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-168f75e0-8a0e-42ac-aadf-56a9063ba2b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:30:09.674022 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1431/2857] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:30:09 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:30:09.686197 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d77117e-0355-4355-8a03-ce60257709c2 service cinder] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:30:09.843425 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d77117e-0355-4355-8a03-ce60257709c2 service cinder] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:30:09.850044 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edad5461-273c-4ae0-a469-437107ec53e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:30:09.851556 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edad5461-273c-4ae0-a469-437107ec53e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:30:09.851556 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edad5461-273c-4ae0-a469-437107ec53e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:30:09.851556 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edad5461-273c-4ae0-a469-437107ec53e4 admin admin] PATH_INFO: `/v3/users/fb342e5832824055905e959777bdbb5d` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:30:09.852864 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edad5461-273c-4ae0-a469-437107ec53e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb342e5832824055905e959777bdbb5d)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:30:09.855630 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edad5461-273c-4ae0-a469-437107ec53e4 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:30:09.926749 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-edad5461-273c-4ae0-a469-437107ec53e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb342e5832824055905e959777bdbb5d'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:30:09.943525 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-edad5461-273c-4ae0-a469-437107ec53e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb342e5832824055905e959777bdbb5d'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:30:09.957860 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-edad5461-273c-4ae0-a469-437107ec53e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb342e5832824055905e959777bdbb5d'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:30:09.995689 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-edad5461-273c-4ae0-a469-437107ec53e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb342e5832824055905e959777bdbb5d'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:30:09.996746 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-edad5461-273c-4ae0-a469-437107ec53e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb342e5832824055905e959777bdbb5d'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:30:10.012911 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1427/2858] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 31 00:30:09 2022] DELETE /identity/v3/users/fb342e5832824055905e959777bdbb5d => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:30:10.014541 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e47cb3a-9da5-4cad-a3ef-d58f5295a42e None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:30:10.014843 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e47cb3a-9da5-4cad-a3ef-d58f5295a42e None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:30:10.015109 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e47cb3a-9da5-4cad-a3ef-d58f5295a42e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:30:10.054407 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-3e47cb3a-9da5-4cad-a3ef-d58f5295a42e None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:30:10.055784 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-3e47cb3a-9da5-4cad-a3ef-d58f5295a42e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:30:10.184077 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1432/2859] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:30:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:30:10.202035 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edad5461-273c-4ae0-a469-437107ec53e4 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:30:10.203825 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-edad5461-273c-4ae0-a469-437107ec53e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:30:10.268281 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:30:10.298907 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edad5461-273c-4ae0-a469-437107ec53e4 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:30:10.303865 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09acfd85-4970-4342-b0e7-e9eecc7c6cd7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'daae792cd11d4c4ca7aae0558998aced', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:30:10.304607 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09acfd85-4970-4342-b0e7-e9eecc7c6cd7 service neutron] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:30:10.304944 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09acfd85-4970-4342-b0e7-e9eecc7c6cd7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:30:10.305319 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09acfd85-4970-4342-b0e7-e9eecc7c6cd7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:30:10.317039 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09acfd85-4970-4342-b0e7-e9eecc7c6cd7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:30:10.318939 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09acfd85-4970-4342-b0e7-e9eecc7c6cd7 service neutron] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:30:10.332078 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1428/2860] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:30:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:30:10.778182 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e47cb3a-9da5-4cad-a3ef-d58f5295a42e None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:30:10.781792 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-3e47cb3a-9da5-4cad-a3ef-d58f5295a42e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:30:10.805222 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e47cb3a-9da5-4cad-a3ef-d58f5295a42e None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:30:10.817283 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398b36b7-11ca-4572-b163-acc9adadd13a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:30:10.818638 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398b36b7-11ca-4572-b163-acc9adadd13a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:30:10.819196 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398b36b7-11ca-4572-b163-acc9adadd13a admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:30:10.819841 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398b36b7-11ca-4572-b163-acc9adadd13a admin admin] PATH_INFO: `/v3/projects/f4b9396ad1f047c2bb518e24794b5d23` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:30:10.822649 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398b36b7-11ca-4572-b163-acc9adadd13a admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4b9396ad1f047c2bb518e24794b5d23)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:30:10.824948 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398b36b7-11ca-4572-b163-acc9adadd13a admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:30:10.898203 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-398b36b7-11ca-4572-b163-acc9adadd13a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4b9396ad1f047c2bb518e24794b5d23', 'request_id': 'req-398b36b7-11ca-4572-b163-acc9adadd13a'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:30:10.909573 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-398b36b7-11ca-4572-b163-acc9adadd13a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4b9396ad1f047c2bb518e24794b5d23', 'request_id': 'req-398b36b7-11ca-4572-b163-acc9adadd13a'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:30:10.919093 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-398b36b7-11ca-4572-b163-acc9adadd13a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4b9396ad1f047c2bb518e24794b5d23', 'request_id': 'req-398b36b7-11ca-4572-b163-acc9adadd13a'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:30:10.924063 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:30:10.942025 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-398b36b7-11ca-4572-b163-acc9adadd13a admin admin] The token cache is being invalidate because project f4b9396ad1f047c2bb518e24794b5d23 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:30:10.943325 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-398b36b7-11ca-4572-b163-acc9adadd13a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:30:10.945131 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-398b36b7-11ca-4572-b163-acc9adadd13a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:30:10.948336 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1433/2861] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 31 00:30:10 2022] DELETE /identity/v3/projects/f4b9396ad1f047c2bb518e24794b5d23 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:30:10.954761 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09acfd85-4970-4342-b0e7-e9eecc7c6cd7 service neutron] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:30:10.970239 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09acfd85-4970-4342-b0e7-e9eecc7c6cd7 service neutron] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:30:11.053459 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f21925c-bd6b-40a0-b814-63e06cddabd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:30:11.054256 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f21925c-bd6b-40a0-b814-63e06cddabd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:30:11.054581 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f21925c-bd6b-40a0-b814-63e06cddabd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:30:11.054907 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f21925c-bd6b-40a0-b814-63e06cddabd6 admin admin] PATH_INFO: `/v3/users/b8d4934fcfe44503a3b9a787fe6f9ba8` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:30:11.057513 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f21925c-bd6b-40a0-b814-63e06cddabd6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8d4934fcfe44503a3b9a787fe6f9ba8)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:30:11.059660 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f21925c-bd6b-40a0-b814-63e06cddabd6 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:30:11.125068 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-9f21925c-bd6b-40a0-b814-63e06cddabd6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8d4934fcfe44503a3b9a787fe6f9ba8'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:30:11.134123 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-9f21925c-bd6b-40a0-b814-63e06cddabd6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8d4934fcfe44503a3b9a787fe6f9ba8'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:30:11.152052 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-9f21925c-bd6b-40a0-b814-63e06cddabd6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8d4934fcfe44503a3b9a787fe6f9ba8'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:30:11.177213 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-9f21925c-bd6b-40a0-b814-63e06cddabd6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8d4934fcfe44503a3b9a787fe6f9ba8'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:30:11.178306 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-9f21925c-bd6b-40a0-b814-63e06cddabd6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8d4934fcfe44503a3b9a787fe6f9ba8'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:30:11.191006 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1429/2862] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 31 00:30:10 2022] DELETE /identity/v3/users/b8d4934fcfe44503a3b9a787fe6f9ba8 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:30:11.638954 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398b36b7-11ca-4572-b163-acc9adadd13a admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:30:11.641415 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-398b36b7-11ca-4572-b163-acc9adadd13a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:30:11.663365 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398b36b7-11ca-4572-b163-acc9adadd13a admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:30:11.759290 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3560e8-75d6-4562-8c43-538d53930e97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:30:11.760184 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3560e8-75d6-4562-8c43-538d53930e97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:30:11.760710 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3560e8-75d6-4562-8c43-538d53930e97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:30:11.761218 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3560e8-75d6-4562-8c43-538d53930e97 admin admin] PATH_INFO: `/v3/projects/5348356a3bcd4c60b15a489fb46dee30` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:30:11.763307 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3560e8-75d6-4562-8c43-538d53930e97 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5348356a3bcd4c60b15a489fb46dee30)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:30:11.767057 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3560e8-75d6-4562-8c43-538d53930e97 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:30:11.846234 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-db3560e8-75d6-4562-8c43-538d53930e97 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5348356a3bcd4c60b15a489fb46dee30', 'request_id': 'req-db3560e8-75d6-4562-8c43-538d53930e97'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:30:11.855418 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-db3560e8-75d6-4562-8c43-538d53930e97 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5348356a3bcd4c60b15a489fb46dee30', 'request_id': 'req-db3560e8-75d6-4562-8c43-538d53930e97'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:30:11.863253 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-db3560e8-75d6-4562-8c43-538d53930e97 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5348356a3bcd4c60b15a489fb46dee30', 'request_id': 'req-db3560e8-75d6-4562-8c43-538d53930e97'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:30:11.878952 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-db3560e8-75d6-4562-8c43-538d53930e97 admin admin] The token cache is being invalidate because project 5348356a3bcd4c60b15a489fb46dee30 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:30:11.879240 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-db3560e8-75d6-4562-8c43-538d53930e97 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:30:11.879947 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-db3560e8-75d6-4562-8c43-538d53930e97 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:30:11.881624 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1434/2863] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 31 00:30:11 2022] DELETE /identity/v3/projects/5348356a3bcd4c60b15a489fb46dee30 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:30:11.887787 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dee54b-fe5d-4a61-8470-c228a34d42eb None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:30:11.888300 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dee54b-fe5d-4a61-8470-c228a34d42eb None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:30:11.888637 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dee54b-fe5d-4a61-8470-c228a34d42eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:30:11.911249 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-b4dee54b-fe5d-4a61-8470-c228a34d42eb None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:30:11.912633 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-b4dee54b-fe5d-4a61-8470-c228a34d42eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:30:12.003946 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:30:12.031522 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1430/2864] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:30:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:30:12.038663 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0681dfc-c1fa-46c4-b621-ff097630b279 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:30:12.039140 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0681dfc-c1fa-46c4-b621-ff097630b279 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:30:12.039539 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0681dfc-c1fa-46c4-b621-ff097630b279 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:30:12.074073 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-a0681dfc-c1fa-46c4-b621-ff097630b279 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:30:12.076107 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-a0681dfc-c1fa-46c4-b621-ff097630b279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:30:12.089566 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1435/2865] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:30:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:30:12.096727 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dee54b-fe5d-4a61-8470-c228a34d42eb None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:30:12.114979 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dee54b-fe5d-4a61-8470-c228a34d42eb None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:30:12.123802 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a5835f-292b-4371-a350-fa915316ee25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:30:12.124914 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a5835f-292b-4371-a350-fa915316ee25 admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:30:12.125422 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a5835f-292b-4371-a350-fa915316ee25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:30:12.125913 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a5835f-292b-4371-a350-fa915316ee25 admin admin] PATH_INFO: `/v3/domains` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:30:12.127144 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a5835f-292b-4371-a350-fa915316ee25 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:30:12.127696 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a5835f-292b-4371-a350-fa915316ee25 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:30:12.131105 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a5835f-292b-4371-a350-fa915316ee25 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:30:12.154813 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1431/2866] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 31 00:30:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:30:12.161682 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0681dfc-c1fa-46c4-b621-ff097630b279 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:30:12.176694 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0681dfc-c1fa-46c4-b621-ff097630b279 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:30:12.182336 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8eda944-9ed0-49ae-b63c-af1f70b32c31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:30:12.183316 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eda944-9ed0-49ae-b63c-af1f70b32c31 admin admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:30:12.183316 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eda944-9ed0-49ae-b63c-af1f70b32c31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:30:12.183625 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eda944-9ed0-49ae-b63c-af1f70b32c31 admin admin] PATH_INFO: `/v3/projects` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:30:12.184246 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8eda944-9ed0-49ae-b63c-af1f70b32c31 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:30:12.186242 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8eda944-9ed0-49ae-b63c-af1f70b32c31 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:30:12.222727 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1436/2867] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 31 00:30:12 2022] POST /identity/v3/projects => generated 359 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:30:12.227972 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a5835f-292b-4371-a350-fa915316ee25 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:30:12.248136 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a5835f-292b-4371-a350-fa915316ee25 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:30:12.339983 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5d254b-a170-40cb-bacd-b210bf3d79c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:30:12.340704 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5d254b-a170-40cb-bacd-b210bf3d79c8 admin admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:30:12.341190 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5d254b-a170-40cb-bacd-b210bf3d79c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:30:12.341630 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5d254b-a170-40cb-bacd-b210bf3d79c8 admin admin] PATH_INFO: `/v3/users` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:30:12.342527 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5d254b-a170-40cb-bacd-b210bf3d79c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:30:12.344997 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5d254b-a170-40cb-bacd-b210bf3d79c8 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:30:12.375037 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1432/2868] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 31 00:30:12 2022] POST /identity/v3/users => generated 280 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:30:12.380401 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8eda944-9ed0-49ae-b63c-af1f70b32c31 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:30:12.404841 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8eda944-9ed0-49ae-b63c-af1f70b32c31 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:30:12.413146 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afa2a94-1602-4fa6-ad8d-5eb64703e31f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:30:12.414154 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afa2a94-1602-4fa6-ad8d-5eb64703e31f admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:30:12.414696 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afa2a94-1602-4fa6-ad8d-5eb64703e31f admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:30:12.415827 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afa2a94-1602-4fa6-ad8d-5eb64703e31f admin admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:30:12.417095 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afa2a94-1602-4fa6-ad8d-5eb64703e31f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:30:12.420250 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afa2a94-1602-4fa6-ad8d-5eb64703e31f admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:30:12.441615 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1437/2869] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 00:30:12 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:30:12.447256 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5d254b-a170-40cb-bacd-b210bf3d79c8 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:30:12.460643 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5d254b-a170-40cb-bacd-b210bf3d79c8 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:30:12.468890 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e26e67f-8101-4f44-bbf8-130a9896cfa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:30:12.469630 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e26e67f-8101-4f44-bbf8-130a9896cfa9 admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:30:12.469914 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e26e67f-8101-4f44-bbf8-130a9896cfa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:30:12.470193 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e26e67f-8101-4f44-bbf8-130a9896cfa9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:30:12.470859 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e26e67f-8101-4f44-bbf8-130a9896cfa9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:30:12.472670 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e26e67f-8101-4f44-bbf8-130a9896cfa9 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:30:12.491505 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1433/2870] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 00:30:12 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 00:30:12.496558 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afa2a94-1602-4fa6-ad8d-5eb64703e31f admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:30:12.514726 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afa2a94-1602-4fa6-ad8d-5eb64703e31f admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:30:12.522853 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a559040a-e2d1-44d1-b286-dc7b5214a923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:30:12.523907 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a559040a-e2d1-44d1-b286-dc7b5214a923 admin admin] REQUEST_METHOD: `PUT` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:30:12.524441 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a559040a-e2d1-44d1-b286-dc7b5214a923 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:30:12.524869 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a559040a-e2d1-44d1-b286-dc7b5214a923 admin admin] PATH_INFO: `/v3/projects/2cf6d670769a4beebc59ddbb6fcff382/users/44254e170e9840978cbb711df2d9af0e/roles/fdad79ffbcbb4fa380dc9cf7dd108618` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:30:12.548759 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a559040a-e2d1-44d1-b286-dc7b5214a923 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2cf6d670769a4beebc59ddbb6fcff382, user_id=44254e170e9840978cbb711df2d9af0e, role_id=fdad79ffbcbb4fa380dc9cf7dd108618)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:30:12.553093 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a559040a-e2d1-44d1-b286-dc7b5214a923 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:30:12.575158 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1438/2871] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 00:30:12 2022] PUT /identity/v3/projects/2cf6d670769a4beebc59ddbb6fcff382/users/44254e170e9840978cbb711df2d9af0e/roles/fdad79ffbcbb4fa380dc9cf7dd108618 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:30:12.660574 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc2cf91-b70a-483e-9974-0e8244b2b281 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:30:12.661876 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc2cf91-b70a-483e-9974-0e8244b2b281 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:30:12.662548 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc2cf91-b70a-483e-9974-0e8244b2b281 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:30:12.702124 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-cbc2cf91-b70a-483e-9974-0e8244b2b281 None None] MFA Rules not processed for user `44254e170e9840978cbb711df2d9af0e`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:30:12.703391 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-cbc2cf91-b70a-483e-9974-0e8244b2b281 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:30:12.815383 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1434/2872] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:30:12 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:30:12.877208 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a559040a-e2d1-44d1-b286-dc7b5214a923 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:30:12.880695 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-a559040a-e2d1-44d1-b286-dc7b5214a923 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:30:12.920344 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:30:12.961630 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a559040a-e2d1-44d1-b286-dc7b5214a923 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:30:12.966834 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274c96e5-00f5-490c-8b2a-c37639946271 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beecda6e9feb400288618745c784989f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:30:12.967478 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274c96e5-00f5-490c-8b2a-c37639946271 service cinder] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:30:12.967760 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274c96e5-00f5-490c-8b2a-c37639946271 service cinder] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:30:12.968033 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274c96e5-00f5-490c-8b2a-c37639946271 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:30:12.989203 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274c96e5-00f5-490c-8b2a-c37639946271 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:30:12.989203 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274c96e5-00f5-490c-8b2a-c37639946271 service cinder] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:30:13.003459 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1439/2873] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:30:12 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:30:13.020181 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc2cf91-b70a-483e-9974-0e8244b2b281 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:30:13.106252 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:30:13.123720 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc2cf91-b70a-483e-9974-0e8244b2b281 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:30:13.132105 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7215af-d0cc-46e6-9365-a00859021047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:30:13.133605 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7215af-d0cc-46e6-9365-a00859021047 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:30:13.134755 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7215af-d0cc-46e6-9365-a00859021047 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:30:13.135274 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7215af-d0cc-46e6-9365-a00859021047 admin admin] PATH_INFO: `/v3/users/44254e170e9840978cbb711df2d9af0e` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:30:13.137502 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7215af-d0cc-46e6-9365-a00859021047 admin admin] RBAC: Authorizing `identity:delete_user(user_id=44254e170e9840978cbb711df2d9af0e)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:30:13.142362 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7215af-d0cc-46e6-9365-a00859021047 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:30:13.214944 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-dc7215af-d0cc-46e6-9365-a00859021047 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44254e170e9840978cbb711df2d9af0e'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:30:13.226961 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-dc7215af-d0cc-46e6-9365-a00859021047 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44254e170e9840978cbb711df2d9af0e'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:30:13.241452 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-dc7215af-d0cc-46e6-9365-a00859021047 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44254e170e9840978cbb711df2d9af0e'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:30:13.258034 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-dc7215af-d0cc-46e6-9365-a00859021047 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44254e170e9840978cbb711df2d9af0e'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:30:13.259384 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-dc7215af-d0cc-46e6-9365-a00859021047 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44254e170e9840978cbb711df2d9af0e'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:30:13.266939 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1435/2874] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 31 00:30:13 2022] DELETE /identity/v3/users/44254e170e9840978cbb711df2d9af0e => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:30:13.275269 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae191516-738b-4e25-9b99-c633de2311bd None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:30:13.275805 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae191516-738b-4e25-9b99-c633de2311bd None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:30:13.276371 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae191516-738b-4e25-9b99-c633de2311bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:30:13.312402 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-ae191516-738b-4e25-9b99-c633de2311bd None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:30:13.315199 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-ae191516-738b-4e25-9b99-c633de2311bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:30:13.405562 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1440/2875] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:30:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:30:13.417531 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7215af-d0cc-46e6-9365-a00859021047 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:30:13.419174 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-dc7215af-d0cc-46e6-9365-a00859021047 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:30:13.490774 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7215af-d0cc-46e6-9365-a00859021047 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:30:13.495666 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8a325c-1ee0-4309-ba32-2d9cb50103b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'daae792cd11d4c4ca7aae0558998aced', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:30:13.496347 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8a325c-1ee0-4309-ba32-2d9cb50103b6 service neutron] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:30:13.496629 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8a325c-1ee0-4309-ba32-2d9cb50103b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:30:13.496902 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8a325c-1ee0-4309-ba32-2d9cb50103b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:30:13.509784 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8a325c-1ee0-4309-ba32-2d9cb50103b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:30:13.511264 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8a325c-1ee0-4309-ba32-2d9cb50103b6 service neutron] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:30:13.522371 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1436/2876] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:30:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 00:30:13.933310 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae191516-738b-4e25-9b99-c633de2311bd None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:30:13.934891 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-ae191516-738b-4e25-9b99-c633de2311bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:30:13.948668 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae191516-738b-4e25-9b99-c633de2311bd None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:30:13.954005 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1307422-4cda-4ec9-9ee7-56f6ab5931a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:30:13.954674 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1307422-4cda-4ec9-9ee7-56f6ab5931a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:30:13.954961 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1307422-4cda-4ec9-9ee7-56f6ab5931a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:30:13.955233 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1307422-4cda-4ec9-9ee7-56f6ab5931a9 admin admin] PATH_INFO: `/v3/projects/2cf6d670769a4beebc59ddbb6fcff382` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:30:13.956789 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1307422-4cda-4ec9-9ee7-56f6ab5931a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2cf6d670769a4beebc59ddbb6fcff382)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:30:13.959309 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1307422-4cda-4ec9-9ee7-56f6ab5931a9 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:30:14.033292 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-e1307422-4cda-4ec9-9ee7-56f6ab5931a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2cf6d670769a4beebc59ddbb6fcff382', 'request_id': 'req-e1307422-4cda-4ec9-9ee7-56f6ab5931a9'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:30:14.040817 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-e1307422-4cda-4ec9-9ee7-56f6ab5931a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2cf6d670769a4beebc59ddbb6fcff382', 'request_id': 'req-e1307422-4cda-4ec9-9ee7-56f6ab5931a9'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:30:14.048245 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-e1307422-4cda-4ec9-9ee7-56f6ab5931a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2cf6d670769a4beebc59ddbb6fcff382', 'request_id': 'req-e1307422-4cda-4ec9-9ee7-56f6ab5931a9'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:30:14.063576 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-e1307422-4cda-4ec9-9ee7-56f6ab5931a9 admin admin] The token cache is being invalidate because project 2cf6d670769a4beebc59ddbb6fcff382 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:30:14.063877 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-e1307422-4cda-4ec9-9ee7-56f6ab5931a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:30:14.064605 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-e1307422-4cda-4ec9-9ee7-56f6ab5931a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:30:14.066181 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1441/2877] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 31 00:30:13 2022] DELETE /identity/v3/projects/2cf6d670769a4beebc59ddbb6fcff382 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:30:14.072229 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8887d09c-b7f4-4c87-9cb7-1ef9ff7305c5 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:30:14.072919 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8887d09c-b7f4-4c87-9cb7-1ef9ff7305c5 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:30:14.072919 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8887d09c-b7f4-4c87-9cb7-1ef9ff7305c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:30:14.095322 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-8887d09c-b7f4-4c87-9cb7-1ef9ff7305c5 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:30:14.096597 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-8887d09c-b7f4-4c87-9cb7-1ef9ff7305c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:30:14.199467 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1437/2878] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:30:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:30:14.209658 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef7abfe-a858-40b1-9799-3bdba1be2d18 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:30:14.210223 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef7abfe-a858-40b1-9799-3bdba1be2d18 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:30:14.210795 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef7abfe-a858-40b1-9799-3bdba1be2d18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:30:14.235833 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-4ef7abfe-a858-40b1-9799-3bdba1be2d18 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:30:14.237623 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-4ef7abfe-a858-40b1-9799-3bdba1be2d18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:30:14.255525 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1442/2879] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:30:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:30:14.263830 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8887d09c-b7f4-4c87-9cb7-1ef9ff7305c5 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:30:14.277641 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8887d09c-b7f4-4c87-9cb7-1ef9ff7305c5 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:30:14.282553 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeda019b-5685-4a88-8176-1386cd385366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:30:14.283191 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeda019b-5685-4a88-8176-1386cd385366 admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:30:14.283472 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeda019b-5685-4a88-8176-1386cd385366 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:30:14.283741 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeda019b-5685-4a88-8176-1386cd385366 admin admin] PATH_INFO: `/v3/domains` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:30:14.284434 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeda019b-5685-4a88-8176-1386cd385366 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:30:14.284736 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeda019b-5685-4a88-8176-1386cd385366 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:30:14.286416 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeda019b-5685-4a88-8176-1386cd385366 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:30:14.299972 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1438/2880] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 31 00:30:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:30:14.304863 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef7abfe-a858-40b1-9799-3bdba1be2d18 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:30:14.315322 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef7abfe-a858-40b1-9799-3bdba1be2d18 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:30:14.320561 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e319b0-c1d9-4868-a7c3-0b86ddb8c383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:30:14.321212 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e319b0-c1d9-4868-a7c3-0b86ddb8c383 admin admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:30:14.321921 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e319b0-c1d9-4868-a7c3-0b86ddb8c383 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:30:14.322202 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e319b0-c1d9-4868-a7c3-0b86ddb8c383 admin admin] PATH_INFO: `/v3/projects` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:30:14.322869 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e319b0-c1d9-4868-a7c3-0b86ddb8c383 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:30:14.324925 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e319b0-c1d9-4868-a7c3-0b86ddb8c383 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:30:14.359571 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1443/2881] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 31 00:30:14 2022] POST /identity/v3/projects => generated 373 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:30:14.363734 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeda019b-5685-4a88-8176-1386cd385366 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:30:14.369678 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:30:14.377829 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeda019b-5685-4a88-8176-1386cd385366 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:30:14.466223 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea93ee34-e4d2-4b48-96a9-cf5b7df2ab5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:30:14.467311 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea93ee34-e4d2-4b48-96a9-cf5b7df2ab5a admin admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:30:14.467791 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea93ee34-e4d2-4b48-96a9-cf5b7df2ab5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:30:14.469156 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea93ee34-e4d2-4b48-96a9-cf5b7df2ab5a admin admin] PATH_INFO: `/v3/users` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:30:14.470027 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea93ee34-e4d2-4b48-96a9-cf5b7df2ab5a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:30:14.472099 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea93ee34-e4d2-4b48-96a9-cf5b7df2ab5a admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:30:14.500476 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1439/2882] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 31 00:30:14 2022] POST /identity/v3/users => generated 287 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:30:14.505226 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e319b0-c1d9-4868-a7c3-0b86ddb8c383 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:30:14.517051 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e319b0-c1d9-4868-a7c3-0b86ddb8c383 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:30:14.523058 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c550af8-7a4e-4014-b820-4fbd70fad1ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:30:14.523693 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c550af8-7a4e-4014-b820-4fbd70fad1ea admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:30:14.523976 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c550af8-7a4e-4014-b820-4fbd70fad1ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:30:14.524298 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c550af8-7a4e-4014-b820-4fbd70fad1ea admin admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:30:14.525532 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c550af8-7a4e-4014-b820-4fbd70fad1ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:30:14.527348 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c550af8-7a4e-4014-b820-4fbd70fad1ea admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:30:14.539149 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1444/2883] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 00:30:14 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 00:30:14.544480 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea93ee34-e4d2-4b48-96a9-cf5b7df2ab5a admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:30:14.555378 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea93ee34-e4d2-4b48-96a9-cf5b7df2ab5a admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:30:14.561060 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2661bfb-9976-4595-9ae0-276c9fec0cf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:30:14.561700 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2661bfb-9976-4595-9ae0-276c9fec0cf9 admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:30:14.561977 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2661bfb-9976-4595-9ae0-276c9fec0cf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:30:14.562249 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2661bfb-9976-4595-9ae0-276c9fec0cf9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:30:14.562904 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2661bfb-9976-4595-9ae0-276c9fec0cf9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:30:14.564622 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2661bfb-9976-4595-9ae0-276c9fec0cf9 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:30:14.577394 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1440/2884] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 00:30:14 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:30:14.582521 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c550af8-7a4e-4014-b820-4fbd70fad1ea admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:30:14.593995 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c550af8-7a4e-4014-b820-4fbd70fad1ea admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:30:14.599237 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bc08d1-3ac6-4392-8713-786f17015ca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:30:14.599927 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bc08d1-3ac6-4392-8713-786f17015ca4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:30:14.600245 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bc08d1-3ac6-4392-8713-786f17015ca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:30:14.600529 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bc08d1-3ac6-4392-8713-786f17015ca4 admin admin] PATH_INFO: `/v3/projects/7424ddb8497246979f7106db893f2cb2/users/fba885045bba46e1bd0e2dc0584eb2b9/roles/fdad79ffbcbb4fa380dc9cf7dd108618` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:30:14.606860 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:30:14.628844 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bc08d1-3ac6-4392-8713-786f17015ca4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7424ddb8497246979f7106db893f2cb2, user_id=fba885045bba46e1bd0e2dc0584eb2b9, role_id=fdad79ffbcbb4fa380dc9cf7dd108618)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:30:14.633121 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bc08d1-3ac6-4392-8713-786f17015ca4 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:30:14.657227 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1445/2885] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 00:30:14 2022] PUT /identity/v3/projects/7424ddb8497246979f7106db893f2cb2/users/fba885045bba46e1bd0e2dc0584eb2b9/roles/fdad79ffbcbb4fa380dc9cf7dd108618 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:30:14.672419 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ab4604-7f1b-4727-a8ce-630411b9d291 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:30:14.672823 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ab4604-7f1b-4727-a8ce-630411b9d291 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:30:14.673180 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ab4604-7f1b-4727-a8ce-630411b9d291 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:30:14.712034 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-07ab4604-7f1b-4727-a8ce-630411b9d291 None None] MFA Rules not processed for user `fba885045bba46e1bd0e2dc0584eb2b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:30:14.713574 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-07ab4604-7f1b-4727-a8ce-630411b9d291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:30:14.791402 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1441/2886] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:30:14 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:30:14.803917 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bc08d1-3ac6-4392-8713-786f17015ca4 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:30:14.807022 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-d0bc08d1-3ac6-4392-8713-786f17015ca4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:30:14.892588 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bc08d1-3ac6-4392-8713-786f17015ca4 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:30:14.897181 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6eb53d6-9654-4647-b89b-7bf782fd26ba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beecda6e9feb400288618745c784989f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:30:14.897940 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6eb53d6-9654-4647-b89b-7bf782fd26ba service cinder] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:30:14.898217 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6eb53d6-9654-4647-b89b-7bf782fd26ba service cinder] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:30:14.898496 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6eb53d6-9654-4647-b89b-7bf782fd26ba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:30:14.909522 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6eb53d6-9654-4647-b89b-7bf782fd26ba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:30:14.911018 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6eb53d6-9654-4647-b89b-7bf782fd26ba service cinder] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:30:14.922976 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1446/2887] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:30:14 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:30:16.886443 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce83ddb6-5e32-46d7-8ba0-38513b626767 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:30:16.887979 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce83ddb6-5e32-46d7-8ba0-38513b626767 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:30:16.889992 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce83ddb6-5e32-46d7-8ba0-38513b626767 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:30:16.918533 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-ce83ddb6-5e32-46d7-8ba0-38513b626767 None None] MFA Rules not processed for user `601aa9e547aa4d42bef6753b26f48eaa`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:30:16.920194 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-ce83ddb6-5e32-46d7-8ba0-38513b626767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:30:17.037021 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1442/2888] 10.222.0.47 () {58 vars in 967 bytes} [Wed Aug 31 00:30:16 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:30:17.118790 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6eb53d6-9654-4647-b89b-7bf782fd26ba service cinder] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:30:17.120973 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-e6eb53d6-9654-4647-b89b-7bf782fd26ba service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:30:17.294550 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6eb53d6-9654-4647-b89b-7bf782fd26ba service cinder] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:30:17.307319 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a2ccec-5135-4c4d-8841-dd4f46917676 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffbfbf19509645f49dbf9566e447c8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:30:17.308648 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a2ccec-5135-4c4d-8841-dd4f46917676 service swift] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:30:17.309124 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a2ccec-5135-4c4d-8841-dd4f46917676 service swift] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:30:17.309622 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a2ccec-5135-4c4d-8841-dd4f46917676 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:30:17.328800 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a2ccec-5135-4c4d-8841-dd4f46917676 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:30:17.332682 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a2ccec-5135-4c4d-8841-dd4f46917676 service swift] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:30:17.352532 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1447/2889] 10.222.0.47 () {60 vars in 1384 bytes} [Wed Aug 31 00:30:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 00:30:19.024094 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce83ddb6-5e32-46d7-8ba0-38513b626767 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:30:19.054349 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:30:19.131764 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce83ddb6-5e32-46d7-8ba0-38513b626767 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:30:19.138899 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6648d8-bb37-4f0e-95b1-1ecb05fd81dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:30:19.139661 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6648d8-bb37-4f0e-95b1-1ecb05fd81dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:30:19.140008 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6648d8-bb37-4f0e-95b1-1ecb05fd81dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:30:19.140374 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6648d8-bb37-4f0e-95b1-1ecb05fd81dd admin admin] PATH_INFO: `/v3/users/fba885045bba46e1bd0e2dc0584eb2b9` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:30:19.141994 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6648d8-bb37-4f0e-95b1-1ecb05fd81dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=fba885045bba46e1bd0e2dc0584eb2b9)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:30:19.144243 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6648d8-bb37-4f0e-95b1-1ecb05fd81dd admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:30:19.214770 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-9c6648d8-bb37-4f0e-95b1-1ecb05fd81dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fba885045bba46e1bd0e2dc0584eb2b9'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:30:19.227126 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-9c6648d8-bb37-4f0e-95b1-1ecb05fd81dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fba885045bba46e1bd0e2dc0584eb2b9'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:30:19.252845 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-9c6648d8-bb37-4f0e-95b1-1ecb05fd81dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fba885045bba46e1bd0e2dc0584eb2b9'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:30:19.271098 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-9c6648d8-bb37-4f0e-95b1-1ecb05fd81dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fba885045bba46e1bd0e2dc0584eb2b9'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:30:19.272319 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-9c6648d8-bb37-4f0e-95b1-1ecb05fd81dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fba885045bba46e1bd0e2dc0584eb2b9'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:30:19.280401 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1443/2890] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 31 00:30:19 2022] DELETE /identity/v3/users/fba885045bba46e1bd0e2dc0584eb2b9 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:30:19.287743 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a1f69b-bb4e-44a9-ac00-ab1b2028a00f None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:30:19.288684 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a1f69b-bb4e-44a9-ac00-ab1b2028a00f None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:30:19.288933 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a1f69b-bb4e-44a9-ac00-ab1b2028a00f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:30:19.328431 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-d3a1f69b-bb4e-44a9-ac00-ab1b2028a00f None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:30:19.330238 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-d3a1f69b-bb4e-44a9-ac00-ab1b2028a00f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:30:19.460303 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1448/2891] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:30:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:30:19.474910 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6648d8-bb37-4f0e-95b1-1ecb05fd81dd admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:30:19.478438 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-9c6648d8-bb37-4f0e-95b1-1ecb05fd81dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:30:19.693644 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6648d8-bb37-4f0e-95b1-1ecb05fd81dd admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:30:19.701486 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b209681-cb7b-4d3f-9b56-d37769260f80 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'daae792cd11d4c4ca7aae0558998aced', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:30:19.702955 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b209681-cb7b-4d3f-9b56-d37769260f80 service neutron] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:30:19.703570 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b209681-cb7b-4d3f-9b56-d37769260f80 service neutron] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:30:19.704273 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b209681-cb7b-4d3f-9b56-d37769260f80 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:30:19.739300 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b209681-cb7b-4d3f-9b56-d37769260f80 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:30:19.741791 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b209681-cb7b-4d3f-9b56-d37769260f80 service neutron] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:30:19.766024 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1444/2892] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:30:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:30:21.074548 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a1f69b-bb4e-44a9-ac00-ab1b2028a00f None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:30:21.078964 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-d3a1f69b-bb4e-44a9-ac00-ab1b2028a00f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:30:21.108544 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a1f69b-bb4e-44a9-ac00-ab1b2028a00f None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:30:21.116301 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dc4319-a04d-45ee-8faf-47ac877dbea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:30:21.117711 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dc4319-a04d-45ee-8faf-47ac877dbea5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:30:21.119746 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dc4319-a04d-45ee-8faf-47ac877dbea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:30:21.120217 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dc4319-a04d-45ee-8faf-47ac877dbea5 admin admin] PATH_INFO: `/v3/projects/7424ddb8497246979f7106db893f2cb2` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:30:21.124835 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dc4319-a04d-45ee-8faf-47ac877dbea5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7424ddb8497246979f7106db893f2cb2)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:30:21.135236 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dc4319-a04d-45ee-8faf-47ac877dbea5 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:30:21.152143 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:30:21.206340 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-95dc4319-a04d-45ee-8faf-47ac877dbea5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7424ddb8497246979f7106db893f2cb2', 'request_id': 'req-95dc4319-a04d-45ee-8faf-47ac877dbea5'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:30:21.218067 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-95dc4319-a04d-45ee-8faf-47ac877dbea5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7424ddb8497246979f7106db893f2cb2', 'request_id': 'req-95dc4319-a04d-45ee-8faf-47ac877dbea5'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:30:21.225801 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-95dc4319-a04d-45ee-8faf-47ac877dbea5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7424ddb8497246979f7106db893f2cb2', 'request_id': 'req-95dc4319-a04d-45ee-8faf-47ac877dbea5'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:30:21.244395 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-95dc4319-a04d-45ee-8faf-47ac877dbea5 admin admin] The token cache is being invalidate because project 7424ddb8497246979f7106db893f2cb2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:30:21.244659 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-95dc4319-a04d-45ee-8faf-47ac877dbea5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:30:21.245360 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-95dc4319-a04d-45ee-8faf-47ac877dbea5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:30:21.246950 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1449/2893] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 31 00:30:21 2022] DELETE /identity/v3/projects/7424ddb8497246979f7106db893f2cb2 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:30:21.252429 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4d6ea1-0d08-42ea-b16e-14e46bf7f15c None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:30:21.253211 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4d6ea1-0d08-42ea-b16e-14e46bf7f15c None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:30:21.253211 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4d6ea1-0d08-42ea-b16e-14e46bf7f15c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:30:21.277756 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-3c4d6ea1-0d08-42ea-b16e-14e46bf7f15c None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:30:21.279031 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-3c4d6ea1-0d08-42ea-b16e-14e46bf7f15c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:30:21.333676 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:30:21.389928 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1445/2894] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:30:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:30:21.398217 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24293d18-d34e-4042-91de-8cf3d67a0923 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:30:21.398526 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24293d18-d34e-4042-91de-8cf3d67a0923 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:30:21.398770 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24293d18-d34e-4042-91de-8cf3d67a0923 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:30:21.425756 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-24293d18-d34e-4042-91de-8cf3d67a0923 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:30:21.427284 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-24293d18-d34e-4042-91de-8cf3d67a0923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:30:21.441326 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1450/2895] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:30:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:30:21.449205 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4d6ea1-0d08-42ea-b16e-14e46bf7f15c None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:30:21.474723 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4d6ea1-0d08-42ea-b16e-14e46bf7f15c None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:30:21.489842 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed983771-7b51-4b1d-ac30-248570c931d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:30:21.490718 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed983771-7b51-4b1d-ac30-248570c931d0 admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:30:21.490718 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed983771-7b51-4b1d-ac30-248570c931d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:30:21.491078 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed983771-7b51-4b1d-ac30-248570c931d0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:30:21.492102 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed983771-7b51-4b1d-ac30-248570c931d0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:30:21.492530 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed983771-7b51-4b1d-ac30-248570c931d0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:30:21.495143 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed983771-7b51-4b1d-ac30-248570c931d0 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:30:21.519580 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1446/2896] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 31 00:30:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:30:21.522960 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24293d18-d34e-4042-91de-8cf3d67a0923 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:30:21.546139 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24293d18-d34e-4042-91de-8cf3d67a0923 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:30:21.554847 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4dd6af-3ca7-423d-abcd-f2edd9f0d308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:30:21.555932 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4dd6af-3ca7-423d-abcd-f2edd9f0d308 admin admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:30:21.556928 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4dd6af-3ca7-423d-abcd-f2edd9f0d308 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:30:21.556928 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4dd6af-3ca7-423d-abcd-f2edd9f0d308 admin admin] PATH_INFO: `/v3/projects` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:30:21.557493 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4dd6af-3ca7-423d-abcd-f2edd9f0d308 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:30:21.560018 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4dd6af-3ca7-423d-abcd-f2edd9f0d308 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:30:21.603108 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1451/2897] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 31 00:30:21 2022] POST /identity/v3/projects => generated 391 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:30:21.608623 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed983771-7b51-4b1d-ac30-248570c931d0 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:30:21.619777 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed983771-7b51-4b1d-ac30-248570c931d0 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:30:21.717843 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7402beff-6c40-4681-80e3-fcfb815fa36f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:30:21.718503 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7402beff-6c40-4681-80e3-fcfb815fa36f admin admin] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:30:21.718787 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7402beff-6c40-4681-80e3-fcfb815fa36f admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:30:21.719067 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7402beff-6c40-4681-80e3-fcfb815fa36f admin admin] PATH_INFO: `/v3/users` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:30:21.719810 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7402beff-6c40-4681-80e3-fcfb815fa36f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:30:21.721987 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7402beff-6c40-4681-80e3-fcfb815fa36f admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:30:21.749037 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1447/2898] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 31 00:30:21 2022] POST /identity/v3/users => generated 296 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:30:21.754468 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4dd6af-3ca7-423d-abcd-f2edd9f0d308 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:30:21.773696 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4dd6af-3ca7-423d-abcd-f2edd9f0d308 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:30:21.782728 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa36d5fa-7efb-4e65-b00e-96c3c6210c55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:30:21.783555 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa36d5fa-7efb-4e65-b00e-96c3c6210c55 admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:30:21.783955 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa36d5fa-7efb-4e65-b00e-96c3c6210c55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:30:21.784385 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa36d5fa-7efb-4e65-b00e-96c3c6210c55 admin admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:30:21.785163 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa36d5fa-7efb-4e65-b00e-96c3c6210c55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:30:21.787070 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa36d5fa-7efb-4e65-b00e-96c3c6210c55 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:30:21.800746 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1452/2899] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 00:30:21 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:30:21.805135 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7402beff-6c40-4681-80e3-fcfb815fa36f admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:30:21.818183 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7402beff-6c40-4681-80e3-fcfb815fa36f admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:30:21.824366 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54a5900-b312-48bf-a1ee-e141533c4501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:30:21.825280 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54a5900-b312-48bf-a1ee-e141533c4501 admin admin] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:30:21.825626 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54a5900-b312-48bf-a1ee-e141533c4501 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:30:21.825966 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54a5900-b312-48bf-a1ee-e141533c4501 admin admin] PATH_INFO: `/v3/roles` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:30:21.826747 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54a5900-b312-48bf-a1ee-e141533c4501 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:30:21.828742 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54a5900-b312-48bf-a1ee-e141533c4501 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:30:21.844003 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1448/2900] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 00:30:21 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 00:30:21.848697 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa36d5fa-7efb-4e65-b00e-96c3c6210c55 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:30:21.860728 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa36d5fa-7efb-4e65-b00e-96c3c6210c55 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:30:21.865412 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d3430c-d9f8-4d94-a31c-40aeb7da5b31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:30:21.866081 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d3430c-d9f8-4d94-a31c-40aeb7da5b31 admin admin] REQUEST_METHOD: `PUT` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:30:21.866648 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d3430c-d9f8-4d94-a31c-40aeb7da5b31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:30:21.866926 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d3430c-d9f8-4d94-a31c-40aeb7da5b31 admin admin] PATH_INFO: `/v3/projects/7cb467316e1e464783859584cb828833/users/824e926b00624b11967635052c1d2b9c/roles/fdad79ffbcbb4fa380dc9cf7dd108618` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:30:21.886760 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d3430c-d9f8-4d94-a31c-40aeb7da5b31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7cb467316e1e464783859584cb828833, user_id=824e926b00624b11967635052c1d2b9c, role_id=fdad79ffbcbb4fa380dc9cf7dd108618)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:30:21.889912 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d3430c-d9f8-4d94-a31c-40aeb7da5b31 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:30:21.905350 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1453/2901] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 00:30:21 2022] PUT /identity/v3/projects/7cb467316e1e464783859584cb828833/users/824e926b00624b11967635052c1d2b9c/roles/fdad79ffbcbb4fa380dc9cf7dd108618 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:30:21.916442 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940a85c8-a271-41c3-aaee-d2bc097cae44 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:30:21.916728 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940a85c8-a271-41c3-aaee-d2bc097cae44 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:30:21.917005 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940a85c8-a271-41c3-aaee-d2bc097cae44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:30:21.958198 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-940a85c8-a271-41c3-aaee-d2bc097cae44 None None] MFA Rules not processed for user `824e926b00624b11967635052c1d2b9c`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:30:21.960396 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-940a85c8-a271-41c3-aaee-d2bc097cae44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:30:22.085911 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1449/2902] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:30:21 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:30:22.107161 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d3430c-d9f8-4d94-a31c-40aeb7da5b31 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:30:22.111722 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-82d3430c-d9f8-4d94-a31c-40aeb7da5b31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:30:22.240004 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d3430c-d9f8-4d94-a31c-40aeb7da5b31 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:30:22.245479 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e21f267-13fe-4d13-a135-f3497301dbdc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beecda6e9feb400288618745c784989f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:30:22.246063 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e21f267-13fe-4d13-a135-f3497301dbdc service cinder] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:30:22.246338 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e21f267-13fe-4d13-a135-f3497301dbdc service cinder] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:30:22.246617 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e21f267-13fe-4d13-a135-f3497301dbdc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:30:22.259157 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e21f267-13fe-4d13-a135-f3497301dbdc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:30:22.260027 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e21f267-13fe-4d13-a135-f3497301dbdc service cinder] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:30:22.271413 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1454/2903] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:30:22 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 00:30:29.343080 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940a85c8-a271-41c3-aaee-d2bc097cae44 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:30:29.344991 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-940a85c8-a271-41c3-aaee-d2bc097cae44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:30:29.392443 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:30:29.434820 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940a85c8-a271-41c3-aaee-d2bc097cae44 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:30:29.439625 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854cad41-c7dd-4c40-8d4d-47b476f38495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:30:29.440310 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854cad41-c7dd-4c40-8d4d-47b476f38495 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:30:29.440593 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854cad41-c7dd-4c40-8d4d-47b476f38495 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:30:29.440867 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854cad41-c7dd-4c40-8d4d-47b476f38495 admin admin] PATH_INFO: `/v3/users/cacf8da1fc48427eacc993769c4f9f3a` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:30:29.442048 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854cad41-c7dd-4c40-8d4d-47b476f38495 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cacf8da1fc48427eacc993769c4f9f3a)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:30:29.444018 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854cad41-c7dd-4c40-8d4d-47b476f38495 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:30:29.501458 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-854cad41-c7dd-4c40-8d4d-47b476f38495 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cacf8da1fc48427eacc993769c4f9f3a'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:30:29.509677 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-854cad41-c7dd-4c40-8d4d-47b476f38495 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cacf8da1fc48427eacc993769c4f9f3a'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:30:29.520144 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-854cad41-c7dd-4c40-8d4d-47b476f38495 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cacf8da1fc48427eacc993769c4f9f3a'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:30:29.544913 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-854cad41-c7dd-4c40-8d4d-47b476f38495 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cacf8da1fc48427eacc993769c4f9f3a'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:30:29.545812 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-854cad41-c7dd-4c40-8d4d-47b476f38495 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cacf8da1fc48427eacc993769c4f9f3a'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:30:29.553503 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1450/2904] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 31 00:30:29 2022] DELETE /identity/v3/users/cacf8da1fc48427eacc993769c4f9f3a => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:30:29.787738 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e21f267-13fe-4d13-a135-f3497301dbdc service cinder] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:30:29.807463 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e21f267-13fe-4d13-a135-f3497301dbdc service cinder] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:30:29.862009 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:30:29.889626 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b1c0ea-cce7-4916-8010-49983a5a9d2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:30:29.890270 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b1c0ea-cce7-4916-8010-49983a5a9d2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:30:29.890564 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b1c0ea-cce7-4916-8010-49983a5a9d2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:30:29.890837 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b1c0ea-cce7-4916-8010-49983a5a9d2e admin admin] PATH_INFO: `/v3/projects/d2b2473cfa244cf1aaaa6e4dac08a3d6` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:30:29.892064 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b1c0ea-cce7-4916-8010-49983a5a9d2e admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2b2473cfa244cf1aaaa6e4dac08a3d6)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:30:29.894050 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b1c0ea-cce7-4916-8010-49983a5a9d2e admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:30:29.954524 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-19b1c0ea-cce7-4916-8010-49983a5a9d2e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2b2473cfa244cf1aaaa6e4dac08a3d6', 'request_id': 'req-19b1c0ea-cce7-4916-8010-49983a5a9d2e'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:30:29.964006 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-19b1c0ea-cce7-4916-8010-49983a5a9d2e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2b2473cfa244cf1aaaa6e4dac08a3d6', 'request_id': 'req-19b1c0ea-cce7-4916-8010-49983a5a9d2e'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:30:29.971100 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-19b1c0ea-cce7-4916-8010-49983a5a9d2e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2b2473cfa244cf1aaaa6e4dac08a3d6', 'request_id': 'req-19b1c0ea-cce7-4916-8010-49983a5a9d2e'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:30:29.987119 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-19b1c0ea-cce7-4916-8010-49983a5a9d2e admin admin] The token cache is being invalidate because project d2b2473cfa244cf1aaaa6e4dac08a3d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:30:29.987589 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-19b1c0ea-cce7-4916-8010-49983a5a9d2e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:30:29.989907 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-19b1c0ea-cce7-4916-8010-49983a5a9d2e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:30:29.990700 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1455/2905] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 31 00:30:29 2022] DELETE /identity/v3/projects/d2b2473cfa244cf1aaaa6e4dac08a3d6 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:30:29.995327 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854cad41-c7dd-4c40-8d4d-47b476f38495 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:30:29.997075 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-854cad41-c7dd-4c40-8d4d-47b476f38495 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:30:30.012322 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854cad41-c7dd-4c40-8d4d-47b476f38495 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:30:30.106186 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a16ff83-16c4-49b0-bfad-e159b69c4625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:30:30.107087 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a16ff83-16c4-49b0-bfad-e159b69c4625 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:30:30.107542 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a16ff83-16c4-49b0-bfad-e159b69c4625 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:30:30.108024 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a16ff83-16c4-49b0-bfad-e159b69c4625 admin admin] PATH_INFO: `/v3/users/2c0fe3990f3b4aa8a8ea974e73342c0f` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:30:30.110164 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a16ff83-16c4-49b0-bfad-e159b69c4625 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c0fe3990f3b4aa8a8ea974e73342c0f)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:30:30.113798 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a16ff83-16c4-49b0-bfad-e159b69c4625 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:30:30.188293 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-4a16ff83-16c4-49b0-bfad-e159b69c4625 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c0fe3990f3b4aa8a8ea974e73342c0f'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:30:30.195046 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:30:30.198052 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-4a16ff83-16c4-49b0-bfad-e159b69c4625 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c0fe3990f3b4aa8a8ea974e73342c0f'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:30:30.209807 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-4a16ff83-16c4-49b0-bfad-e159b69c4625 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c0fe3990f3b4aa8a8ea974e73342c0f'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:30:30.229113 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-4a16ff83-16c4-49b0-bfad-e159b69c4625 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c0fe3990f3b4aa8a8ea974e73342c0f'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:30:30.230292 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-4a16ff83-16c4-49b0-bfad-e159b69c4625 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c0fe3990f3b4aa8a8ea974e73342c0f'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:30:30.240980 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1451/2906] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 31 00:30:29 2022] DELETE /identity/v3/users/2c0fe3990f3b4aa8a8ea974e73342c0f => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:30:30.475161 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b1c0ea-cce7-4916-8010-49983a5a9d2e admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:30:30.478483 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-19b1c0ea-cce7-4916-8010-49983a5a9d2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:30:30.501913 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b1c0ea-cce7-4916-8010-49983a5a9d2e admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:30:30.605332 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49e6b31-ee08-415e-85b5-feddb191681d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:30:30.606048 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49e6b31-ee08-415e-85b5-feddb191681d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:30:30.606335 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49e6b31-ee08-415e-85b5-feddb191681d admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:30:30.606614 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49e6b31-ee08-415e-85b5-feddb191681d admin admin] PATH_INFO: `/v3/projects/51a9e9ece54741ef8c65759bfb81afc1` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:30:30.608029 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49e6b31-ee08-415e-85b5-feddb191681d admin admin] RBAC: Authorizing `identity:delete_project(project_id=51a9e9ece54741ef8c65759bfb81afc1)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:30:30.610135 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49e6b31-ee08-415e-85b5-feddb191681d admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:30:30.677419 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-a49e6b31-ee08-415e-85b5-feddb191681d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51a9e9ece54741ef8c65759bfb81afc1', 'request_id': 'req-a49e6b31-ee08-415e-85b5-feddb191681d'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:30:30.686678 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-a49e6b31-ee08-415e-85b5-feddb191681d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51a9e9ece54741ef8c65759bfb81afc1', 'request_id': 'req-a49e6b31-ee08-415e-85b5-feddb191681d'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:30:30.694731 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-a49e6b31-ee08-415e-85b5-feddb191681d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51a9e9ece54741ef8c65759bfb81afc1', 'request_id': 'req-a49e6b31-ee08-415e-85b5-feddb191681d'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:30:30.707189 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:30:30.711694 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-a49e6b31-ee08-415e-85b5-feddb191681d admin admin] The token cache is being invalidate because project 51a9e9ece54741ef8c65759bfb81afc1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:30:30.713035 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-a49e6b31-ee08-415e-85b5-feddb191681d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:30:30.714011 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-a49e6b31-ee08-415e-85b5-feddb191681d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:30:30.724320 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1456/2907] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 31 00:30:30 2022] DELETE /identity/v3/projects/51a9e9ece54741ef8c65759bfb81afc1 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:30:34.988070 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a16ff83-16c4-49b0-bfad-e159b69c4625 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:30:34.989997 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-4a16ff83-16c4-49b0-bfad-e159b69c4625 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:30:35.059929 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a16ff83-16c4-49b0-bfad-e159b69c4625 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:30:35.120134 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29bb774-2b28-4b62-91e9-e9696914635f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'daae792cd11d4c4ca7aae0558998aced', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:30:35.120813 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29bb774-2b28-4b62-91e9-e9696914635f service neutron] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:30:35.121073 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29bb774-2b28-4b62-91e9-e9696914635f service neutron] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:30:35.121357 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29bb774-2b28-4b62-91e9-e9696914635f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:30:35.123222 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-c29bb774-2b28-4b62-91e9-e9696914635f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:30:35.226371 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29bb774-2b28-4b62-91e9-e9696914635f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:30:35.228459 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29bb774-2b28-4b62-91e9-e9696914635f service neutron] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:30:35.241027 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1452/2908] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:30:34 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:30:38.880626 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d3495e-e113-4f99-9797-9987ec18d27a None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:30:38.881457 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d3495e-e113-4f99-9797-9987ec18d27a None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:30:38.881457 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d3495e-e113-4f99-9797-9987ec18d27a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:30:38.902902 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-88d3495e-e113-4f99-9797-9987ec18d27a None None] MFA Rules not processed for user `4f5ea3b457d546b0b9c362085a90e2ed`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:30:38.904141 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-88d3495e-e113-4f99-9797-9987ec18d27a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:30:38.970307 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1457/2909] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:30:38 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:30:39.017700 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29bb774-2b28-4b62-91e9-e9696914635f service neutron] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:30:39.019211 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-c29bb774-2b28-4b62-91e9-e9696914635f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:30:39.059899 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:30:39.121542 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29bb774-2b28-4b62-91e9-e9696914635f service neutron] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:30:39.125771 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30455ab-a626-4fa4-839b-f0e324ea1043 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc025521e1dc4c91ab50a8718a87754f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:30:39.126787 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30455ab-a626-4fa4-839b-f0e324ea1043 service glance] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:30:39.127257 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30455ab-a626-4fa4-839b-f0e324ea1043 service glance] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:30:39.127592 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30455ab-a626-4fa4-839b-f0e324ea1043 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:30:39.129766 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-c30455ab-a626-4fa4-839b-f0e324ea1043 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:30:39.146759 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30455ab-a626-4fa4-839b-f0e324ea1043 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:30:39.148276 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30455ab-a626-4fa4-839b-f0e324ea1043 service glance] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:30:39.162747 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1453/2910] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:30:39 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:30:40.655614 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d3495e-e113-4f99-9797-9987ec18d27a None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:30:40.657185 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-88d3495e-e113-4f99-9797-9987ec18d27a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:30:40.756502 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d3495e-e113-4f99-9797-9987ec18d27a None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:30:40.765907 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74b4496-52e3-4d84-aa3f-f689ef3406a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:30:40.767016 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74b4496-52e3-4d84-aa3f-f689ef3406a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:30:40.767515 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74b4496-52e3-4d84-aa3f-f689ef3406a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:30:40.768013 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74b4496-52e3-4d84-aa3f-f689ef3406a6 admin admin] PATH_INFO: `/v3/users/824e926b00624b11967635052c1d2b9c` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:30:40.770340 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74b4496-52e3-4d84-aa3f-f689ef3406a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=824e926b00624b11967635052c1d2b9c)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:30:40.774535 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74b4496-52e3-4d84-aa3f-f689ef3406a6 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:30:40.853839 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-c74b4496-52e3-4d84-aa3f-f689ef3406a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '824e926b00624b11967635052c1d2b9c'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:30:40.863224 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-c74b4496-52e3-4d84-aa3f-f689ef3406a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '824e926b00624b11967635052c1d2b9c'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:30:40.873354 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-c74b4496-52e3-4d84-aa3f-f689ef3406a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '824e926b00624b11967635052c1d2b9c'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:30:40.874155 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-c74b4496-52e3-4d84-aa3f-f689ef3406a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '824e926b00624b11967635052c1d2b9c'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:30:40.890796 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-c74b4496-52e3-4d84-aa3f-f689ef3406a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '824e926b00624b11967635052c1d2b9c'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:30:40.898280 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1458/2911] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 31 00:30:40 2022] DELETE /identity/v3/users/824e926b00624b11967635052c1d2b9c => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:30:40.903650 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7875401a-c852-4cb0-afee-afa068ae0782 None None] REQUEST_METHOD: `POST` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:30:40.904307 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7875401a-c852-4cb0-afee-afa068ae0782 None None] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:30:40.904447 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7875401a-c852-4cb0-afee-afa068ae0782 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:30:40.925732 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.auth.core [None req-7875401a-c852-4cb0-afee-afa068ae0782 None None] MFA Rules not processed for user `11b70534c08c4c45883d75f7a7aeed08`. Rule list: `[]` (Enabled: `True`). {{(pid=81523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:30:40.926943 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-7875401a-c852-4cb0-afee-afa068ae0782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:30:41.012591 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1454/2912] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:30:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:30:41.026828 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74b4496-52e3-4d84-aa3f-f689ef3406a6 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:30:41.029093 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-c74b4496-52e3-4d84-aa3f-f689ef3406a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:30:41.069270 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:30:41.115776 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74b4496-52e3-4d84-aa3f-f689ef3406a6 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:30:41.123906 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14817cc-7630-4eef-a744-8366b2e97392 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'daae792cd11d4c4ca7aae0558998aced', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:30:41.125389 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14817cc-7630-4eef-a744-8366b2e97392 service neutron] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:30:41.126031 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14817cc-7630-4eef-a744-8366b2e97392 service neutron] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:30:41.126654 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14817cc-7630-4eef-a744-8366b2e97392 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:30:41.146839 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14817cc-7630-4eef-a744-8366b2e97392 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:30:41.148605 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14817cc-7630-4eef-a744-8366b2e97392 service neutron] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:30:41.181197 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1459/2913] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:30:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:30:41.769922 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7875401a-c852-4cb0-afee-afa068ae0782 None None] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:30:41.771751 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-7875401a-c852-4cb0-afee-afa068ae0782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:30:41.785059 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7875401a-c852-4cb0-afee-afa068ae0782 None None] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:30:41.791027 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eee3248-3621-43f5-9c3c-cbe85c1e09c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:30:41.791706 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eee3248-3621-43f5-9c3c-cbe85c1e09c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:30:41.792088 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eee3248-3621-43f5-9c3c-cbe85c1e09c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:30:41.792431 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eee3248-3621-43f5-9c3c-cbe85c1e09c8 admin admin] PATH_INFO: `/v3/projects/7cb467316e1e464783859584cb828833` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:30:41.794642 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eee3248-3621-43f5-9c3c-cbe85c1e09c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7cb467316e1e464783859584cb828833)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:30:41.795829 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eee3248-3621-43f5-9c3c-cbe85c1e09c8 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:30:41.882971 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-3eee3248-3621-43f5-9c3c-cbe85c1e09c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7cb467316e1e464783859584cb828833', 'request_id': 'req-3eee3248-3621-43f5-9c3c-cbe85c1e09c8'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:30:41.894992 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-3eee3248-3621-43f5-9c3c-cbe85c1e09c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7cb467316e1e464783859584cb828833', 'request_id': 'req-3eee3248-3621-43f5-9c3c-cbe85c1e09c8'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:30:41.904555 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-3eee3248-3621-43f5-9c3c-cbe85c1e09c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7cb467316e1e464783859584cb828833', 'request_id': 'req-3eee3248-3621-43f5-9c3c-cbe85c1e09c8'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:30:41.920499 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-3eee3248-3621-43f5-9c3c-cbe85c1e09c8 admin admin] The token cache is being invalidate because project 7cb467316e1e464783859584cb828833 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81523) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:30:41.920949 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-3eee3248-3621-43f5-9c3c-cbe85c1e09c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:30:41.921777 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-3eee3248-3621-43f5-9c3c-cbe85c1e09c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:30:41.929582 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1455/2914] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 31 00:30:41 2022] DELETE /identity/v3/projects/7cb467316e1e464783859584cb828833 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:30:51.160787 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=15 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:30:51.916644 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=76,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:30:59.332680 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce55d814-1119-412e-9959-e15983a6ca6d None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:30:59.333807 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce55d814-1119-412e-9959-e15983a6ca6d None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:30:59.333807 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce55d814-1119-412e-9959-e15983a6ca6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:30:59.394507 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-ce55d814-1119-412e-9959-e15983a6ca6d None None] MFA Rules not processed for user `601aa9e547aa4d42bef6753b26f48eaa`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:30:59.395843 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-ce55d814-1119-412e-9959-e15983a6ca6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:30:59.478064 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1460/2915] 10.222.0.47 () {58 vars in 1009 bytes} [Wed Aug 31 00:30:59 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:30:59.490865 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eee3248-3621-43f5-9c3c-cbe85c1e09c8 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:30:59.493053 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-3eee3248-3621-43f5-9c3c-cbe85c1e09c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:30:59.617936 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eee3248-3621-43f5-9c3c-cbe85c1e09c8 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:30:59.626938 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4494e4e3-2921-42c7-bb92-fe4787f9dbf5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffbfbf19509645f49dbf9566e447c8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:30:59.627983 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4494e4e3-2921-42c7-bb92-fe4787f9dbf5 service swift] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:30:59.628568 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4494e4e3-2921-42c7-bb92-fe4787f9dbf5 service swift] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:30:59.629055 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4494e4e3-2921-42c7-bb92-fe4787f9dbf5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:30:59.646439 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4494e4e3-2921-42c7-bb92-fe4787f9dbf5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:30:59.649617 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4494e4e3-2921-42c7-bb92-fe4787f9dbf5 service swift] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:30:59.664896 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1456/2916] 10.222.0.47 () {60 vars in 1384 bytes} [Wed Aug 31 00:30:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 31 00:31:09.474006 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=40 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:31:09.659031 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=41 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:31:17.565830 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413e3d66-826d-4c4e-84fd-20c2ed6370de None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:31:17.566448 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413e3d66-826d-4c4e-84fd-20c2ed6370de None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:31:17.566448 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413e3d66-826d-4c4e-84fd-20c2ed6370de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:31:17.590291 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-413e3d66-826d-4c4e-84fd-20c2ed6370de None None] MFA Rules not processed for user `601aa9e547aa4d42bef6753b26f48eaa`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:31:17.591565 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-413e3d66-826d-4c4e-84fd-20c2ed6370de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:31:17.599500 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1461/2917] 10.222.0.47 () {58 vars in 967 bytes} [Wed Aug 31 00:31:17 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:31:17.617495 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4494e4e3-2921-42c7-bb92-fe4787f9dbf5 service swift] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:31:17.629368 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4494e4e3-2921-42c7-bb92-fe4787f9dbf5 service swift] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:31:17.636305 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4726da4-ebdc-4a5d-be4f-fe4c6f011dfb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffbfbf19509645f49dbf9566e447c8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:31:17.637091 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4726da4-ebdc-4a5d-be4f-fe4c6f011dfb service swift] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:31:17.637409 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4726da4-ebdc-4a5d-be4f-fe4c6f011dfb service swift] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:31:17.637720 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4726da4-ebdc-4a5d-be4f-fe4c6f011dfb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:31:17.648247 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4726da4-ebdc-4a5d-be4f-fe4c6f011dfb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:31:17.650281 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4726da4-ebdc-4a5d-be4f-fe4c6f011dfb service swift] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:31:17.660004 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1457/2918] 10.222.0.47 () {60 vars in 1384 bytes} [Wed Aug 31 00:31:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 31 00:31:19.838032 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413e3d66-826d-4c4e-84fd-20c2ed6370de None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:31:19.839550 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-413e3d66-826d-4c4e-84fd-20c2ed6370de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:31:19.938404 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413e3d66-826d-4c4e-84fd-20c2ed6370de None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:31:19.943332 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36981a8-5d0e-4f17-b9fb-85b80d0af95d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:31:19.944216 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36981a8-5d0e-4f17-b9fb-85b80d0af95d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:31:19.945292 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36981a8-5d0e-4f17-b9fb-85b80d0af95d admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:31:19.945292 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36981a8-5d0e-4f17-b9fb-85b80d0af95d admin admin] PATH_INFO: `/v3/users/4f5ea3b457d546b0b9c362085a90e2ed` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:31:19.947337 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36981a8-5d0e-4f17-b9fb-85b80d0af95d admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f5ea3b457d546b0b9c362085a90e2ed)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:31:19.949447 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36981a8-5d0e-4f17-b9fb-85b80d0af95d admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:31:20.009161 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-f36981a8-5d0e-4f17-b9fb-85b80d0af95d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f5ea3b457d546b0b9c362085a90e2ed'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:31:20.017952 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-f36981a8-5d0e-4f17-b9fb-85b80d0af95d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f5ea3b457d546b0b9c362085a90e2ed'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:31:20.027792 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-f36981a8-5d0e-4f17-b9fb-85b80d0af95d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f5ea3b457d546b0b9c362085a90e2ed'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:31:20.028596 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-f36981a8-5d0e-4f17-b9fb-85b80d0af95d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f5ea3b457d546b0b9c362085a90e2ed'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:31:20.043886 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-f36981a8-5d0e-4f17-b9fb-85b80d0af95d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f5ea3b457d546b0b9c362085a90e2ed'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:31:20.050741 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1462/2919] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 31 00:31:19 2022] DELETE /identity/v3/users/4f5ea3b457d546b0b9c362085a90e2ed => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:31:20.252281 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4726da4-ebdc-4a5d-be4f-fe4c6f011dfb service swift] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:31:20.263764 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4726da4-ebdc-4a5d-be4f-fe4c6f011dfb service swift] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:31:20.334651 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e2b4ea-6b78-4342-8dae-e9c0a1e9b75b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:31:20.335879 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e2b4ea-6b78-4342-8dae-e9c0a1e9b75b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:31:20.336327 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e2b4ea-6b78-4342-8dae-e9c0a1e9b75b admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:31:20.336706 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e2b4ea-6b78-4342-8dae-e9c0a1e9b75b admin admin] PATH_INFO: `/v3/projects/0c60f381dfb74597b07208b0c080987f` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:31:20.337993 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e2b4ea-6b78-4342-8dae-e9c0a1e9b75b admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c60f381dfb74597b07208b0c080987f)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:31:20.340065 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e2b4ea-6b78-4342-8dae-e9c0a1e9b75b admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:31:20.396115 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-84e2b4ea-6b78-4342-8dae-e9c0a1e9b75b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c60f381dfb74597b07208b0c080987f', 'request_id': 'req-84e2b4ea-6b78-4342-8dae-e9c0a1e9b75b'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:31:20.404653 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-84e2b4ea-6b78-4342-8dae-e9c0a1e9b75b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c60f381dfb74597b07208b0c080987f', 'request_id': 'req-84e2b4ea-6b78-4342-8dae-e9c0a1e9b75b'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:31:20.411880 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-84e2b4ea-6b78-4342-8dae-e9c0a1e9b75b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c60f381dfb74597b07208b0c080987f', 'request_id': 'req-84e2b4ea-6b78-4342-8dae-e9c0a1e9b75b'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:31:20.427069 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-84e2b4ea-6b78-4342-8dae-e9c0a1e9b75b admin admin] The token cache is being invalidate because project 0c60f381dfb74597b07208b0c080987f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81523) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:31:20.427453 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-84e2b4ea-6b78-4342-8dae-e9c0a1e9b75b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:31:20.428030 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-84e2b4ea-6b78-4342-8dae-e9c0a1e9b75b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:31:20.430203 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1458/2920] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 31 00:31:20 2022] DELETE /identity/v3/projects/0c60f381dfb74597b07208b0c080987f => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:31:24.980980 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36981a8-5d0e-4f17-b9fb-85b80d0af95d admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:31:24.983249 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-f36981a8-5d0e-4f17-b9fb-85b80d0af95d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:31:25.060459 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36981a8-5d0e-4f17-b9fb-85b80d0af95d admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:31:25.098801 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:31:25.131279 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4cf0bd-b336-4a54-83a1-f8cef55d81ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'daae792cd11d4c4ca7aae0558998aced', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:31:25.132670 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4cf0bd-b336-4a54-83a1-f8cef55d81ac service neutron] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:31:25.132945 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4cf0bd-b336-4a54-83a1-f8cef55d81ac service neutron] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:31:25.133221 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4cf0bd-b336-4a54-83a1-f8cef55d81ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:31:25.135085 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-ce4cf0bd-b336-4a54-83a1-f8cef55d81ac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:31:25.149283 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4cf0bd-b336-4a54-83a1-f8cef55d81ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:31:25.150891 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4cf0bd-b336-4a54-83a1-f8cef55d81ac service neutron] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:31:25.161718 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1463/2921] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:31:24 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:31:25.980749 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e2b4ea-6b78-4342-8dae-e9c0a1e9b75b admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:31:25.982306 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-84e2b4ea-6b78-4342-8dae-e9c0a1e9b75b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:31:26.053676 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e2b4ea-6b78-4342-8dae-e9c0a1e9b75b admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:31:26.057731 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6e7ad1-9dcd-45c1-ada0-7321b16352cc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'beecda6e9feb400288618745c784989f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:31:26.058359 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6e7ad1-9dcd-45c1-ada0-7321b16352cc service cinder] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:31:26.058637 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6e7ad1-9dcd-45c1-ada0-7321b16352cc service cinder] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:31:26.058913 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6e7ad1-9dcd-45c1-ada0-7321b16352cc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:31:26.060830 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-5a6e7ad1-9dcd-45c1-ada0-7321b16352cc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:31:26.116907 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:31:26.152587 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6e7ad1-9dcd-45c1-ada0-7321b16352cc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:31:26.154053 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6e7ad1-9dcd-45c1-ada0-7321b16352cc service cinder] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:31:26.166371 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1459/2922] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:31:25 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:31:33.249572 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928b9aa5-49bf-495b-a33a-2d2ef5a4b434 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:31:33.250144 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928b9aa5-49bf-495b-a33a-2d2ef5a4b434 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:31:33.250144 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928b9aa5-49bf-495b-a33a-2d2ef5a4b434 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:31:33.272345 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-928b9aa5-49bf-495b-a33a-2d2ef5a4b434 None None] MFA Rules not processed for user `410f2e9dc2db4ffcb5ff0f67b0d00ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:31:33.273621 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-928b9aa5-49bf-495b-a33a-2d2ef5a4b434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:31:33.280783 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1464/2923] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 00:31:33 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:31:33.662251 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6e7ad1-9dcd-45c1-ada0-7321b16352cc service cinder] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:31:33.663793 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-5a6e7ad1-9dcd-45c1-ada0-7321b16352cc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:31:33.676046 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6e7ad1-9dcd-45c1-ada0-7321b16352cc service cinder] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:31:33.680530 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fc040a-de5a-498a-b48c-c2fc79f8bed1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'daae792cd11d4c4ca7aae0558998aced', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:31:33.681477 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fc040a-de5a-498a-b48c-c2fc79f8bed1 service neutron] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:31:33.681946 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fc040a-de5a-498a-b48c-c2fc79f8bed1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:31:33.682398 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fc040a-de5a-498a-b48c-c2fc79f8bed1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:31:33.684875 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-b1fc040a-de5a-498a-b48c-c2fc79f8bed1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:31:33.703478 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fc040a-de5a-498a-b48c-c2fc79f8bed1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:31:33.706195 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fc040a-de5a-498a-b48c-c2fc79f8bed1 service neutron] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:31:33.722691 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1460/2924] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:31:33 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:31:34.267386 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928b9aa5-49bf-495b-a33a-2d2ef5a4b434 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:31:34.270053 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-928b9aa5-49bf-495b-a33a-2d2ef5a4b434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:31:34.359741 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928b9aa5-49bf-495b-a33a-2d2ef5a4b434 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:31:34.364937 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b0aa00-fbc2-4ce8-9896-b43bb3160a07 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f76e01e32264ff7a6a7740ffa0a207d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:31:34.365653 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b0aa00-fbc2-4ce8-9896-b43bb3160a07 service placement] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:31:34.365968 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b0aa00-fbc2-4ce8-9896-b43bb3160a07 service placement] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:31:34.366613 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b0aa00-fbc2-4ce8-9896-b43bb3160a07 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:31:34.368298 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-84b0aa00-fbc2-4ce8-9896-b43bb3160a07 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:31:34.381051 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b0aa00-fbc2-4ce8-9896-b43bb3160a07 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:31:34.383278 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b0aa00-fbc2-4ce8-9896-b43bb3160a07 service placement] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:31:34.394765 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1465/2925] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:31:34 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:31:37.435710 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fc040a-de5a-498a-b48c-c2fc79f8bed1 service neutron] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:31:37.437359 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-b1fc040a-de5a-498a-b48c-c2fc79f8bed1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:31:37.583517 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fc040a-de5a-498a-b48c-c2fc79f8bed1 service neutron] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:31:37.591472 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7e00ab-56f7-4f12-a7ce-7b31cbb0d47c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea002bf49c248dbae7147665fa10fd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:31:37.592202 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7e00ab-56f7-4f12-a7ce-7b31cbb0d47c service nova] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:31:37.592555 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7e00ab-56f7-4f12-a7ce-7b31cbb0d47c service nova] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:31:37.592957 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7e00ab-56f7-4f12-a7ce-7b31cbb0d47c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:31:37.595001 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-ea7e00ab-56f7-4f12-a7ce-7b31cbb0d47c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:31:37.609855 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7e00ab-56f7-4f12-a7ce-7b31cbb0d47c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:31:37.611494 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7e00ab-56f7-4f12-a7ce-7b31cbb0d47c service nova] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:31:37.625130 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1461/2926] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:31:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 00:31:44.389792 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=48 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:31:47.619069 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=53 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:33:23.946930 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b0aa00-fbc2-4ce8-9896-b43bb3160a07 service placement] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:33:23.948585 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-84b0aa00-fbc2-4ce8-9896-b43bb3160a07 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:33:23.963679 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b0aa00-fbc2-4ce8-9896-b43bb3160a07 service placement] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:33:23.969264 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb21b79-5577-4009-ba2d-6dac4a93e81f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f76e01e32264ff7a6a7740ffa0a207d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:33:23.969899 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb21b79-5577-4009-ba2d-6dac4a93e81f service placement] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:33:23.970177 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb21b79-5577-4009-ba2d-6dac4a93e81f service placement] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:33:23.970453 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb21b79-5577-4009-ba2d-6dac4a93e81f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:33:23.973228 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-acb21b79-5577-4009-ba2d-6dac4a93e81f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:33:23.987327 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb21b79-5577-4009-ba2d-6dac4a93e81f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:33:23.990007 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb21b79-5577-4009-ba2d-6dac4a93e81f service placement] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:33:24.006216 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1466/2927] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:33:23 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:33:30.605426 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7e00ab-56f7-4f12-a7ce-7b31cbb0d47c service nova] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:33:30.607670 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-ea7e00ab-56f7-4f12-a7ce-7b31cbb0d47c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:33:30.625432 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7e00ab-56f7-4f12-a7ce-7b31cbb0d47c service nova] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:33:30.632302 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2cc6aa-0cb3-4d18-9a6e-c905cae1ba92 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea002bf49c248dbae7147665fa10fd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:33:30.632934 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2cc6aa-0cb3-4d18-9a6e-c905cae1ba92 service nova] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:33:30.633219 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2cc6aa-0cb3-4d18-9a6e-c905cae1ba92 service nova] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:33:30.633500 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2cc6aa-0cb3-4d18-9a6e-c905cae1ba92 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:33:30.637829 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-2b2cc6aa-0cb3-4d18-9a6e-c905cae1ba92 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:33:30.653697 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2cc6aa-0cb3-4d18-9a6e-c905cae1ba92 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:33:30.655419 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2cc6aa-0cb3-4d18-9a6e-c905cae1ba92 service nova] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:33:30.672323 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1462/2928] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:33:30 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:33:33.997693 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=6 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:33:36.619977 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb21b79-5577-4009-ba2d-6dac4a93e81f service placement] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:33:36.622487 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-acb21b79-5577-4009-ba2d-6dac4a93e81f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:33:36.643874 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb21b79-5577-4009-ba2d-6dac4a93e81f service placement] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:33:36.650519 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9debb69-f4a2-4100-8a70-3deb46b8b791 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'daae792cd11d4c4ca7aae0558998aced', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:33:36.651970 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9debb69-f4a2-4100-8a70-3deb46b8b791 service neutron] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:33:36.652501 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9debb69-f4a2-4100-8a70-3deb46b8b791 service neutron] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:33:36.653016 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9debb69-f4a2-4100-8a70-3deb46b8b791 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:33:36.656110 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-a9debb69-f4a2-4100-8a70-3deb46b8b791 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:33:36.783337 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9debb69-f4a2-4100-8a70-3deb46b8b791 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:33:36.786000 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9debb69-f4a2-4100-8a70-3deb46b8b791 service neutron] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:33:36.806835 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1467/2929] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:33:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:33:40.664479 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=6 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:33:40.956526 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2cc6aa-0cb3-4d18-9a6e-c905cae1ba92 service nova] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:33:41.011911 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2cc6aa-0cb3-4d18-9a6e-c905cae1ba92 service nova] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:33:41.020298 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f68c04-d04e-4e12-8721-256df2951c16 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f76e01e32264ff7a6a7740ffa0a207d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b647cccb30a427193fc62dbebe0c6f1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:33:41.020939 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f68c04-d04e-4e12-8721-256df2951c16 service placement] REQUEST_METHOD: `GET` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:33:41.021225 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f68c04-d04e-4e12-8721-256df2951c16 service placement] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:33:41.021487 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f68c04-d04e-4e12-8721-256df2951c16 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:33:41.024452 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-15f68c04-d04e-4e12-8721-256df2951c16 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:33:41.040448 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f68c04-d04e-4e12-8721-256df2951c16 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:33:41.043643 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f68c04-d04e-4e12-8721-256df2951c16 service placement] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:33:41.056690 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1463/2930] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 00:33:40 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:33:45.480246 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9debb69-f4a2-4100-8a70-3deb46b8b791 service neutron] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:33:45.481838 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-a9debb69-f4a2-4100-8a70-3deb46b8b791 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:33:45.499871 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9debb69-f4a2-4100-8a70-3deb46b8b791 service neutron] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:33:45.509202 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee4fbdb-bdc6-4801-a958-4f08ebfe1596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:33:45.510303 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee4fbdb-bdc6-4801-a958-4f08ebfe1596 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:33:45.510789 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee4fbdb-bdc6-4801-a958-4f08ebfe1596 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:33:45.511281 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee4fbdb-bdc6-4801-a958-4f08ebfe1596 admin admin] PATH_INFO: `/v3/users/410f2e9dc2db4ffcb5ff0f67b0d00ddc` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:33:45.513535 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee4fbdb-bdc6-4801-a958-4f08ebfe1596 admin admin] RBAC: Authorizing `identity:delete_user(user_id=410f2e9dc2db4ffcb5ff0f67b0d00ddc)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:33:45.517418 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee4fbdb-bdc6-4801-a958-4f08ebfe1596 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:33:45.584920 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-5ee4fbdb-bdc6-4801-a958-4f08ebfe1596 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '410f2e9dc2db4ffcb5ff0f67b0d00ddc'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:33:45.593038 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-5ee4fbdb-bdc6-4801-a958-4f08ebfe1596 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '410f2e9dc2db4ffcb5ff0f67b0d00ddc'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:33:45.604825 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-5ee4fbdb-bdc6-4801-a958-4f08ebfe1596 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '410f2e9dc2db4ffcb5ff0f67b0d00ddc'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:33:45.605614 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-5ee4fbdb-bdc6-4801-a958-4f08ebfe1596 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '410f2e9dc2db4ffcb5ff0f67b0d00ddc'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:33:45.623287 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-5ee4fbdb-bdc6-4801-a958-4f08ebfe1596 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '410f2e9dc2db4ffcb5ff0f67b0d00ddc'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:33:45.631341 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1468/2931] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 31 00:33:45 2022] DELETE /identity/v3/users/410f2e9dc2db4ffcb5ff0f67b0d00ddc => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:33:45.905755 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f68c04-d04e-4e12-8721-256df2951c16 service placement] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:33:45.923768 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f68c04-d04e-4e12-8721-256df2951c16 service placement] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:33:46.001362 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934a0fe4-e356-4bde-ae08-c2ae6b001a64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:33:46.003187 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934a0fe4-e356-4bde-ae08-c2ae6b001a64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:33:46.003187 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934a0fe4-e356-4bde-ae08-c2ae6b001a64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:33:46.004048 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934a0fe4-e356-4bde-ae08-c2ae6b001a64 admin admin] PATH_INFO: `/v3/projects/5e59b45c75cb4f8ea7e7a47730709614` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:33:46.005905 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934a0fe4-e356-4bde-ae08-c2ae6b001a64 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e59b45c75cb4f8ea7e7a47730709614)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:33:46.008367 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934a0fe4-e356-4bde-ae08-c2ae6b001a64 admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:33:46.064662 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-934a0fe4-e356-4bde-ae08-c2ae6b001a64 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e59b45c75cb4f8ea7e7a47730709614', 'request_id': 'req-934a0fe4-e356-4bde-ae08-c2ae6b001a64'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:33:46.076481 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-934a0fe4-e356-4bde-ae08-c2ae6b001a64 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e59b45c75cb4f8ea7e7a47730709614', 'request_id': 'req-934a0fe4-e356-4bde-ae08-c2ae6b001a64'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:33:46.084986 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-934a0fe4-e356-4bde-ae08-c2ae6b001a64 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e59b45c75cb4f8ea7e7a47730709614', 'request_id': 'req-934a0fe4-e356-4bde-ae08-c2ae6b001a64'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:33:46.108079 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-934a0fe4-e356-4bde-ae08-c2ae6b001a64 admin admin] The token cache is being invalidate because project 5e59b45c75cb4f8ea7e7a47730709614 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81523) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:33:46.108635 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-934a0fe4-e356-4bde-ae08-c2ae6b001a64 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:33:46.109970 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-934a0fe4-e356-4bde-ae08-c2ae6b001a64 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:33:46.112690 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1464/2932] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 31 00:33:45 2022] DELETE /identity/v3/projects/5e59b45c75cb4f8ea7e7a47730709614 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:33:46.118459 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee4fbdb-bdc6-4801-a958-4f08ebfe1596 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:33:46.120067 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-5ee4fbdb-bdc6-4801-a958-4f08ebfe1596 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:33:46.134669 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee4fbdb-bdc6-4801-a958-4f08ebfe1596 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:33:46.220137 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abe2940-bc73-4aef-8df2-a8c72c30fa6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:33:46.220730 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abe2940-bc73-4aef-8df2-a8c72c30fa6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:33:46.221015 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abe2940-bc73-4aef-8df2-a8c72c30fa6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:33:46.221421 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abe2940-bc73-4aef-8df2-a8c72c30fa6c admin admin] PATH_INFO: `/v3/users/e32c05e148664ff49bce7ad9ef781e0a` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:33:46.222678 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abe2940-bc73-4aef-8df2-a8c72c30fa6c admin admin] RBAC: Authorizing `identity:delete_user(user_id=e32c05e148664ff49bce7ad9ef781e0a)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:33:46.224706 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abe2940-bc73-4aef-8df2-a8c72c30fa6c admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:33:46.232407 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:33:46.284931 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-1abe2940-bc73-4aef-8df2-a8c72c30fa6c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e32c05e148664ff49bce7ad9ef781e0a'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:33:46.292759 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-1abe2940-bc73-4aef-8df2-a8c72c30fa6c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e32c05e148664ff49bce7ad9ef781e0a'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:33:46.301848 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-1abe2940-bc73-4aef-8df2-a8c72c30fa6c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e32c05e148664ff49bce7ad9ef781e0a'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:33:46.302626 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-1abe2940-bc73-4aef-8df2-a8c72c30fa6c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e32c05e148664ff49bce7ad9ef781e0a'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:33:46.320983 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-1abe2940-bc73-4aef-8df2-a8c72c30fa6c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e32c05e148664ff49bce7ad9ef781e0a'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:33:46.330583 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1469/2933] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 31 00:33:46 2022] DELETE /identity/v3/users/e32c05e148664ff49bce7ad9ef781e0a => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:33:46.543986 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934a0fe4-e356-4bde-ae08-c2ae6b001a64 admin admin] Authenticating user token {{(pid=81523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:33:46.545897 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.fernet_utils [None req-934a0fe4-e356-4bde-ae08-c2ae6b001a64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:33:46.566219 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934a0fe4-e356-4bde-ae08-c2ae6b001a64 admin admin] Validating token access rules against request {{(pid=81523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:33:46.651579 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9f884d-ba77-4bed-ad65-cf22607797eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11b70534c08c4c45883d75f7a7aeed08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '549d5b0e486743c994271a9e51f4023c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:33:46.652262 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9f884d-ba77-4bed-ad65-cf22607797eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:33:46.652539 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9f884d-ba77-4bed-ad65-cf22607797eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:33:46.652808 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9f884d-ba77-4bed-ad65-cf22607797eb admin admin] PATH_INFO: `/v3/projects/3dd11c1f01664ae6be7a03dae5272eae` {{(pid=81523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:33:46.653977 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9f884d-ba77-4bed-ad65-cf22607797eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=3dd11c1f01664ae6be7a03dae5272eae)` {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:33:46.656329 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9f884d-ba77-4bed-ad65-cf22607797eb admin admin] RBAC: Authorization granted {{(pid=81523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:33:46.682560 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:33:46.717087 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-df9f884d-ba77-4bed-ad65-cf22607797eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3dd11c1f01664ae6be7a03dae5272eae', 'request_id': 'req-df9f884d-ba77-4bed-ad65-cf22607797eb'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:33:46.725942 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-df9f884d-ba77-4bed-ad65-cf22607797eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3dd11c1f01664ae6be7a03dae5272eae', 'request_id': 'req-df9f884d-ba77-4bed-ad65-cf22607797eb'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:33:46.733038 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-df9f884d-ba77-4bed-ad65-cf22607797eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3dd11c1f01664ae6be7a03dae5272eae', 'request_id': 'req-df9f884d-ba77-4bed-ad65-cf22607797eb'} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:33:46.754525 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-df9f884d-ba77-4bed-ad65-cf22607797eb admin admin] The token cache is being invalidate because project 3dd11c1f01664ae6be7a03dae5272eae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81523) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:33:46.755449 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-df9f884d-ba77-4bed-ad65-cf22607797eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:33:46.757270 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG keystone.notifications [None req-df9f884d-ba77-4bed-ad65-cf22607797eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:33:46.762629 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: [pid: 81523|app: 0|req: 1465/2934] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 31 00:33:46 2022] DELETE /identity/v3/projects/3dd11c1f01664ae6be7a03dae5272eae => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:33:56.324053 dv-cinder-852210-5-iscsi devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=23,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:33:56.746004 dv-cinder-852210-5-iscsi devstack@keystone.service[81523]: DEBUG dbcounter [-] [81523] Writing DB stats keystone:SELECT=16,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}